2025-10-13 19:20:54.919472 | Job console starting... 2025-10-13 19:20:54.940375 | Updating repositories 2025-10-13 19:20:55.046111 | Preparing job workspace 2025-10-13 19:21:07.361683 | Running Ansible setup... 2025-10-13 19:21:13.884884 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-10-13 19:21:14.516504 | 2025-10-13 19:21:14.516644 | PLAY [localhost] 2025-10-13 19:21:14.525905 | 2025-10-13 19:21:14.526019 | TASK [Gathering Facts] 2025-10-13 19:21:15.737462 | localhost | ok 2025-10-13 19:21:15.752193 | 2025-10-13 19:21:15.752357 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2025-10-13 19:21:16.201884 | localhost -> localhost | changed 2025-10-13 19:21:16.207697 | 2025-10-13 19:21:16.207810 | TASK [log-inventory : Copy ansible inventory to logs dir] 2025-10-13 19:21:17.112425 | localhost -> localhost | changed 2025-10-13 19:21:17.128039 | 2025-10-13 19:21:17.128244 | TASK [Setup log path fact] 2025-10-13 19:21:17.152670 | localhost | ok 2025-10-13 19:21:17.168314 | 2025-10-13 19:21:17.168416 | TASK [set-zuul-log-path-fact : Set log path for a build] 2025-10-13 19:21:17.198088 | localhost | ok 2025-10-13 19:21:17.206419 | 2025-10-13 19:21:17.206494 | TASK [emit-job-header : Print job information] 2025-10-13 19:21:17.234546 | # Job Information 2025-10-13 19:21:17.234757 | Ansible Version: 2.15.12 2025-10-13 19:21:17.234789 | Job: cifmw-multinode-kuttl 2025-10-13 19:21:17.234809 | Pipeline: github-check 2025-10-13 19:21:17.234827 | Executor: ze03.softwarefactory-project.io 2025-10-13 19:21:17.234845 | Triggered by: https://github.com/openstack-k8s-operators/ci-framework/pull/3402 2025-10-13 19:21:17.234864 | Log URL (when completed): https://logserver.rdoproject.org/99d/rdoproject.org/99d5f1cd38d94d13a70c490f97e6f024/ 2025-10-13 19:21:17.234883 | Event ID: 8207d830-a869-11f0-8ae9-c38a08a1225e 2025-10-13 19:21:17.239076 | 2025-10-13 19:21:17.239143 | LOOP [emit-job-header : Print node information] 2025-10-13 19:21:17.390667 | localhost | ok: 2025-10-13 19:21:17.390958 | localhost | # Node Information 2025-10-13 19:21:17.390987 | localhost | Inventory Hostname: controller 2025-10-13 19:21:17.391009 | localhost | Hostname: np0005486072 2025-10-13 19:21:17.391030 | localhost | Username: zuul 2025-10-13 19:21:17.391050 | localhost | Distro: CentOS 9 2025-10-13 19:21:17.391068 | localhost | Provider: vexxhost-nodepool-tripleo 2025-10-13 19:21:17.391086 | localhost | Region: RegionOne 2025-10-13 19:21:17.391103 | localhost | Label: cloud-centos-9-stream-tripleo-medium 2025-10-13 19:21:17.391119 | localhost | Product Name: OpenStack Nova 2025-10-13 19:21:17.391136 | localhost | Interface IP: 38.102.83.182 2025-10-13 19:21:17.480390 | localhost | ok: 2025-10-13 19:21:17.480505 | localhost | # Node Information 2025-10-13 19:21:17.480530 | localhost | Inventory Hostname: crc 2025-10-13 19:21:17.480551 | localhost | Hostname: crc 2025-10-13 19:21:17.480571 | localhost | Username: core 2025-10-13 19:21:17.480589 | localhost | Distro: RedHat 4.18 2025-10-13 19:21:17.480606 | localhost | Provider: vexxhost-nodepool-tripleo 2025-10-13 19:21:17.480625 | localhost | Region: RegionOne 2025-10-13 19:21:17.480643 | localhost | Label: crc-cloud-ocp-4-18-1-3xl 2025-10-13 19:21:17.480661 | localhost | Product Name: OpenStack Nova 2025-10-13 19:21:17.480678 | localhost | Interface IP: 38.102.83.181 2025-10-13 19:21:17.522372 | 2025-10-13 19:21:17.522495 | PLAY [all] 2025-10-13 19:21:17.535035 | 2025-10-13 19:21:17.535163 | TASK [Gather network facts] 2025-10-13 19:21:18.050694 | controller | ok 2025-10-13 19:21:18.296268 | crc | ok 2025-10-13 19:21:18.356133 | 2025-10-13 19:21:18.356257 | TASK [include_role : start-zuul-console] 2025-10-13 19:21:18.407909 | controller | ok 2025-10-13 19:21:18.442540 | crc | ok 2025-10-13 19:21:18.479625 | 2025-10-13 19:21:18.479777 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-10-13 19:21:18.909608 | controller | ok 2025-10-13 19:21:18.957529 | crc | ok 2025-10-13 19:21:18.989006 | 2025-10-13 19:21:18.989135 | TASK [include_role : add-build-sshkey] 2025-10-13 19:21:19.040291 | controller | ok 2025-10-13 19:21:19.045257 | crc | ok 2025-10-13 19:21:19.082097 | 2025-10-13 19:21:19.082226 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2025-10-13 19:21:19.393861 | controller -> localhost | ok 2025-10-13 19:21:19.401998 | 2025-10-13 19:21:19.402122 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2025-10-13 19:21:19.432201 | controller | ok 2025-10-13 19:21:19.459001 | crc | ok 2025-10-13 19:21:19.560492 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-10-13 19:21:19.560604 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2025-10-13 19:21:19.567533 | 2025-10-13 19:21:19.567614 | TASK [add-build-sshkey : Create Temp SSH key] 2025-10-13 19:21:20.637185 | controller -> localhost | Generating public/private rsa key pair. 2025-10-13 19:21:20.637393 | controller -> localhost | Your identification has been saved in /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/99d5f1cd38d94d13a70c490f97e6f024_id_rsa. 2025-10-13 19:21:20.637422 | controller -> localhost | Your public key has been saved in /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/99d5f1cd38d94d13a70c490f97e6f024_id_rsa.pub. 2025-10-13 19:21:20.637446 | controller -> localhost | The key fingerprint is: 2025-10-13 19:21:20.637465 | controller -> localhost | SHA256:XGpwVWHQZ2D3M3m1JyaTJvoa9WVxZrcO0AHaRUrBaqQ zuul-build-sshkey 2025-10-13 19:21:20.637485 | controller -> localhost | The key's randomart image is: 2025-10-13 19:21:20.637503 | controller -> localhost | +---[RSA 3072]----+ 2025-10-13 19:21:20.637520 | controller -> localhost | | +BX*. .| 2025-10-13 19:21:20.637538 | controller -> localhost | | o++=o+.+| 2025-10-13 19:21:20.637555 | controller -> localhost | | . +.++=++=O| 2025-10-13 19:21:20.637572 | controller -> localhost | | E * o.+ *B| 2025-10-13 19:21:20.637589 | controller -> localhost | | S . .o. | 2025-10-13 19:21:20.637606 | controller -> localhost | | . o . oo | 2025-10-13 19:21:20.637623 | controller -> localhost | | . . . . | 2025-10-13 19:21:20.637640 | controller -> localhost | | o | 2025-10-13 19:21:20.637656 | controller -> localhost | | . | 2025-10-13 19:21:20.637673 | controller -> localhost | +----[SHA256]-----+ 2025-10-13 19:21:20.637791 | controller -> localhost | ok: Runtime: 0:00:00.438738 2025-10-13 19:21:20.648153 | 2025-10-13 19:21:20.648291 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2025-10-13 19:21:20.700450 | controller | ok 2025-10-13 19:21:20.716951 | crc | ok 2025-10-13 19:21:20.737967 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-10-13 19:21:20.738081 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2025-10-13 19:21:20.750028 | 2025-10-13 19:21:20.750163 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2025-10-13 19:21:20.790654 | crc | skipping: Conditional result was False 2025-10-13 19:21:20.791304 | controller | skipping: Conditional result was False 2025-10-13 19:21:20.798335 | 2025-10-13 19:21:20.798484 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2025-10-13 19:21:21.309926 | controller | changed 2025-10-13 19:21:21.381963 | crc | changed 2025-10-13 19:21:21.388584 | 2025-10-13 19:21:21.388649 | TASK [add-build-sshkey : Make sure user has a .ssh] 2025-10-13 19:21:21.654921 | controller | ok 2025-10-13 19:21:21.744389 | crc | ok 2025-10-13 19:21:21.750254 | 2025-10-13 19:21:21.750336 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2025-10-13 19:21:22.679063 | controller | changed 2025-10-13 19:21:22.713313 | crc | changed 2025-10-13 19:21:22.718906 | 2025-10-13 19:21:22.718976 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2025-10-13 19:21:23.499351 | controller | changed 2025-10-13 19:21:23.622457 | crc | changed 2025-10-13 19:21:23.631612 | 2025-10-13 19:21:23.631919 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2025-10-13 19:21:23.659049 | controller | skipping: Conditional result was False 2025-10-13 19:21:23.669995 | crc | skipping: Conditional result was False 2025-10-13 19:21:23.676196 | 2025-10-13 19:21:23.676271 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2025-10-13 19:21:24.049302 | controller -> localhost | changed 2025-10-13 19:21:24.070955 | 2025-10-13 19:21:24.071159 | TASK [add-build-sshkey : Add back temp key] 2025-10-13 19:21:24.382039 | controller -> localhost | Identity added: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/99d5f1cd38d94d13a70c490f97e6f024_id_rsa (zuul-build-sshkey) 2025-10-13 19:21:24.382450 | controller -> localhost | ok: Runtime: 0:00:00.012773 2025-10-13 19:21:24.397577 | 2025-10-13 19:21:24.397820 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2025-10-13 19:21:24.789272 | crc | ok 2025-10-13 19:21:24.795564 | controller | ok 2025-10-13 19:21:24.803155 | 2025-10-13 19:21:24.803242 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2025-10-13 19:21:24.827369 | controller | skipping: Conditional result was False 2025-10-13 19:21:24.848885 | crc | skipping: Conditional result was False 2025-10-13 19:21:24.881902 | 2025-10-13 19:21:24.882153 | TASK [include_role : validate-host] 2025-10-13 19:21:24.939472 | controller | ok 2025-10-13 19:21:24.946847 | crc | ok 2025-10-13 19:21:24.974395 | 2025-10-13 19:21:24.974474 | TASK [validate-host : Define zuul_info_dir fact] 2025-10-13 19:21:25.007687 | controller | ok 2025-10-13 19:21:25.014388 | crc | ok 2025-10-13 19:21:25.019151 | 2025-10-13 19:21:25.019224 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2025-10-13 19:21:25.310630 | controller -> localhost | ok 2025-10-13 19:21:25.317727 | 2025-10-13 19:21:25.317897 | TASK [validate-host : Collect information about the host] 2025-10-13 19:21:26.145254 | controller | ok 2025-10-13 19:21:26.516993 | crc | ok 2025-10-13 19:21:26.537642 | 2025-10-13 19:21:26.537808 | TASK [validate-host : Sanitize hostname] 2025-10-13 19:21:26.596030 | controller | ok 2025-10-13 19:21:26.613283 | crc | ok 2025-10-13 19:21:26.619690 | 2025-10-13 19:21:26.619830 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2025-10-13 19:21:27.083932 | controller -> localhost | changed 2025-10-13 19:21:27.095721 | crc -> localhost | changed 2025-10-13 19:21:27.105627 | 2025-10-13 19:21:27.105823 | TASK [validate-host : Collect information about zuul worker] 2025-10-13 19:21:27.574109 | controller | ok 2025-10-13 19:21:27.616687 | crc | ok 2025-10-13 19:21:27.623323 | 2025-10-13 19:21:27.623389 | TASK [validate-host : Write out all zuul information for each host] 2025-10-13 19:21:28.112900 | crc -> localhost | changed 2025-10-13 19:21:28.145225 | controller -> localhost | changed 2025-10-13 19:21:28.167899 | 2025-10-13 19:21:28.168151 | TASK [include_role : prepare-workspace-openshift] 2025-10-13 19:21:28.195274 | controller | skipping: Conditional result was False 2025-10-13 19:21:28.206531 | 2025-10-13 19:21:28.206710 | TASK [include_role : remove-zuul-sshkey] 2025-10-13 19:21:28.237277 | controller | skipping: Conditional result was False 2025-10-13 19:21:28.243993 | 2025-10-13 19:21:28.244073 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2025-10-13 19:21:28.535780 | crc | ok: "logs" 2025-10-13 19:21:28.536215 | crc | ok: All items complete 2025-10-13 19:21:28.536261 | 2025-10-13 19:21:28.612315 | controller | ok: "logs" 2025-10-13 19:21:28.801111 | crc | ok: "artifacts" 2025-10-13 19:21:28.839861 | controller | ok: "artifacts" 2025-10-13 19:21:29.038220 | controller | ok: "docs" 2025-10-13 19:21:29.068470 | crc | ok: "docs" 2025-10-13 19:21:29.079023 | 2025-10-13 19:21:29.079191 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2025-10-13 19:21:29.385636 | controller | changed: "logs" 2025-10-13 19:21:29.385953 | controller | ok: All items complete 2025-10-13 19:21:29.385985 | 2025-10-13 19:21:29.409322 | crc | changed: "logs" 2025-10-13 19:21:29.586952 | controller | changed: "artifacts" 2025-10-13 19:21:29.642126 | crc | changed: "artifacts" 2025-10-13 19:21:29.799870 | controller | changed: "docs" 2025-10-13 19:21:29.900809 | crc | changed: "docs" 2025-10-13 19:21:29.983974 | 2025-10-13 19:21:29.984081 | PLAY RECAP 2025-10-13 19:21:29.984122 | controller | ok: 22 changed: 9 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-10-13 19:21:29.984148 | crc | ok: 17 changed: 6 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2025-10-13 19:21:29.984170 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-13 19:21:29.984188 | 2025-10-13 19:21:30.162599 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/base-minimal/pre.yaml@master] 2025-10-13 19:21:30.166779 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-10-13 19:21:30.922420 | 2025-10-13 19:21:30.922559 | PLAY [all] 2025-10-13 19:21:30.964279 | 2025-10-13 19:21:30.964439 | TASK [mirror-info-fork : Set mirror_fqdn if not defined] 2025-10-13 19:21:31.048429 | controller | ok 2025-10-13 19:21:31.077568 | crc | ok 2025-10-13 19:21:31.083188 | 2025-10-13 19:21:31.083345 | TASK [mirror-info-fork : Create /etc/ci] 2025-10-13 19:21:31.499695 | controller | changed 2025-10-13 19:21:31.531499 | crc | changed 2025-10-13 19:21:31.572281 | 2025-10-13 19:21:31.572447 | TASK [mirror-info-fork : Install ci_mirror script] 2025-10-13 19:21:32.655251 | crc | changed 2025-10-13 19:21:32.666537 | controller | changed 2025-10-13 19:21:32.694436 | 2025-10-13 19:21:32.694599 | LOOP [add-authorized-keys : Enable access via build key on all nodes] 2025-10-13 19:21:33.242148 | controller | changed: 2025-10-13 19:21:33.242786 | controller | { 2025-10-13 19:21:33.242887 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-10-13 19:21:33.242943 | controller | } 2025-10-13 19:21:33.296306 | crc | changed: 2025-10-13 19:21:33.296612 | crc | { 2025-10-13 19:21:33.296676 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA4Z/c9osaGGtU6X8fgELwfj/yayRurfcKA0HMFfdpPxev2dbwljysMuzoVp4OZmW1gvGtyYPSNRvnzgsaabPNKNo2ym5NToCP6UM+KSe93aln4BcM/24mXChYAbXJQ5Bqq/pIzsGs/pKetQN+vwvMxLOwTvpcsCJBXaa981RKML6xj9l/UZ7IIq1HSEKMvPLxZMWdu0Ut8DkCd5F4nOw9Wgml2uYpDCj5LLCrQQ9ChdOMz8hz6SighhNlRpPkvPaet3OXxr/ytFMu7j7vv06CaEnuMMiY2aTWN1Imin9eHAylIqFHta/3gFfQSWt9jXM7owkBLKL7ATzhaAn+fjNupw== arxcruz@redhat.com" 2025-10-13 19:21:33.296720 | crc | } 2025-10-13 19:21:33.496028 | controller | changed: 2025-10-13 19:21:33.496229 | controller | { 2025-10-13 19:21:33.496288 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-10-13 19:21:33.496330 | controller | } 2025-10-13 19:21:33.658347 | crc | changed: 2025-10-13 19:21:33.658556 | crc | { 2025-10-13 19:21:33.658624 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS4Fn6k4deCnIlOtLWqZJyksbepjQt04j8Ed8CGx9EKkj0fKiAxiI4TadXQYPuNHMixZy4Nevjb6aDhL5Z906TfvNHKUrjrG7G26a0k8vdc61NEQ7FmcGMWRLwwc6ReDO7lFpzYKBMk4YqfWgBuGU/K6WLKiVW2cVvwIuGIaYrE1OiiX0iVUUk7KApXlDJMXn7qjSYynfO4mF629NIp8FJal38+Kv+HA+0QkE5Y2xXnzD4Lar5+keymiCHRntPppXHeLIRzbt0gxC7v3L72hpQ3BTBEzwHpeS8KY+SX1y5lRMN45thCHfJqGmARJREDjBvWG8JXOPmVIKQtZmVcD5b mandreou@redhat.com" 2025-10-13 19:21:33.658702 | crc | } 2025-10-13 19:21:33.774491 | controller | changed: 2025-10-13 19:21:33.774629 | controller | { 2025-10-13 19:21:33.774665 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-10-13 19:21:33.774692 | controller | } 2025-10-13 19:21:34.019287 | crc | changed: 2025-10-13 19:21:34.019403 | crc | { 2025-10-13 19:21:34.019427 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9MiLfy30deHA7xPOAlew5qUq3UP2gmRMYJi8PtkjFB20/DKeWwWNnkZPqP9AayruRoo51SIiVg870gbZE2jYl+Ncx/FYDe56JeC3ySZsXoAVkC9bP7gkOGqOmJjirvAgPMI7bogVz8i+66Q4Ar7OKTp3762G4IuWPPEg4ce4Y7lx9qWocZapHYq4cYKMxrOZ7SEbFSATBbe2bPZAPKTw8do/Eny+Hq/LkHFhIeyra6cqTFQYShr+zPln0Cr+ro/pDX3bB+1ubFgTpjpkkkQsLhDfR6cCdCWM2lgnS3BTtYj5Ct9/JRPR5YOphqZz+uB+OEu2IL68hmU9vNTth1KeX rlandy@redhat.com" 2025-10-13 19:21:34.019446 | crc | } 2025-10-13 19:21:34.060385 | controller | changed: 2025-10-13 19:21:34.060491 | controller | { 2025-10-13 19:21:34.060514 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-10-13 19:21:34.060534 | controller | } 2025-10-13 19:21:34.342662 | controller | changed: 2025-10-13 19:21:34.342891 | controller | { 2025-10-13 19:21:34.342942 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-10-13 19:21:34.342980 | controller | } 2025-10-13 19:21:34.420646 | crc | changed: 2025-10-13 19:21:34.420830 | crc | { 2025-10-13 19:21:34.420880 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFCbgz8gdERiJlk2IKOtkjQxEXejrio6ZYMJAVJYpOIp raukadah@gmail.com" 2025-10-13 19:21:34.420919 | crc | } 2025-10-13 19:21:34.591718 | controller | changed: 2025-10-13 19:21:34.592125 | controller | { 2025-10-13 19:21:34.592175 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-10-13 19:21:34.592213 | controller | } 2025-10-13 19:21:34.819367 | crc | changed: 2025-10-13 19:21:34.819696 | crc | { 2025-10-13 19:21:34.819817 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBqb3Q/9uDf4LmihQ7xeJ9gA/STIQUFPSfyyV0m8AoQi bshewale@redhat.com" 2025-10-13 19:21:34.819869 | crc | } 2025-10-13 19:21:34.863040 | controller | changed: 2025-10-13 19:21:34.863161 | controller | { 2025-10-13 19:21:34.863191 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-10-13 19:21:34.863216 | controller | } 2025-10-13 19:21:35.135283 | controller | changed: 2025-10-13 19:21:35.135412 | controller | { 2025-10-13 19:21:35.135448 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-10-13 19:21:35.135476 | controller | } 2025-10-13 19:21:35.199687 | crc | changed: 2025-10-13 19:21:35.199839 | crc | { 2025-10-13 19:21:35.199875 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0I8QqQx0Az2ysJt2JuffucLijhBqnsXKEIx5GyHwxVULROa8VtNFXUDH6ZKZavhiMcmfHB2+TBTda+lDP4FldYj06dGmzCY+IYGa+uDRdxHNGYjvCfLFcmLlzRK6fNbTcui+KlUFUdKe0fb9CRoGKyhlJD5GRkM1Dv+Yb6Bj+RNnmm1fVGYxzmrD2utvffYEb0SZGWxq2R9gefx1q/3wCGjeqvufEV+AskPhVGc5T7t9eyZ4qmslkLh1/nMuaIBFcr9AUACRajsvk6mXrAN1g3HlBf2gQlhi1UEyfbqIQvzzFtsbLDlSum/KmKjy818GzvWjERfQ0VkGzCd9bSLVL dviroel@redhat.com" 2025-10-13 19:21:35.199899 | crc | } 2025-10-13 19:21:35.406442 | controller | changed: 2025-10-13 19:21:35.406548 | controller | { 2025-10-13 19:21:35.406571 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-10-13 19:21:35.406590 | controller | } 2025-10-13 19:21:35.596899 | crc | changed: 2025-10-13 19:21:35.597040 | crc | { 2025-10-13 19:21:35.597066 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLOQd4ZLtkZXQGY6UwAr/06ppWQK4fDO3HaqxPk98csyOCBXsliSKK39Bso828+5srIXiW7aI6aC9P5mwi4mUZlGPfJlQbfrcGvY+b/SocuvaGK+1RrHLoJCT52LBhwgrzlXio2jeksZeein8iaTrhsPrOAs7KggIL/rB9hEiB3NaOPWhhoCP4vlW6MEMExGcqB/1FVxXFBPnLkEyW0Lk7ycVflZl2ocRxbfjZi0+tI1Wlinp8PvSQSc/WVrAcDgKjc/mB4ODPOyYy3G8FHgfMsrXSDEyjBKgLKMsdCrAUcqJQWjkqXleXSYOV4q3pzL+9umK+q/e3P/bIoSFQzmJKTU1eDfuvPXmow9F5H54fii/Da7ezlMJ+wPGHJrRAkmzvMbALy7xwswLhZMkOGNtRcPqaKYRmIBKpw3o6bCTtcNUHOtOQnzwY8JzrM2eBWJBXAANYw+9/ho80JIiwhg29CFNpVBuHbql2YxJQNrnl90guN65rYNpDxdIluweyUf8= anbanerj@kaermorhen" 2025-10-13 19:21:35.597087 | crc | } 2025-10-13 19:21:35.665319 | controller | changed: 2025-10-13 19:21:35.665422 | controller | { 2025-10-13 19:21:35.665444 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-10-13 19:21:35.665462 | controller | } 2025-10-13 19:21:35.904126 | controller | changed: 2025-10-13 19:21:35.904229 | controller | { 2025-10-13 19:21:35.904251 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-10-13 19:21:35.904269 | controller | } 2025-10-13 19:21:35.956583 | crc | changed: 2025-10-13 19:21:35.956684 | crc | { 2025-10-13 19:21:35.956706 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3VwV8Im9kRm49lt3tM36hj4Zv27FxGo4C1Q/0jqhzFmHY7RHbmeRr8ObhwWoHjXSozKWg8FL5ER0z3hTwL0W6lez3sL7hUaCmSuZmG5Hnl3x4vTSxDI9JZ/Y65rtYiiWQo2fC5xJhU/4+0e5e/pseCm8cKRSu+SaxhO+sd6FDojA2x1BzOzKiQRDy/1zWGp/cZkxcEuB1wHI5LMzN03c67vmbu+fhZRAUO4dQkvcnj2LrhQtpa+ytvnSjr8icMDosf1OsbSffwZFyHB/hfWGAfe0eIeSA2XPraxiPknXxiPKx2MJsaUTYbsZcm3EjFdHBBMumw5rBI74zLrMRvCO9GwBEmGT4rFng1nP+yw5DB8sn2zqpOsPg1LYRwCPOUveC13P6pgsZZPh812e8v5EKnETct+5XI3dVpdw6CnNiLwAyVAF15DJvBGT/u1k0Myg/bQn+Gv9k2MSj6LvQmf6WbZu2Wgjm30z3FyCneBqTL7mLF19YXzeC0ufHz5pnO1E= dasm@fedora" 2025-10-13 19:21:35.956811 | crc | } 2025-10-13 19:21:36.156127 | controller | changed: 2025-10-13 19:21:36.156244 | controller | { 2025-10-13 19:21:36.156266 | controller | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-10-13 19:21:36.156284 | controller | } 2025-10-13 19:21:36.331532 | crc | changed: 2025-10-13 19:21:36.331634 | crc | { 2025-10-13 19:21:36.331658 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUnwjB20UKmsSed9X73eGNV5AOEFccQ3NYrRW776pEk cjeanner" 2025-10-13 19:21:36.331677 | crc | } 2025-10-13 19:21:36.420685 | controller | changed: 2025-10-13 19:21:36.422222 | controller | { 2025-10-13 19:21:36.422269 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-10-13 19:21:36.422296 | controller | } 2025-10-13 19:21:36.634245 | controller | changed: 2025-10-13 19:21:36.634357 | controller | { 2025-10-13 19:21:36.634389 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-10-13 19:21:36.634415 | controller | } 2025-10-13 19:21:36.663019 | crc | changed: 2025-10-13 19:21:36.663585 | crc | { 2025-10-13 19:21:36.663623 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDercCMGn8rW1C4P67tHgtflPdTeXlpyUJYH+6XDd2lR jgilaber@redhat.com" 2025-10-13 19:21:36.663643 | crc | } 2025-10-13 19:21:36.896058 | controller | changed: 2025-10-13 19:21:36.896166 | controller | { 2025-10-13 19:21:36.896196 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-10-13 19:21:36.896220 | controller | } 2025-10-13 19:21:37.031597 | crc | changed: 2025-10-13 19:21:37.031716 | crc | { 2025-10-13 19:21:37.036073 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAMI6kkg9Wg0sG7jIJmyZemEBwUn1yzNpQQd3gnulOmZ adrianfuscoarnejo@gmail.com" 2025-10-13 19:21:37.036109 | crc | } 2025-10-13 19:21:37.133907 | controller | changed: 2025-10-13 19:21:37.134015 | controller | { 2025-10-13 19:21:37.134036 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-10-13 19:21:37.134054 | controller | } 2025-10-13 19:21:37.381632 | controller | changed: 2025-10-13 19:21:37.381780 | controller | { 2025-10-13 19:21:37.381816 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-10-13 19:21:37.381845 | controller | } 2025-10-13 19:21:37.402990 | crc | changed: 2025-10-13 19:21:37.403103 | crc | { 2025-10-13 19:21:37.403126 | crc | "public_key": "ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPijwpQu/3jhhhBZInXNOLEH57DrknPc3PLbsRvYyJIFzwYjX+WD4a7+nGnMYS42MuZk6TJcVqgnqofVx4isoD4= ramishra@redhat.com" 2025-10-13 19:21:37.403146 | crc | } 2025-10-13 19:21:37.633967 | controller | changed: 2025-10-13 19:21:37.634093 | controller | { 2025-10-13 19:21:37.634129 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-10-13 19:21:37.634158 | controller | } 2025-10-13 19:21:37.769837 | crc | changed: 2025-10-13 19:21:37.769955 | crc | { 2025-10-13 19:21:37.770285 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGpU/BepK3qX0NRf5Np+dOBDqzQEefhNrw2DCZaH3uWW rebtoor@monolith" 2025-10-13 19:21:37.770340 | crc | } 2025-10-13 19:21:37.898983 | controller | changed: 2025-10-13 19:21:37.899103 | controller | { 2025-10-13 19:21:37.899125 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-10-13 19:21:37.899142 | controller | } 2025-10-13 19:21:38.171797 | crc | changed: 2025-10-13 19:21:38.171910 | crc | { 2025-10-13 19:21:38.171932 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDK0iKdi8jQTpQrDdLVH/AAgLVYyTXF7AQ1gjc/5uT3t ykarel@yatinkarel" 2025-10-13 19:21:38.171951 | crc | } 2025-10-13 19:21:38.177128 | controller | changed: 2025-10-13 19:21:38.177204 | controller | { 2025-10-13 19:21:38.177225 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-10-13 19:21:38.177242 | controller | } 2025-10-13 19:21:38.425454 | controller | changed: 2025-10-13 19:21:38.425539 | controller | { 2025-10-13 19:21:38.425563 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-10-13 19:21:38.425582 | controller | } 2025-10-13 19:21:38.549856 | crc | changed: 2025-10-13 19:21:38.549999 | crc | { 2025-10-13 19:21:38.550022 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF/V/cLotA6LZeO32VL45Hd78skuA2lJA425Sm2LlQeZ fmount@horcrux" 2025-10-13 19:21:38.550040 | crc | } 2025-10-13 19:21:38.706224 | controller | changed: 2025-10-13 19:21:38.706327 | controller | { 2025-10-13 19:21:38.706349 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-10-13 19:21:38.706367 | controller | } 2025-10-13 19:21:38.935004 | crc | changed: 2025-10-13 19:21:38.935220 | crc | { 2025-10-13 19:21:38.935247 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa7QCjuDMVmRPo1rREbGwzYeBCYVN+Ou/3WKXZEC6Sr" 2025-10-13 19:21:38.935266 | crc | } 2025-10-13 19:21:39.025561 | controller | changed: 2025-10-13 19:21:39.025779 | controller | { 2025-10-13 19:21:39.025872 | controller | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-10-13 19:21:39.025947 | controller | } 2025-10-13 19:21:39.273679 | controller | changed: 2025-10-13 19:21:39.273918 | controller | { 2025-10-13 19:21:39.273958 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-10-13 19:21:39.273983 | controller | } 2025-10-13 19:21:39.287978 | crc | changed: 2025-10-13 19:21:39.288095 | crc | { 2025-10-13 19:21:39.288128 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCfNtF7NvKl915TGsGGoseUb06Hj8L/S4toWf0hExeY+F00woL6NvBlJD0nDct+P5a22I4EhvoQCRQ8reaPCm1lybR3uiRIJsj+8zkVvLwby9LXzfZorlNG9ofjd00FEmB09uW/YvTl6Q9XwwwX6tInzIOv3TMqTHHGOL74ibbj8J/FJR0cFEyj0z4WQRvtkh32xAHl83gbuINryMt0sqRI+clj2381NKL55DRLQrVw0gsfqqxiHAnXg21qWmc4J+b9e9kiuAFQjcjwTVkwJCcg3xbPwC/qokYRby/Y5S40UUd7/jEARGXT7RZgpzTuDd1oZiCVrnrqJNPaMNdVv5MLeFdf1B7iIe5aa/fGouX7AO4SdKhZUdnJmCFAGvjC6S3JMZ2wAcUl+OHnssfmdj7XL50cLo27vjuzMtLAgSqi6N99m92WCF2s8J9aVzszX7Xz9OKZCeGsiVJp3/NdABKzSEAyM9xBD/5Vho894Sav+otpySHe3p6RUTgbB5Zu8VyZRZ/UtB3ueXxyo764yrc6qWIDqrehm84Xm9g+/jpIBzGPl07NUNJpdt/6Sgf9RIKXw/7XypO5yZfUcuFNGTxLfqjTNrtgLZNcjfav6sSdVXVcMPL//XNuRdKmVFaO76eV/oGMQGr1fGcCD+N+CpI7+Q+fCNB6VFWG4nZFuI/Iuw== averdagu@redhat.com" 2025-10-13 19:21:39.288166 | crc | } 2025-10-13 19:21:39.532431 | controller | changed: 2025-10-13 19:21:39.532525 | controller | { 2025-10-13 19:21:39.532548 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-10-13 19:21:39.532566 | controller | } 2025-10-13 19:21:39.660606 | crc | changed: 2025-10-13 19:21:39.660776 | crc | { 2025-10-13 19:21:39.660803 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDq8l27xI+QlQVdS4djp9ogSoyrNE2+Ox6vKPdhSNL1J3PE5w+WCSvMz9A5gnNuH810zwbekEApbxTze/gLQJwBHA52CChfURpXrFaxY7ePXRElwKAL3mJfzBWY/c5jnNL9TCVmFJTGZkFZP3Nh+BMgZvL6xBkt3WKm6Uq18qzd9XeKcZusrA+O+uLv1fVeQnadY9RIqOCyeFYCzLWrUfTyE8x/XG0hAWIM7qpnF2cALQS2h9n4hW5ybiUN790H08wf9hFwEf5nxY9Z9dVkPFQiTSGKNBzmnCXU9skxS/xhpFjJ5duGSZdtAHe9O+nGZm9c67hxgtf8e5PDuqAdXEv2cf6e3VBAt+Bz8EKI3yosTj0oZHfwr42Yzb1l/SKy14Rggsrc9KAQlrGXan6+u2jcQqqx7l+SWmnpFiWTV9u5cWj2IgOhApOitmRBPYqk9rE2usfO0hLn/Pj/R/Nau4803e1/EikdLE7Ps95s9mX5jRDjAoUa2JwFF5RsVFyL910= ashigupt@ashigupt.remote.csb" 2025-10-13 19:21:39.660823 | crc | } 2025-10-13 19:21:39.813817 | controller | changed: 2025-10-13 19:21:39.813934 | controller | { 2025-10-13 19:21:39.813966 | controller | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-10-13 19:21:39.813993 | controller | } 2025-10-13 19:21:40.072966 | crc | changed: 2025-10-13 19:21:40.073063 | crc | { 2025-10-13 19:21:40.073087 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKLl0NYKwoZ/JY5KeZU8VwRAggeOxqQJeoqp3dsAaY9" 2025-10-13 19:21:40.073107 | crc | } 2025-10-13 19:21:40.073143 | crc | changed: All items complete 2025-10-13 19:21:40.073164 | 2025-10-13 19:21:40.465230 | crc | changed: 2025-10-13 19:21:40.465371 | crc | { 2025-10-13 19:21:40.465403 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIASASQOH2BcOyLKuuDOdWZlPi2orcjcA8q4400T73DLH evallesp@fedora" 2025-10-13 19:21:40.465429 | crc | } 2025-10-13 19:21:40.819579 | crc | changed: 2025-10-13 19:21:40.819705 | crc | { 2025-10-13 19:21:40.819760 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILeBWlamUph+jRKV2qrx1PGU7vWuGIt5+z9k96I8WehW amsinha@amsinha-mac" 2025-10-13 19:21:40.819942 | crc | } 2025-10-13 19:21:41.170544 | crc | changed: 2025-10-13 19:21:41.170647 | crc | { 2025-10-13 19:21:41.170669 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIANvVgvJBlK3gb1yz5uef/JqIGq4HLEmY2dYA8e37swb morenod@redhat-laptop" 2025-10-13 19:21:41.170688 | crc | } 2025-10-13 19:21:41.545553 | crc | changed: 2025-10-13 19:21:41.545677 | crc | { 2025-10-13 19:21:41.545699 | crc | "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZdI7t1cxYx65heVI24HTV4F7oQLW1zyfxHreL2TIJKxjyrUUKIFEUmTutcBlJRLNT2Eoix6x1sOw9YrchloCLcn//SGfTElr9mSc5jbjb7QXEU+zJMhtxyEJ1Po3CUGnj7ckiIXw7wcawZtrEOAQ9pH3ExYCJcEMiyNjRQZCxT3tPK+S4B95EWh5Fsrz9CkwpjNRPPH7LigCeQTM3Wc7r97utAslBUUvYceDSLA7rMgkitJE38b7rZBeYzsGQ8YYUBjTCtehqQXxCRjizbHWaaZkBU+N3zkKB6n/iCNGIO690NK7A/qb6msTijiz1PeuM8ThOsi9qXnbX5v0PoTpcFSojV7NHAQ71f0XXuS43FhZctT+Dcx44dT8Fb5vJu2cJGrk+qF8ZgJYNpRS7gPg0EG2EqjK7JMf9ULdjSu0r+KlqIAyLvtzT4eOnQipoKlb/WG5D/0ohKv7OMQ352ggfkBFIQsRXyyTCT98Ft9juqPuahi3CAQmP4H9dyE+7+Kz437PEtsxLmfm6naNmWi7Ee1DqWPwS8rEajsm4sNM4wW9gdBboJQtc0uZw0DfLj1I9r3Mc8Ol0jYtz0yNQDSzVLrGCaJlC311trU70tZ+ZkAVV6Mn8lOhSbj1cK0lvSr6ZK4dgqGl3I1eTZJJhbLNdg7UOVaiRx9543+C/p/As7w== brjackma@redhat.com" 2025-10-13 19:21:41.545717 | crc | } 2025-10-13 19:21:41.891464 | crc | changed: 2025-10-13 19:21:41.891600 | crc | { 2025-10-13 19:21:41.891634 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKwedoZ0TWPJX/z/4TAbO/kKcDZOQVgRH0hAqrL5UCI1 vcastell@redhat.com" 2025-10-13 19:21:41.891660 | crc | } 2025-10-13 19:21:42.270537 | crc | changed: 2025-10-13 19:21:42.270708 | crc | { 2025-10-13 19:21:42.270802 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEmv8sE8GCk6ZTPIqF0FQrttBdL3mq7rCm/IJy0xDFh7 michburk@redhat.com" 2025-10-13 19:21:42.270863 | crc | } 2025-10-13 19:21:42.616938 | crc | changed: 2025-10-13 19:21:42.617048 | crc | { 2025-10-13 19:21:42.617070 | crc | "public_key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICy6GpGEtwevXEEn4mmLR5lmSLe23dGgAvzkB9DMNbkf rsafrono@rsafrono" 2025-10-13 19:21:42.617088 | crc | } 2025-10-13 19:21:42.642335 | 2025-10-13 19:21:42.642509 | TASK [Set timezone to UTC] 2025-10-13 19:21:43.174685 | controller | changed: executed `/bin/timedatectl set-timezone UTC` 2025-10-13 19:21:43.282067 | crc | ok 2025-10-13 19:21:43.293288 | 2025-10-13 19:21:43.293458 | TASK [Create nodepool directory] 2025-10-13 19:21:43.569559 | controller | changed 2025-10-13 19:21:43.669964 | crc | changed 2025-10-13 19:21:43.676685 | 2025-10-13 19:21:43.676867 | TASK [Create nodepool sub_nodes file] 2025-10-13 19:21:44.405523 | controller | changed 2025-10-13 19:21:44.597298 | crc | changed 2025-10-13 19:21:44.605034 | 2025-10-13 19:21:44.605200 | TASK [Create nodepool sub_nodes_private file] 2025-10-13 19:21:45.270254 | controller | changed 2025-10-13 19:21:45.368574 | crc | changed 2025-10-13 19:21:45.376114 | 2025-10-13 19:21:45.376193 | LOOP [Populate nodepool sub_nodes file] 2025-10-13 19:21:45.427570 | 2025-10-13 19:21:45.427787 | LOOP [Populate nodepool sub_nodes_private file] 2025-10-13 19:21:45.481444 | 2025-10-13 19:21:45.481600 | TASK [Create nodepool primary file] 2025-10-13 19:21:45.520190 | controller | skipping: Conditional result was False 2025-10-13 19:21:45.520608 | crc | skipping: Conditional result was False 2025-10-13 19:21:45.526680 | 2025-10-13 19:21:45.526767 | TASK [Create nodepool node_private for this node] 2025-10-13 19:21:46.376813 | crc | changed 2025-10-13 19:21:46.427828 | controller | changed 2025-10-13 19:21:46.452569 | 2025-10-13 19:21:46.452790 | LOOP [Copy ssh keys to nodepool directory] 2025-10-13 19:21:46.910032 | crc | ok: Item: id_rsa Runtime: 0:00:00.006889 2025-10-13 19:21:46.910434 | 2025-10-13 19:21:46.922469 | controller | ok: Item: id_rsa Runtime: 0:00:00.007890 2025-10-13 19:21:47.168359 | controller | ok: Item: id_rsa.pub Runtime: 0:00:00.010945 2025-10-13 19:21:47.179055 | crc | ok: Item: id_rsa.pub Runtime: 0:00:00.006548 2025-10-13 19:21:47.198311 | 2025-10-13 19:21:47.198417 | TASK [Add sudoers role for zuul-sudo-grep.sh] 2025-10-13 19:21:47.929921 | controller | changed 2025-10-13 19:21:48.145140 | crc | changed 2025-10-13 19:21:48.152898 | 2025-10-13 19:21:48.153287 | TASK [Validate sudoers config after edits] 2025-10-13 19:21:48.596230 | crc | /etc/sudoers: parsed OK 2025-10-13 19:21:48.596435 | crc | /etc/sudoers.d/coreos-sudo-group: parsed OK 2025-10-13 19:21:48.596447 | crc | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-10-13 19:21:48.527058 | controller | /etc/sudoers: parsed OK 2025-10-13 19:21:48.527439 | controller | /etc/sudoers.d/90-cloud-init-users: parsed OK 2025-10-13 19:21:48.527451 | controller | /etc/sudoers.d/zuul: parsed OK 2025-10-13 19:21:48.527502 | controller | /etc/sudoers.d/zuul-sudo-grep: parsed OK 2025-10-13 19:21:48.776350 | controller | ok: Runtime: 0:00:00.010426 2025-10-13 19:21:48.784331 | crc | ok: Runtime: 0:00:00.010878 2025-10-13 19:21:48.793788 | 2025-10-13 19:21:48.793856 | TASK [Show the environment passed in to job shell scripts] 2025-10-13 19:21:49.211412 | crc | SHELL=/bin/bash 2025-10-13 19:21:49.211512 | crc | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-10-13 19:21:49.211521 | crc | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-10-13 19:21:49.211529 | crc | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/04/3404/9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8^openstack-k8s-operators/ci-framework:main:refs/changes/06/3406/3b7e5d87cb08f8ceea89c6e58502f20dfffec667^openstack-k8s-operators/ci-framework:main:refs/changes/02/3402/a301e7c15ccc9d964f35eb738c51dc015730d4ed 2025-10-13 19:21:49.211536 | crc | PWD=/var/home/core 2025-10-13 19:21:49.211542 | crc | ZUUL_PIPELINE=github-check 2025-10-13 19:21:49.211548 | crc | LOGNAME=core 2025-10-13 19:21:49.211553 | crc | XDG_SESSION_TYPE=tty 2025-10-13 19:21:49.211559 | crc | _=/usr/bin/env 2025-10-13 19:21:49.211573 | crc | MOTD_SHOWN=pam 2025-10-13 19:21:49.211583 | crc | HOME=/var/home/core 2025-10-13 19:21:49.211594 | crc | LANG=C.UTF-8 2025-10-13 19:21:49.211604 | crc | SSH_CONNECTION=38.102.83.114 48670 38.102.83.181 22 2025-10-13 19:21:49.211615 | crc | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-10-13 19:21:49.211629 | crc | ZUUL_CHANGE_IDS=3404,9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8 3406,3b7e5d87cb08f8ceea89c6e58502f20dfffec667 3402,a301e7c15ccc9d964f35eb738c51dc015730d4ed 2025-10-13 19:21:49.211640 | crc | WORKSPACE=/home/zuul/workspace 2025-10-13 19:21:49.211650 | crc | XDG_SESSION_CLASS=user 2025-10-13 19:21:49.211661 | crc | SELINUX_ROLE_REQUESTED= 2025-10-13 19:21:49.211671 | crc | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-10-13 19:21:49.211681 | crc | USER=core 2025-10-13 19:21:49.211692 | crc | ZUUL_VOTING=True 2025-10-13 19:21:49.211702 | crc | BUILD_TIMEOUT=9000000 2025-10-13 19:21:49.211712 | crc | SELINUX_USE_CURRENT_RANGE= 2025-10-13 19:21:49.211722 | crc | SHLVL=1 2025-10-13 19:21:49.211732 | crc | ZUUL_PATCHSET=a301e7c15ccc9d964f35eb738c51dc015730d4ed 2025-10-13 19:21:49.211743 | crc | XDG_SESSION_ID=2 2025-10-13 19:21:49.211753 | crc | ZUUL_BRANCH=main 2025-10-13 19:21:49.211763 | crc | XDG_RUNTIME_DIR=/run/user/1000 2025-10-13 19:21:49.211774 | crc | SSH_CLIENT=38.102.83.114 48670 22 2025-10-13 19:21:49.211783 | crc | which_declare=declare -f 2025-10-13 19:21:49.211794 | crc | PATH=/var/home/core/.local/bin:/var/home/core/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-10-13 19:21:49.211805 | crc | SELINUX_LEVEL_REQUESTED= 2025-10-13 19:21:49.211816 | crc | ZUUL_CHANGE=3402 2025-10-13 19:21:49.211826 | crc | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-10-13 19:21:49.211836 | crc | ZUUL_UUID=99d5f1cd38d94d13a70c490f97e6f024 2025-10-13 19:21:49.211847 | crc | BASH_FUNC_which%%=() { ( alias; 2025-10-13 19:21:49.211859 | crc | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-10-13 19:21:49.211870 | crc | } 2025-10-13 19:21:49.199896 | controller | SHELL=/bin/bash 2025-10-13 19:21:49.199961 | controller | ZUUL_PROJECT=openstack-k8s-operators/ci-framework 2025-10-13 19:21:49.199970 | controller | ZUUL_SHORT_PROJECT_NAME=ci-framework 2025-10-13 19:21:49.199977 | controller | ZUUL_CHANGES=openstack-k8s-operators/ci-framework:main:refs/changes/04/3404/9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8^openstack-k8s-operators/ci-framework:main:refs/changes/06/3406/3b7e5d87cb08f8ceea89c6e58502f20dfffec667^openstack-k8s-operators/ci-framework:main:refs/changes/02/3402/a301e7c15ccc9d964f35eb738c51dc015730d4ed 2025-10-13 19:21:49.200033 | controller | PWD=/home/zuul 2025-10-13 19:21:49.200042 | controller | ZUUL_PIPELINE=github-check 2025-10-13 19:21:49.200048 | controller | LOGNAME=zuul 2025-10-13 19:21:49.200054 | controller | XDG_SESSION_TYPE=tty 2025-10-13 19:21:49.200060 | controller | _=/usr/bin/env 2025-10-13 19:21:49.200066 | controller | MOTD_SHOWN=pam 2025-10-13 19:21:49.200072 | controller | HOME=/home/zuul 2025-10-13 19:21:49.200078 | controller | LANG=en_US.UTF-8 2025-10-13 19:21:49.200083 | controller | SSH_CONNECTION=38.102.83.114 43416 38.102.83.182 22 2025-10-13 19:21:49.200090 | controller | TOX_TESTENV_PASSENV=ZUUL_UUID ZUUL_PROJECT ZUUL_SHORT_PROJECT_NAME ZUUL_PIPELINE ZUUL_VOTING WORKSPACE BUILD_TIMEOUT ZUUL_BRANCH ZUUL_CHANGES ZUUL_CHANGE_IDS ZUUL_CHANGE ZUUL_PATCHSET 2025-10-13 19:21:49.200100 | controller | ZUUL_CHANGE_IDS=3404,9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8 3406,3b7e5d87cb08f8ceea89c6e58502f20dfffec667 3402,a301e7c15ccc9d964f35eb738c51dc015730d4ed 2025-10-13 19:21:49.200106 | controller | WORKSPACE=/home/zuul/workspace 2025-10-13 19:21:49.200113 | controller | XDG_SESSION_CLASS=user 2025-10-13 19:21:49.200119 | controller | SELINUX_ROLE_REQUESTED= 2025-10-13 19:21:49.200125 | controller | LESSOPEN=||/usr/bin/lesspipe.sh %s 2025-10-13 19:21:49.200131 | controller | USER=zuul 2025-10-13 19:21:49.200137 | controller | ZUUL_VOTING=True 2025-10-13 19:21:49.200143 | controller | BUILD_TIMEOUT=9000000 2025-10-13 19:21:49.200148 | controller | SELINUX_USE_CURRENT_RANGE= 2025-10-13 19:21:49.200154 | controller | SHLVL=1 2025-10-13 19:21:49.200160 | controller | ZUUL_PATCHSET=a301e7c15ccc9d964f35eb738c51dc015730d4ed 2025-10-13 19:21:49.200166 | controller | XDG_SESSION_ID=1 2025-10-13 19:21:49.200172 | controller | ZUUL_BRANCH=main 2025-10-13 19:21:49.200178 | controller | XDG_RUNTIME_DIR=/run/user/1000 2025-10-13 19:21:49.200184 | controller | SSH_CLIENT=38.102.83.114 43416 22 2025-10-13 19:21:49.200190 | controller | DEBUGINFOD_URLS=https://debuginfod.centos.org/ 2025-10-13 19:21:49.200196 | controller | DEBUGINFOD_IMA_CERT_PATH=/etc/keys/ima: 2025-10-13 19:21:49.200203 | controller | which_declare=declare -f 2025-10-13 19:21:49.200210 | controller | PATH=/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-10-13 19:21:49.200216 | controller | SELINUX_LEVEL_REQUESTED= 2025-10-13 19:21:49.200222 | controller | ZUUL_CHANGE=3402 2025-10-13 19:21:49.200228 | controller | DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/1000/bus 2025-10-13 19:21:49.200234 | controller | ZUUL_UUID=99d5f1cd38d94d13a70c490f97e6f024 2025-10-13 19:21:49.200240 | controller | BASH_FUNC_which%%=() { ( alias; 2025-10-13 19:21:49.200246 | controller | eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot $@ 2025-10-13 19:21:49.200252 | controller | } 2025-10-13 19:21:49.440601 | controller | ok: Runtime: 0:00:00.007587 2025-10-13 19:21:49.458233 | crc | ok: Runtime: 0:00:00.009778 2025-10-13 19:21:49.472559 | 2025-10-13 19:21:49.472691 | TASK [Workaround hardcoded /home/zuul/workspace in zuul_legacy_vars] 2025-10-13 19:21:49.505062 | controller | skipping: Conditional result was False 2025-10-13 19:21:49.506033 | crc | skipping: Conditional result was False 2025-10-13 19:21:49.515011 | 2025-10-13 19:21:49.515107 | TASK [Symlink /home/zuul-worker/workspace] 2025-10-13 19:21:50.103156 | controller | skipping: Conditional result was False 2025-10-13 19:21:50.103840 | crc | skipping: Conditional result was False 2025-10-13 19:21:50.111789 | 2025-10-13 19:21:50.111891 | TASK [Ensure legacy workspace directory] 2025-10-13 19:21:50.388023 | controller | changed 2025-10-13 19:21:50.414952 | crc | changed 2025-10-13 19:21:50.480095 | 2025-10-13 19:21:50.480223 | PLAY RECAP 2025-10-13 19:21:50.480287 | controller | ok: 14 changed: 11 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-10-13 19:21:50.480330 | crc | ok: 14 changed: 10 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-10-13 19:21:50.480519 | 2025-10-13 19:21:50.613855 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/ci-framework-rdo-base/pre.yaml@master] 2025-10-13 19:21:50.617122 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/crc/bootstrap-ci-network.yml@master] 2025-10-13 19:21:51.260168 | 2025-10-13 19:21:51.260290 | PLAY [controller] 2025-10-13 19:21:51.283494 | 2025-10-13 19:21:51.283611 | TASK [Debug parameters] 2025-10-13 19:21:51.328183 | controller | ok 2025-10-13 19:21:51.334913 | 2025-10-13 19:21:51.335013 | TASK [Assert crc_ci_bootstrap_cloud_name is defined] 2025-10-13 19:21:51.397278 | controller | ok: All assertions passed 2025-10-13 19:21:51.404828 | 2025-10-13 19:21:51.404915 | TASK [Assert crc_ci_bootstrap_networking is defined and contains the minimum fields] 2025-10-13 19:21:51.457025 | controller | ok: All assertions passed 2025-10-13 19:21:51.463442 | 2025-10-13 19:21:51.463528 | TASK [Assert that the default network exists and has no VLAN tag] 2025-10-13 19:21:51.495566 | controller | ok: All assertions passed 2025-10-13 19:21:51.507295 | 2025-10-13 19:21:51.507430 | LOOP [Assert that all instances has a given fixed IP for each net and default net is present] 2025-10-13 19:21:51.598742 | controller | ok: All assertions passed 2025-10-13 19:21:51.613924 | controller | ok: All assertions passed 2025-10-13 19:21:51.632379 | 2025-10-13 19:21:51.632512 | LOOP [Assert that every host references an valid/declared network] 2025-10-13 19:21:51.692336 | controller | ok: All assertions passed 2025-10-13 19:21:51.692537 | controller | ok: All items complete 2025-10-13 19:21:51.692565 | 2025-10-13 19:21:51.703707 | controller | ok: All assertions passed 2025-10-13 19:21:51.716939 | 2025-10-13 19:21:51.717054 | LOOP [Assert that all instances has in range fixed IP for each net] 2025-10-13 19:21:51.820390 | controller | ok: All assertions passed 2025-10-13 19:21:51.828154 | controller | ok: All assertions passed 2025-10-13 19:21:51.837530 | 2025-10-13 19:21:51.837600 | TASK [Assert that all non-default nets has the vlan tag] 2025-10-13 19:21:51.928557 | controller | ok: All assertions passed 2025-10-13 19:21:51.934110 | 2025-10-13 19:21:51.934171 | TASK [Install required packages] 2025-10-13 19:22:06.528045 | controller | changed 2025-10-13 19:22:06.535041 | 2025-10-13 19:22:06.535103 | TASK [Create openstack config dir] 2025-10-13 19:22:06.866003 | controller | changed 2025-10-13 19:22:06.877902 | 2025-10-13 19:22:06.878063 | LOOP [Create ci dir in etc folder in the controller] 2025-10-13 19:22:07.181018 | controller -> 38.102.83.181 | changed: "crc" 2025-10-13 19:22:07.181426 | controller -> 38.102.83.181 | ok: All items complete 2025-10-13 19:22:07.181485 | 2025-10-13 19:22:07.448295 | controller -> 38.102.83.182 | changed: "controller" 2025-10-13 19:22:07.461706 | 2025-10-13 19:22:07.461819 | TASK [Set global resource names as facts] 2025-10-13 19:22:07.491856 | controller | ok 2025-10-13 19:22:07.499566 | 2025-10-13 19:22:07.499978 | TASK [Generate CA cert file] 2025-10-13 19:22:07.526867 | controller | skipping: Conditional result was False 2025-10-13 19:22:07.533641 | 2025-10-13 19:22:07.533776 | TASK [Update CA certs] 2025-10-13 19:22:08.065507 | controller | skipping: Conditional result was False 2025-10-13 19:22:08.071936 | 2025-10-13 19:22:08.072025 | TASK [Generate clouds config from cloud_secrets secret] 2025-10-13 19:22:09.284142 | controller | changed 2025-10-13 19:22:09.291606 | 2025-10-13 19:22:09.291708 | TASK [Create the default network] 2025-10-13 19:22:12.792652 | controller | admin_state_up: true 2025-10-13 19:22:12.792783 | controller | availability_zone_hints: 2025-10-13 19:22:12.792951 | controller | - nova 2025-10-13 19:22:12.792962 | controller | availability_zones: [] 2025-10-13 19:22:12.793215 | controller | created_at: '2025-10-13T19:22:11Z' 2025-10-13 19:22:12.793355 | controller | description: '' 2025-10-13 19:22:12.793534 | controller | dns_domain: '' 2025-10-13 19:22:12.793704 | controller | id: 29e4fd91-7b8e-4108-9885-1a0c0e9ac3cf 2025-10-13 19:22:12.793885 | controller | ipv4_address_scope: null 2025-10-13 19:22:12.794068 | controller | ipv6_address_scope: null 2025-10-13 19:22:12.794270 | controller | is_default: false 2025-10-13 19:22:12.794433 | controller | is_vlan_qinq: null 2025-10-13 19:22:12.794585 | controller | is_vlan_transparent: true 2025-10-13 19:22:12.794724 | controller | l2_adjacency: true 2025-10-13 19:22:12.794893 | controller | mtu: 1500 2025-10-13 19:22:12.795042 | controller | name: zuul-ci-net-99d5f1cd 2025-10-13 19:22:12.795191 | controller | port_security_enabled: false 2025-10-13 19:22:12.795356 | controller | project_id: 4b633c451ac74233be3721a3635275e5 2025-10-13 19:22:12.795522 | controller | provider:network_type: null 2025-10-13 19:22:12.795676 | controller | provider:physical_network: null 2025-10-13 19:22:12.795871 | controller | provider:segmentation_id: null 2025-10-13 19:22:12.796012 | controller | qos_policy_id: null 2025-10-13 19:22:12.796148 | controller | revision_number: 1 2025-10-13 19:22:12.796295 | controller | router:external: false 2025-10-13 19:22:12.796485 | controller | segments: null 2025-10-13 19:22:12.796617 | controller | shared: false 2025-10-13 19:22:12.796753 | controller | status: ACTIVE 2025-10-13 19:22:12.796879 | controller | subnets: [] 2025-10-13 19:22:12.797006 | controller | tags: [] 2025-10-13 19:22:12.797169 | controller | updated_at: '2025-10-13T19:22:11Z' 2025-10-13 19:22:13.347029 | controller | changed 2025-10-13 19:22:13.357482 | 2025-10-13 19:22:13.357581 | TASK [Create subnet - ipv4] 2025-10-13 19:22:15.404414 | controller | allocation_pools: 2025-10-13 19:22:15.404685 | controller | - end: 192.168.122.254 2025-10-13 19:22:15.404700 | controller | start: 192.168.122.2 2025-10-13 19:22:15.404709 | controller | cidr: 192.168.122.0/24 2025-10-13 19:22:15.404852 | controller | created_at: '2025-10-13T19:22:15Z' 2025-10-13 19:22:15.404973 | controller | description: '' 2025-10-13 19:22:15.405136 | controller | dns_nameservers: [] 2025-10-13 19:22:15.405355 | controller | dns_publish_fixed_ip: null 2025-10-13 19:22:15.405585 | controller | enable_dhcp: false 2025-10-13 19:22:15.405748 | controller | gateway_ip: 192.168.122.1 2025-10-13 19:22:15.405871 | controller | host_routes: [] 2025-10-13 19:22:15.406023 | controller | id: c3435213-9a6b-46ed-a590-5894551f60e8 2025-10-13 19:22:15.406198 | controller | ip_version: 4 2025-10-13 19:22:15.406322 | controller | ipv6_address_mode: null 2025-10-13 19:22:15.406459 | controller | ipv6_ra_mode: null 2025-10-13 19:22:15.406589 | controller | name: zuul-ci-subnet-99d5f1cd 2025-10-13 19:22:15.406730 | controller | network_id: 29e4fd91-7b8e-4108-9885-1a0c0e9ac3cf 2025-10-13 19:22:15.406868 | controller | project_id: 4b633c451ac74233be3721a3635275e5 2025-10-13 19:22:15.406996 | controller | revision_number: 0 2025-10-13 19:22:15.407113 | controller | segment_id: null 2025-10-13 19:22:15.407232 | controller | service_types: [] 2025-10-13 19:22:15.407350 | controller | subnetpool_id: null 2025-10-13 19:22:15.407478 | controller | tags: [] 2025-10-13 19:22:15.407616 | controller | updated_at: '2025-10-13T19:22:15Z' 2025-10-13 19:22:15.907009 | controller | changed 2025-10-13 19:22:15.920902 | 2025-10-13 19:22:15.921068 | TASK [Set yaml returned data for further usage] 2025-10-13 19:22:16.003015 | controller | ok 2025-10-13 19:22:16.015595 | 2025-10-13 19:22:16.015794 | TASK [Create router] 2025-10-13 19:22:16.561976 | controller | skipping: Conditional result was False 2025-10-13 19:22:16.574222 | 2025-10-13 19:22:16.574371 | TASK [Set router yaml returned data for further usage] 2025-10-13 19:22:16.641855 | controller | skipping: Conditional result was False 2025-10-13 19:22:16.654097 | 2025-10-13 19:22:16.654244 | TASK [Add router to subnet] 2025-10-13 19:22:17.203811 | controller | skipping: Conditional result was False 2025-10-13 19:22:17.218468 | 2025-10-13 19:22:17.221774 | LOOP [Create ports, VLANs and configure them on the instance] 2025-10-13 19:22:17.285874 | controller | ok: 2025-10-13 19:22:17.286167 | controller | { 2025-10-13 19:22:17.286194 | controller | "key": "controller", 2025-10-13 19:22:17.286213 | controller | "value": { 2025-10-13 19:22:17.286230 | controller | "networks": { 2025-10-13 19:22:17.286247 | controller | "default": { 2025-10-13 19:22:17.286262 | controller | "ip": "192.168.122.11" 2025-10-13 19:22:17.286278 | controller | } 2025-10-13 19:22:17.286294 | controller | } 2025-10-13 19:22:17.286309 | controller | } 2025-10-13 19:22:17.286325 | controller | } 2025-10-13 19:22:20.276310 | controller | ok: 2025-10-13 19:22:20.276432 | controller | { 2025-10-13 19:22:20.276455 | controller | "key": "crc", 2025-10-13 19:22:20.276474 | controller | "value": { 2025-10-13 19:22:20.276491 | controller | "networks": { 2025-10-13 19:22:20.276508 | controller | "default": { 2025-10-13 19:22:20.276524 | controller | "ip": "192.168.122.10" 2025-10-13 19:22:20.276540 | controller | }, 2025-10-13 19:22:20.276556 | controller | "internal-api": { 2025-10-13 19:22:20.276572 | controller | "ip": "172.17.0.5" 2025-10-13 19:22:20.276587 | controller | }, 2025-10-13 19:22:20.276604 | controller | "storage": { 2025-10-13 19:22:20.276630 | controller | "ip": "172.18.0.5" 2025-10-13 19:22:20.276646 | controller | }, 2025-10-13 19:22:20.276661 | controller | "tenant": { 2025-10-13 19:22:20.276677 | controller | "ip": "172.19.0.5" 2025-10-13 19:22:20.276692 | controller | } 2025-10-13 19:22:20.276707 | controller | } 2025-10-13 19:22:20.276748 | controller | } 2025-10-13 19:22:20.276771 | controller | } 2025-10-13 19:22:20.291026 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/playbooks/crc/bootstrap-ci-network-instance.yml 2025-10-13 19:22:20.294761 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/playbooks/crc/bootstrap-ci-network-instance.yml 2025-10-13 19:22:20.305075 | 2025-10-13 19:22:20.305181 | TASK [Create instance ports and attach if necessary] 2025-10-13 19:22:20.324870 | controller | ok 2025-10-13 19:22:20.411880 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/playbooks/crc/bootstrap-ci-network-instance-create-attach-port.yml 2025-10-13 19:22:20.417684 | 2025-10-13 19:22:20.417774 | TASK [Print the host networking data] 2025-10-13 19:22:20.447469 | controller | ok 2025-10-13 19:22:20.453338 | 2025-10-13 19:22:20.453436 | TASK [Create the private network parent port] 2025-10-13 19:22:22.950834 | controller | admin_state_up: true 2025-10-13 19:22:22.951056 | controller | allowed_address_pairs: [] 2025-10-13 19:22:22.951244 | controller | binding_host_id: null 2025-10-13 19:22:22.951370 | controller | binding_profile: {} 2025-10-13 19:22:22.951512 | controller | binding_vif_details: {} 2025-10-13 19:22:22.951705 | controller | binding_vif_type: null 2025-10-13 19:22:22.951858 | controller | binding_vnic_type: normal 2025-10-13 19:22:22.952002 | controller | created_at: '2025-10-13T19:22:22Z' 2025-10-13 19:22:22.952126 | controller | data_plane_status: null 2025-10-13 19:22:22.952241 | controller | description: '' 2025-10-13 19:22:22.952402 | controller | device_id: '' 2025-10-13 19:22:22.952526 | controller | device_owner: '' 2025-10-13 19:22:22.952645 | controller | device_profile: null 2025-10-13 19:22:22.952957 | controller | dns_assignment: 2025-10-13 19:22:22.953072 | controller | - fqdn: host-192-168-122-11.openstacklocal. 2025-10-13 19:22:22.953082 | controller | hostname: host-192-168-122-11 2025-10-13 19:22:22.953089 | controller | ip_address: 192.168.122.11 2025-10-13 19:22:22.953097 | controller | dns_domain: '' 2025-10-13 19:22:22.953211 | controller | dns_name: '' 2025-10-13 19:22:22.953330 | controller | extra_dhcp_opts: [] 2025-10-13 19:22:22.953600 | controller | fixed_ips: 2025-10-13 19:22:22.953733 | controller | - ip_address: 192.168.122.11 2025-10-13 19:22:22.953743 | controller | subnet_id: c3435213-9a6b-46ed-a590-5894551f60e8 2025-10-13 19:22:22.953752 | controller | hardware_offload_type: null 2025-10-13 19:22:22.953860 | controller | hints: '' 2025-10-13 19:22:22.953999 | controller | id: 8ec4d66b-4406-4f1d-a1e8-810bdf50f928 2025-10-13 19:22:22.954123 | controller | ip_allocation: immediate 2025-10-13 19:22:22.954247 | controller | mac_address: fa:16:3e:94:63:4c 2025-10-13 19:22:22.954421 | controller | name: controller-8d8f3676-e7a5-4dad-b3ce-cc928d36e76f 2025-10-13 19:22:22.954575 | controller | network_id: 29e4fd91-7b8e-4108-9885-1a0c0e9ac3cf 2025-10-13 19:22:22.954703 | controller | numa_affinity_policy: null 2025-10-13 19:22:22.954857 | controller | port_security_enabled: false 2025-10-13 19:22:22.954996 | controller | project_id: 4b633c451ac74233be3721a3635275e5 2025-10-13 19:22:22.955123 | controller | propagate_uplink_status: null 2025-10-13 19:22:22.955242 | controller | resource_request: null 2025-10-13 19:22:22.955385 | controller | revision_number: 1 2025-10-13 19:22:22.955534 | controller | qos_network_policy_id: null 2025-10-13 19:22:22.955653 | controller | qos_policy_id: null 2025-10-13 19:22:22.955775 | controller | security_group_ids: [] 2025-10-13 19:22:22.955888 | controller | status: DOWN 2025-10-13 19:22:22.956000 | controller | tags: [] 2025-10-13 19:22:22.956119 | controller | trunk_details: null 2025-10-13 19:22:22.956252 | controller | trusted: null 2025-10-13 19:22:22.956416 | controller | updated_at: '2025-10-13T19:22:22Z' 2025-10-13 19:22:23.488597 | controller | changed 2025-10-13 19:22:23.502210 | 2025-10-13 19:22:23.502388 | TASK [Set common facts for further usage] 2025-10-13 19:22:23.596373 | controller | ok 2025-10-13 19:22:23.609890 | 2025-10-13 19:22:23.610061 | TASK [Create the trunk port] 2025-10-13 19:22:24.159863 | controller | skipping: Conditional result was False 2025-10-13 19:22:24.174214 | 2025-10-13 19:22:24.174401 | TASK [Avoid NetworkManager to automatically picked up the new interface] 2025-10-13 19:22:24.232373 | controller | skipping: Conditional result was False 2025-10-13 19:22:24.242365 | 2025-10-13 19:22:24.242513 | TASK [Refresh NetworkManager] 2025-10-13 19:22:24.299033 | controller | skipping: Conditional result was False 2025-10-13 19:22:24.306167 | 2025-10-13 19:22:24.306280 | TASK [Attach the port to the instance] 2025-10-13 19:22:31.347303 | controller | changed 2025-10-13 19:22:31.360065 | 2025-10-13 19:22:31.360250 | TASK [Wait till the interface exists] 2025-10-13 19:22:31.647668 | controller -> 38.102.83.182 | changed 2025-10-13 19:22:31.654995 | 2025-10-13 19:22:31.655073 | TASK [Prepare interface data to be used configuring trunk and vlan ifaces] 2025-10-13 19:22:31.776309 | controller | ok 2025-10-13 19:22:31.793331 | 2025-10-13 19:22:31.793529 | LOOP [Create VLANs ports and attach them to the trunk] 2025-10-13 19:22:31.825078 | 2025-10-13 19:22:31.825386 | LOOP [Prepare VLANs interface data to be used configuring] 2025-10-13 19:22:31.857232 | 2025-10-13 19:22:31.857614 | LOOP [Create NetworkManager configuration file for the trunk port] 2025-10-13 19:22:32.662770 | controller -> 38.102.83.182 | changed: 2025-10-13 19:22:32.662969 | controller -> 38.102.83.182 | { 2025-10-13 19:22:32.662995 | controller -> 38.102.83.182 | "key": "default", 2025-10-13 19:22:32.663013 | controller -> 38.102.83.182 | "value": { 2025-10-13 19:22:32.663030 | controller -> 38.102.83.182 | "connection": "ci-private-network", 2025-10-13 19:22:32.663046 | controller -> 38.102.83.182 | "gw": "192.168.122.1", 2025-10-13 19:22:32.663061 | controller -> 38.102.83.182 | "iface": "eth1", 2025-10-13 19:22:32.663077 | controller -> 38.102.83.182 | "ip": "192.168.122.11/24", 2025-10-13 19:22:32.663092 | controller -> 38.102.83.182 | "mac": "fa:16:3e:94:63:4c", 2025-10-13 19:22:32.663108 | controller -> 38.102.83.182 | "mtu": "1500" 2025-10-13 19:22:32.663122 | controller -> 38.102.83.182 | } 2025-10-13 19:22:32.663137 | controller -> 38.102.83.182 | } 2025-10-13 19:22:32.663167 | 2025-10-13 19:22:32.703706 | 2025-10-13 19:22:32.703843 | TASK [Refresh NetworkManager] 2025-10-13 19:22:33.601519 | controller -> 38.102.83.182 | changed 2025-10-13 19:22:33.626025 | 2025-10-13 19:22:33.626312 | TASK [Debug fetch IP routes] 2025-10-13 19:22:33.979043 | controller -> 38.102.83.182 | changed 2025-10-13 19:22:34.000244 | 2025-10-13 19:22:34.000441 | TASK [Debug IP routes] 2025-10-13 19:22:34.058960 | controller -> 38.102.83.182 | ok 2025-10-13 19:22:34.072362 | 2025-10-13 19:22:34.072542 | TASK [Create instance ports and attach if necessary] 2025-10-13 19:22:34.105187 | controller | ok 2025-10-13 19:22:34.125015 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/playbooks/crc/bootstrap-ci-network-instance-create-attach-port.yml 2025-10-13 19:22:34.133235 | 2025-10-13 19:22:34.133342 | TASK [Print the host networking data] 2025-10-13 19:22:34.162879 | controller | ok 2025-10-13 19:22:34.169225 | 2025-10-13 19:22:34.169330 | TASK [Create the private network parent port] 2025-10-13 19:22:36.921385 | controller | admin_state_up: true 2025-10-13 19:22:36.921549 | controller | allowed_address_pairs: [] 2025-10-13 19:22:36.921719 | controller | binding_host_id: null 2025-10-13 19:22:36.921822 | controller | binding_profile: {} 2025-10-13 19:22:36.921921 | controller | binding_vif_details: {} 2025-10-13 19:22:36.922021 | controller | binding_vif_type: null 2025-10-13 19:22:36.922150 | controller | binding_vnic_type: normal 2025-10-13 19:22:36.922265 | controller | created_at: '2025-10-13T19:22:36Z' 2025-10-13 19:22:36.922363 | controller | data_plane_status: null 2025-10-13 19:22:36.922475 | controller | description: '' 2025-10-13 19:22:36.922566 | controller | device_id: '' 2025-10-13 19:22:36.922657 | controller | device_owner: '' 2025-10-13 19:22:36.922751 | controller | device_profile: null 2025-10-13 19:22:36.923051 | controller | dns_assignment: 2025-10-13 19:22:36.923143 | controller | - fqdn: host-192-168-122-10.openstacklocal. 2025-10-13 19:22:36.923154 | controller | hostname: host-192-168-122-10 2025-10-13 19:22:36.923160 | controller | ip_address: 192.168.122.10 2025-10-13 19:22:36.923169 | controller | dns_domain: '' 2025-10-13 19:22:36.923234 | controller | dns_name: '' 2025-10-13 19:22:36.923327 | controller | extra_dhcp_opts: [] 2025-10-13 19:22:36.923585 | controller | fixed_ips: 2025-10-13 19:22:36.923710 | controller | - ip_address: 192.168.122.10 2025-10-13 19:22:36.923721 | controller | subnet_id: c3435213-9a6b-46ed-a590-5894551f60e8 2025-10-13 19:22:36.923729 | controller | hardware_offload_type: null 2025-10-13 19:22:36.923806 | controller | hints: '' 2025-10-13 19:22:36.923914 | controller | id: e46842b8-b9d1-4d47-86e8-f01c52684e6d 2025-10-13 19:22:36.924008 | controller | ip_allocation: immediate 2025-10-13 19:22:36.924110 | controller | mac_address: fa:16:3e:2d:95:4a 2025-10-13 19:22:36.924224 | controller | name: crc-7f6da054-260b-4efc-9e6f-f710d7e3cf6b 2025-10-13 19:22:36.924343 | controller | network_id: 29e4fd91-7b8e-4108-9885-1a0c0e9ac3cf 2025-10-13 19:22:36.924461 | controller | numa_affinity_policy: null 2025-10-13 19:22:36.924591 | controller | port_security_enabled: false 2025-10-13 19:22:36.924709 | controller | project_id: 4b633c451ac74233be3721a3635275e5 2025-10-13 19:22:36.924809 | controller | propagate_uplink_status: null 2025-10-13 19:22:36.924906 | controller | resource_request: null 2025-10-13 19:22:36.925026 | controller | revision_number: 1 2025-10-13 19:22:36.925127 | controller | qos_network_policy_id: null 2025-10-13 19:22:36.925242 | controller | qos_policy_id: null 2025-10-13 19:22:36.925340 | controller | security_group_ids: [] 2025-10-13 19:22:36.925451 | controller | status: DOWN 2025-10-13 19:22:36.925543 | controller | tags: [] 2025-10-13 19:22:36.925639 | controller | trunk_details: null 2025-10-13 19:22:36.925731 | controller | trusted: null 2025-10-13 19:22:36.925842 | controller | updated_at: '2025-10-13T19:22:36Z' 2025-10-13 19:22:37.203389 | controller | changed 2025-10-13 19:22:37.217297 | 2025-10-13 19:22:37.217428 | TASK [Set common facts for further usage] 2025-10-13 19:22:37.320414 | controller | ok 2025-10-13 19:22:37.334389 | 2025-10-13 19:22:37.334552 | TASK [Create the trunk port] 2025-10-13 19:22:37.885832 | controller | skipping: Conditional result was False 2025-10-13 19:22:37.899360 | 2025-10-13 19:22:37.899536 | TASK [Avoid NetworkManager to automatically picked up the new interface] 2025-10-13 19:22:38.009275 | controller | skipping: Conditional result was False 2025-10-13 19:22:38.022056 | 2025-10-13 19:22:38.022210 | TASK [Refresh NetworkManager] 2025-10-13 19:22:38.101344 | controller | skipping: Conditional result was False 2025-10-13 19:22:38.115200 | 2025-10-13 19:22:38.115341 | TASK [Attach the port to the instance] 2025-10-13 19:22:45.688177 | controller | changed 2025-10-13 19:22:45.702327 | 2025-10-13 19:22:45.702499 | TASK [Wait till the interface exists] 2025-10-13 19:22:46.057546 | controller -> 38.102.83.181 | changed 2025-10-13 19:22:46.073781 | 2025-10-13 19:22:46.073932 | TASK [Prepare interface data to be used configuring trunk and vlan ifaces] 2025-10-13 19:22:46.219284 | controller | ok 2025-10-13 19:22:46.232504 | 2025-10-13 19:22:46.232638 | LOOP [Create VLANs ports and attach them to the trunk] 2025-10-13 19:22:46.299443 | controller | skipping: Conditional result was False 2025-10-13 19:22:49.316902 | controller | skipping: Conditional result was False 2025-10-13 19:22:52.331825 | controller | skipping: Conditional result was False 2025-10-13 19:22:52.344419 | 2025-10-13 19:22:52.344521 | LOOP [Prepare VLANs interface data to be used configuring] 2025-10-13 19:22:52.552642 | controller | ok: 2025-10-13 19:22:52.554344 | controller | { 2025-10-13 19:22:52.554553 | controller | "key": "internal-api", 2025-10-13 19:22:52.554891 | controller | "value": { 2025-10-13 19:22:52.555093 | controller | "ip": "172.17.0.5" 2025-10-13 19:22:52.555291 | controller | } 2025-10-13 19:22:52.555433 | controller | } 2025-10-13 19:22:52.555555 | 2025-10-13 19:22:52.607780 | controller | ok: 2025-10-13 19:22:52.607941 | controller | { 2025-10-13 19:22:52.608004 | controller | "key": "storage", 2025-10-13 19:22:52.608051 | controller | "value": { 2025-10-13 19:22:52.608097 | controller | "ip": "172.18.0.5" 2025-10-13 19:22:52.608141 | controller | } 2025-10-13 19:22:52.608324 | controller | } 2025-10-13 19:22:52.644260 | controller | ok: 2025-10-13 19:22:52.644365 | controller | { 2025-10-13 19:22:52.644415 | controller | "key": "tenant", 2025-10-13 19:22:52.644453 | controller | "value": { 2025-10-13 19:22:52.644489 | controller | "ip": "172.19.0.5" 2025-10-13 19:22:52.644525 | controller | } 2025-10-13 19:22:52.644560 | controller | } 2025-10-13 19:22:52.704683 | 2025-10-13 19:22:52.704850 | LOOP [Create NetworkManager configuration file for the trunk port] 2025-10-13 19:22:53.756286 | controller -> 38.102.83.181 | changed: 2025-10-13 19:22:53.756692 | controller -> 38.102.83.181 | { 2025-10-13 19:22:53.756798 | controller -> 38.102.83.181 | "key": "default", 2025-10-13 19:22:53.756841 | controller -> 38.102.83.181 | "value": { 2025-10-13 19:22:53.756878 | controller -> 38.102.83.181 | "connection": "ci-private-network", 2025-10-13 19:22:53.756914 | controller -> 38.102.83.181 | "gw": "192.168.122.1", 2025-10-13 19:22:53.756948 | controller -> 38.102.83.181 | "iface": "ens7", 2025-10-13 19:22:53.756982 | controller -> 38.102.83.181 | "ip": "192.168.122.10/24", 2025-10-13 19:22:53.757016 | controller -> 38.102.83.181 | "mac": "fa:16:3e:2d:95:4a", 2025-10-13 19:22:53.757049 | controller -> 38.102.83.181 | "mtu": "1500" 2025-10-13 19:22:53.757082 | controller -> 38.102.83.181 | } 2025-10-13 19:22:53.757116 | controller -> 38.102.83.181 | } 2025-10-13 19:22:54.725230 | controller -> 38.102.83.181 | changed: 2025-10-13 19:22:54.725336 | controller -> 38.102.83.181 | { 2025-10-13 19:22:54.725367 | controller -> 38.102.83.181 | "key": "internal-api", 2025-10-13 19:22:54.725393 | controller -> 38.102.83.181 | "value": { 2025-10-13 19:22:54.725416 | controller -> 38.102.83.181 | "connection": "ci-private-network-20", 2025-10-13 19:22:54.725439 | controller -> 38.102.83.181 | "iface": "ens7.20", 2025-10-13 19:22:54.725461 | controller -> 38.102.83.181 | "ip": "172.17.0.5/24", 2025-10-13 19:22:54.725483 | controller -> 38.102.83.181 | "mac": "52:54:00:67:00:bb", 2025-10-13 19:22:54.725504 | controller -> 38.102.83.181 | "mtu": "1496", 2025-10-13 19:22:54.725525 | controller -> 38.102.83.181 | "parent_iface": "ens7", 2025-10-13 19:22:54.725546 | controller -> 38.102.83.181 | "vlan": 20 2025-10-13 19:22:54.725567 | controller -> 38.102.83.181 | } 2025-10-13 19:22:54.725589 | controller -> 38.102.83.181 | } 2025-10-13 19:22:55.603255 | controller -> 38.102.83.181 | changed: 2025-10-13 19:22:55.603513 | controller -> 38.102.83.181 | { 2025-10-13 19:22:55.603573 | controller -> 38.102.83.181 | "key": "storage", 2025-10-13 19:22:55.603614 | controller -> 38.102.83.181 | "value": { 2025-10-13 19:22:55.603652 | controller -> 38.102.83.181 | "connection": "ci-private-network-21", 2025-10-13 19:22:55.603688 | controller -> 38.102.83.181 | "iface": "ens7.21", 2025-10-13 19:22:55.603767 | controller -> 38.102.83.181 | "ip": "172.18.0.5/24", 2025-10-13 19:22:55.603814 | controller -> 38.102.83.181 | "mac": "52:54:00:cd:e4:63", 2025-10-13 19:22:55.603848 | controller -> 38.102.83.181 | "mtu": "1496", 2025-10-13 19:22:55.603891 | controller -> 38.102.83.181 | "parent_iface": "ens7", 2025-10-13 19:22:55.603940 | controller -> 38.102.83.181 | "vlan": 21 2025-10-13 19:22:55.603977 | controller -> 38.102.83.181 | } 2025-10-13 19:22:55.604010 | controller -> 38.102.83.181 | } 2025-10-13 19:22:56.622507 | controller -> 38.102.83.181 | changed: 2025-10-13 19:22:56.622672 | controller -> 38.102.83.181 | { 2025-10-13 19:22:56.622778 | controller -> 38.102.83.181 | "key": "tenant", 2025-10-13 19:22:56.622830 | controller -> 38.102.83.181 | "value": { 2025-10-13 19:22:56.622870 | controller -> 38.102.83.181 | "connection": "ci-private-network-22", 2025-10-13 19:22:56.622906 | controller -> 38.102.83.181 | "iface": "ens7.22", 2025-10-13 19:22:56.622943 | controller -> 38.102.83.181 | "ip": "172.19.0.5/24", 2025-10-13 19:22:56.622980 | controller -> 38.102.83.181 | "mac": "52:54:00:75:f7:82", 2025-10-13 19:22:56.623016 | controller -> 38.102.83.181 | "mtu": "1496", 2025-10-13 19:22:56.623052 | controller -> 38.102.83.181 | "parent_iface": "ens7", 2025-10-13 19:22:56.623085 | controller -> 38.102.83.181 | "vlan": 22 2025-10-13 19:22:56.623120 | controller -> 38.102.83.181 | } 2025-10-13 19:22:56.623156 | controller -> 38.102.83.181 | } 2025-10-13 19:22:56.633779 | 2025-10-13 19:22:56.633903 | TASK [Refresh NetworkManager] 2025-10-13 19:22:57.467260 | controller -> 38.102.83.181 | changed 2025-10-13 19:22:57.476342 | 2025-10-13 19:22:57.476438 | TASK [Debug fetch IP routes] 2025-10-13 19:22:57.800339 | controller -> 38.102.83.181 | changed 2025-10-13 19:22:57.807073 | 2025-10-13 19:22:57.807140 | TASK [Debug IP routes] 2025-10-13 19:22:57.844097 | controller -> 38.102.83.181 | ok 2025-10-13 19:22:57.858167 | 2025-10-13 19:22:57.858327 | TASK [Display some data about network ports] 2025-10-13 19:22:59.674954 | controller | +--------------------------------------+-------------------------------------------------+-------------------+-------------------------------------------------------------------------------+--------+ 2025-10-13 19:22:59.799531 | controller | | ID | Name | MAC Address | Fixed IP Addresses | Status | 2025-10-13 19:22:59.799597 | controller | +--------------------------------------+-------------------------------------------------+-------------------+-------------------------------------------------------------------------------+--------+ 2025-10-13 19:22:59.799605 | controller | | 491c72f5-685c-424f-bbb3-f1f7989baffe | | fa:16:3e:b2:f3:42 | | DOWN | 2025-10-13 19:22:59.799612 | controller | | 8ec4d66b-4406-4f1d-a1e8-810bdf50f928 | controller-8d8f3676-e7a5-4dad-b3ce-cc928d36e76f | fa:16:3e:94:63:4c | ip_address='192.168.122.11', subnet_id='c3435213-9a6b-46ed-a590-5894551f60e8' | ACTIVE | 2025-10-13 19:22:59.799618 | controller | | e46842b8-b9d1-4d47-86e8-f01c52684e6d | crc-7f6da054-260b-4efc-9e6f-f710d7e3cf6b | fa:16:3e:2d:95:4a | ip_address='192.168.122.10', subnet_id='c3435213-9a6b-46ed-a590-5894551f60e8' | ACTIVE | 2025-10-13 19:22:59.799624 | controller | +--------------------------------------+-------------------------------------------------+-------------------+-------------------------------------------------------------------------------+--------+ 2025-10-13 19:22:59.912089 | controller | changed 2025-10-13 19:22:59.918665 | 2025-10-13 19:22:59.918781 | LOOP [Display server configuration] 2025-10-13 19:23:02.031288 | controller | changed 2025-10-13 19:23:02.031613 | controller | changed: All items complete 2025-10-13 19:23:02.031657 | 2025-10-13 19:23:07.429700 | controller | changed 2025-10-13 19:23:07.453484 | 2025-10-13 19:23:07.453659 | TASK [Fetch underneath provider DNSs] 2025-10-13 19:23:07.483981 | controller | ok 2025-10-13 19:23:07.496806 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/playbooks/crc/bootstrap-ci-network-fetch-provider-dns.yml 2025-10-13 19:23:07.512436 | 2025-10-13 19:23:07.512543 | TASK [Fetch the DNS list of the default interface] 2025-10-13 19:23:07.918359 | controller | ok 2025-10-13 19:23:07.928303 | 2025-10-13 19:23:07.928536 | TASK [Set provider DNS for further usage] 2025-10-13 19:23:07.970931 | controller | ok 2025-10-13 19:23:07.976069 | 2025-10-13 19:23:07.976130 | LOOP [Save networking data to file for further usage] 2025-10-13 19:23:08.939055 | controller -> 38.102.83.181 | changed: "crc" 2025-10-13 19:23:09.680299 | controller -> 38.102.83.182 | changed: "controller" 2025-10-13 19:23:09.696381 | 2025-10-13 19:23:09.696559 | TASK [Remove cloud_secrets file] 2025-10-13 19:23:09.950603 | controller | changed 2025-10-13 19:23:09.982995 | 2025-10-13 19:23:09.983116 | PLAY RECAP 2025-10-13 19:23:09.983176 | controller | ok: 48 changed: 22 unreachable: 0 failed: 0 skipped: 14 rescued: 0 ignored: 0 2025-10-13 19:23:09.983207 | 2025-10-13 19:23:10.106460 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/crc/bootstrap-ci-network.yml@master] 2025-10-13 19:23:10.110061 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/crc/prepare-crc.yaml@master] 2025-10-13 19:23:10.722088 | 2025-10-13 19:23:10.722224 | PLAY [Prefer ipv4 over ipv6] 2025-10-13 19:23:10.759960 | 2025-10-13 19:23:10.760097 | TASK [Configure /etc/gai.conf to prever ipv4 over ipv6] 2025-10-13 19:23:10.818592 | controller | skipping: Conditional result was False 2025-10-13 19:23:10.819128 | crc | skipping: Conditional result was False 2025-10-13 19:23:10.875626 | 2025-10-13 19:23:10.875772 | PLAY [Generic task for migration time to crc-cloud] 2025-10-13 19:23:10.906655 | 2025-10-13 19:23:10.906789 | TASK [Check if there is a image build date file] 2025-10-13 19:23:11.373846 | crc | ok 2025-10-13 19:23:11.398344 | 2025-10-13 19:23:11.398479 | TASK [Print image date] 2025-10-13 19:23:11.871526 | crc | Mon Oct 13 01:49:08 UTC 2025 | Image type: crc-cloud 2025-10-13 19:23:11.949295 | crc | ok 2025-10-13 19:23:11.985490 | 2025-10-13 19:23:11.985618 | TASK [Run crc-cloud preparation] 2025-10-13 19:23:12.017764 | crc | ok 2025-10-13 19:23:12.046031 | 2025-10-13 19:23:12.046159 | TASK [prepare-crc-cloud : Print build date] 2025-10-13 19:23:12.077376 | crc | ok 2025-10-13 19:23:12.085538 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/build_date.yaml 2025-10-13 19:23:12.095045 | 2025-10-13 19:23:12.095120 | TASK [prepare-crc-cloud : Check if there is a image build date file] 2025-10-13 19:23:12.380346 | crc | ok 2025-10-13 19:23:12.387390 | 2025-10-13 19:23:12.387461 | TASK [prepare-crc-cloud : Print image date if available] 2025-10-13 19:23:12.665968 | crc | Mon Oct 13 01:49:08 UTC 2025 | Image type: crc-cloud 2025-10-13 19:23:12.928311 | crc | ok 2025-10-13 19:23:12.947717 | 2025-10-13 19:23:12.947948 | TASK [prepare-crc-cloud : Tune Kubelet config file] 2025-10-13 19:23:12.965447 | crc | skipping: Conditional result was False 2025-10-13 19:23:12.982541 | 2025-10-13 19:23:12.982699 | TASK [prepare-crc-cloud : Reboot CRC host to get the network interfaces] 2025-10-13 19:23:13.015090 | crc | ok 2025-10-13 19:23:13.032995 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/reboot_crc.yaml 2025-10-13 19:23:13.047232 | 2025-10-13 19:23:13.047318 | TASK [prepare-crc-cloud : Reboot host after adding pull secret and changing kubelet node params] 2025-10-13 19:24:08.293231 | crc | changed 2025-10-13 19:24:08.300520 | 2025-10-13 19:24:08.300614 | TASK [Start Zuul console after reboot] 2025-10-13 19:24:08.335011 | crc | ok 2025-10-13 19:24:08.364383 | 2025-10-13 19:24:08.364518 | TASK [start-zuul-console : Start zuul_console daemon.] 2025-10-13 19:24:09.117259 | crc | ok 2025-10-13 19:24:09.147832 | 2025-10-13 19:24:09.148018 | TASK [prepare-crc-cloud : Prepare for executing crc-cloud] 2025-10-13 19:24:09.184663 | crc | ok 2025-10-13 19:24:09.196246 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/pre.yaml 2025-10-13 19:24:09.211303 | 2025-10-13 19:24:09.211388 | TASK [prepare-crc-cloud : Disable overwriting /etc/resolv.conf by the NetworkManager] 2025-10-13 19:24:10.308377 | crc | changed 2025-10-13 19:24:10.316329 | 2025-10-13 19:24:10.316411 | TASK [prepare-crc-cloud : Reload NetworkManager after creating custom rules] 2025-10-13 19:24:11.304669 | crc | changed 2025-10-13 19:24:11.315092 | 2025-10-13 19:24:11.315216 | TASK [prepare-crc-cloud : Inject pull secret into /var/lib/kubelet/config.json] 2025-10-13 19:24:12.358580 | crc | changed 2025-10-13 19:24:12.369681 | 2025-10-13 19:24:12.369819 | TASK [prepare-crc-cloud : Check if etcd slow profile set] 2025-10-13 19:24:12.404656 | crc | skipping: Conditional result was False 2025-10-13 19:24:12.414665 | 2025-10-13 19:24:12.414841 | TASK [prepare-crc-cloud : Use ramdisk for etcd] 2025-10-13 19:24:12.449301 | crc | ok 2025-10-13 19:24:12.464021 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/ramdisk.yaml 2025-10-13 19:24:12.479643 | 2025-10-13 19:24:12.479797 | TASK [prepare-crc-cloud : Move current etcd to other place] 2025-10-13 19:24:13.020188 | crc | ok 2025-10-13 19:24:13.027519 | 2025-10-13 19:24:13.027600 | TASK [prepare-crc-cloud : Mount ramdisk] 2025-10-13 19:24:13.486440 | crc | changed 2025-10-13 19:24:13.500352 | 2025-10-13 19:24:13.500605 | TASK [prepare-crc-cloud : Set proper permissions after mount] 2025-10-13 19:24:14.033364 | crc | changed 2025-10-13 19:24:14.051809 | 2025-10-13 19:24:14.051991 | TASK [prepare-crc-cloud : Copy content from old location to ramdisk] 2025-10-13 19:24:15.527084 | crc | changed 2025-10-13 19:24:15.544945 | 2025-10-13 19:24:15.545167 | TASK [prepare-crc-cloud : Set proper SELinux context] 2025-10-13 19:24:16.114208 | crc | ok 2025-10-13 19:24:16.135608 | 2025-10-13 19:24:16.135838 | TASK [prepare-crc-cloud : Block crc.testing domains] 2025-10-13 19:24:16.177879 | crc | ok 2025-10-13 19:24:16.198327 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/block_crc_domains.yaml 2025-10-13 19:24:16.220904 | 2025-10-13 19:24:16.221053 | LOOP [prepare-crc-cloud : Set crc.testing domains into /etc/hosts] 2025-10-13 19:24:16.701831 | crc | changed: line added 2025-10-13 19:24:16.985719 | crc | changed: line added 2025-10-13 19:24:17.280379 | crc | changed: line added 2025-10-13 19:24:17.521477 | crc | changed: line added 2025-10-13 19:24:17.814101 | crc | changed: line added 2025-10-13 19:24:18.096318 | crc | changed: line added 2025-10-13 19:24:18.389575 | crc | changed: line added 2025-10-13 19:24:18.684344 | crc | changed: line added 2025-10-13 19:24:18.751506 | 2025-10-13 19:24:18.751621 | TASK [prepare-crc-cloud : Get default interface name] 2025-10-13 19:24:19.117699 | crc | ens3 2025-10-13 19:24:19.289796 | crc | ok 2025-10-13 19:24:19.308073 | 2025-10-13 19:24:19.308246 | LOOP [prepare-crc-cloud : Block CRC domains also using iptables] 2025-10-13 19:24:19.860106 | crc | ok 2025-10-13 19:24:19.860555 | crc | changed: All items complete 2025-10-13 19:24:19.860807 | 2025-10-13 19:24:20.130438 | crc | ok 2025-10-13 19:24:20.430440 | crc | ok 2025-10-13 19:24:20.747607 | crc | ok 2025-10-13 19:24:21.080847 | crc | ok 2025-10-13 19:24:21.380623 | crc | ok 2025-10-13 19:24:21.692110 | crc | ok 2025-10-13 19:24:21.963783 | crc | ok 2025-10-13 19:24:21.996213 | 2025-10-13 19:24:21.996429 | TASK [prepare-crc-cloud : Set required facts] 2025-10-13 19:24:22.042479 | crc | ok 2025-10-13 19:24:22.057586 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/set_vars.yaml 2025-10-13 19:24:22.073858 | 2025-10-13 19:24:22.074006 | TASK [prepare-crc-cloud : Set required facts] 2025-10-13 19:24:22.136652 | crc | Output suppressed because no_log was given 2025-10-13 19:24:22.143537 | 2025-10-13 19:24:22.143607 | TASK [Start crc-cloud role when Zuul defined] 2025-10-13 19:24:22.184909 | crc | ok 2025-10-13 19:24:22.230343 | 2025-10-13 19:24:22.230461 | TASK [deploy-crc-cloud : Check if pull-secret is provided] 2025-10-13 19:24:22.255107 | crc | skipping: Conditional result was False 2025-10-13 19:24:22.264979 | 2025-10-13 19:24:22.265083 | TASK [deploy-crc-cloud : Create kubeconfig] 2025-10-13 19:24:22.295832 | crc | ok 2025-10-13 19:24:22.304592 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/kubeconfig.yaml 2025-10-13 19:24:22.316820 | 2025-10-13 19:24:22.316923 | TASK [deploy-crc-cloud : Create kube directory] 2025-10-13 19:24:22.602898 | crc | changed 2025-10-13 19:24:22.609935 | 2025-10-13 19:24:22.610007 | TASK [deploy-crc-cloud : Copy kubeconfig to user dir] 2025-10-13 19:24:23.111001 | crc | changed 2025-10-13 19:24:23.131056 | 2025-10-13 19:24:23.131285 | TASK [deploy-crc-cloud : Setup dnsmasq] 2025-10-13 19:24:23.174484 | crc | ok 2025-10-13 19:24:23.194892 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/dnsmasq.yaml 2025-10-13 19:24:23.212762 | 2025-10-13 19:24:23.212853 | TASK [deploy-crc-cloud : Create crc-dnsmasq.conf] 2025-10-13 19:24:24.185161 | crc | changed 2025-10-13 19:24:24.195293 | 2025-10-13 19:24:24.195395 | LOOP [deploy-crc-cloud : Set this host as first nameserver in /etc/resolv.conf] 2025-10-13 19:24:24.537171 | crc | changed: line replaced 2025-10-13 19:24:24.847120 | crc | ok 2025-10-13 19:24:25.110936 | crc | ok 2025-10-13 19:24:25.134833 | 2025-10-13 19:24:25.134982 | TASK [deploy-crc-cloud : Disable overwriting /etc/resolv.conf by the NetworkManager] 2025-10-13 19:24:25.901420 | crc | ok 2025-10-13 19:24:25.920815 | 2025-10-13 19:24:25.920965 | TASK [deploy-crc-cloud : Restart NetworkManager when its needed] 2025-10-13 19:24:25.957713 | crc | skipping: Conditional result was False 2025-10-13 19:24:25.969954 | 2025-10-13 19:24:25.970098 | TASK [deploy-crc-cloud : Restart dnsmasq] 2025-10-13 19:24:27.888018 | crc | changed 2025-10-13 19:24:27.914281 | 2025-10-13 19:24:27.914454 | TASK [deploy-crc-cloud : Start kubelet] 2025-10-13 19:24:27.954584 | crc | ok 2025-10-13 19:24:27.974712 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/kubelet.yaml 2025-10-13 19:24:28.000985 | 2025-10-13 19:24:28.001119 | TASK [deploy-crc-cloud : Start and enable kubelet] 2025-10-13 19:24:42.151904 | crc | changed 2025-10-13 19:24:42.174125 | 2025-10-13 19:24:42.174353 | TASK [deploy-crc-cloud : Wait for port 6443 to be up] 2025-10-13 19:25:42.688844 | crc | ok 2025-10-13 19:25:42.705572 | 2025-10-13 19:25:42.705814 | TASK [deploy-crc-cloud : Wait for API to start before continue] 2025-10-13 19:25:44.117994 | crc | NAMESPACE NAME READY STATUS RESTARTS AGE 2025-10-13 19:25:44.118075 | crc | openshift-apiserver-operator openshift-apiserver-operator-796bbdcf4f-wrm6s 0/1 Pending 0 43s 2025-10-13 19:25:44.118096 | crc | openshift-apiserver apiserver-76f77b778f-h75w4 0/2 Pending 0 43s 2025-10-13 19:25:44.118108 | crc | openshift-authentication-operator authentication-operator-69f744f599-wbldg 0/1 Pending 0 43s 2025-10-13 19:25:44.118121 | crc | openshift-authentication oauth-openshift-558db77b4-799nv 0/1 Pending 0 43s 2025-10-13 19:25:44.118134 | crc | openshift-cluster-machine-approver machine-approver-56656f9798-tlf8c 0/2 Pending 0 43s 2025-10-13 19:25:44.118146 | crc | openshift-cluster-samples-operator cluster-samples-operator-665b6dd947-jq5bg 0/2 Pending 0 43s 2025-10-13 19:25:44.118158 | crc | openshift-cluster-version cluster-version-operator-5c965bbfc6-6lkhl 0/1 Pending 0 43s 2025-10-13 19:25:44.118175 | crc | openshift-config-operator openshift-config-operator-7777fb866f-xjnmn 0/1 Pending 0 43s 2025-10-13 19:25:44.118187 | crc | openshift-console-operator console-operator-58897d9998-44frm 0/1 Pending 0 43s 2025-10-13 19:25:44.118200 | crc | openshift-console console-f9d7485db-vjjt5 0/1 Pending 0 43s 2025-10-13 19:25:44.118212 | crc | openshift-console downloads-7954f5f757-7cvtv 0/1 Pending 0 43s 2025-10-13 19:25:44.118231 | crc | openshift-controller-manager-operator openshift-controller-manager-operator-756b6f6bc6-c4k8m 0/1 Pending 0 43s 2025-10-13 19:25:44.118245 | crc | openshift-controller-manager controller-manager-879f6c89f-65ckv 0/1 Pending 0 43s 2025-10-13 19:25:44.118258 | crc | openshift-dns-operator dns-operator-744455d44c-txxmq 0/2 Pending 0 42s 2025-10-13 19:25:44.118343 | crc | openshift-dns node-resolver-2gpk7 0/1 Pending 0 43s 2025-10-13 19:25:44.118399 | crc | openshift-etcd-operator etcd-operator-b45778765-2rb6d 0/1 Pending 0 42s 2025-10-13 19:25:44.118414 | crc | openshift-etcd etcd-crc 0/5 Pending 0 42s 2025-10-13 19:25:44.118427 | crc | openshift-image-registry cluster-image-registry-operator-dc59b4c8b-tlhzg 0/1 Pending 0 42s 2025-10-13 19:25:44.118439 | crc | openshift-image-registry image-registry-697d97f7c8-v9wn7 0/1 Pending 0 42s 2025-10-13 19:25:44.118456 | crc | openshift-image-registry node-ca-7k44s 0/1 Pending 0 43s 2025-10-13 19:25:44.118468 | crc | openshift-ingress-operator ingress-operator-5b745b69d9-l7kq4 0/2 Pending 0 42s 2025-10-13 19:25:44.118481 | crc | openshift-ingress router-default-5444994796-8zqqx 0/1 Pending 0 42s 2025-10-13 19:25:44.118493 | crc | openshift-kube-apiserver-operator kube-apiserver-operator-766d6c64bb-bshp5 0/1 Pending 0 42s 2025-10-13 19:25:44.118508 | crc | openshift-kube-apiserver kube-apiserver-crc 0/5 Pending 0 42s 2025-10-13 19:25:44.118531 | crc | openshift-kube-controller-manager-operator kube-controller-manager-operator-78b949d7b-99f6g 0/1 Pending 0 42s 2025-10-13 19:25:44.118553 | crc | openshift-kube-controller-manager kube-controller-manager-crc 0/4 Pending 0 37s 2025-10-13 19:25:44.118565 | crc | openshift-kube-scheduler-operator openshift-kube-scheduler-operator-5fdd9b5758-bcjgg 0/1 Pending 0 42s 2025-10-13 19:25:44.118578 | crc | openshift-kube-scheduler openshift-kube-scheduler-crc 0/3 Pending 0 11s 2025-10-13 19:25:44.118590 | crc | openshift-kube-storage-version-migrator-operator kube-storage-version-migrator-operator-b67b599dd-tmbgk 0/1 Pending 0 42s 2025-10-13 19:25:44.118602 | crc | openshift-kube-storage-version-migrator migrator-59844c95c7-bd9mk 0/2 Pending 0 42s 2025-10-13 19:25:44.118614 | crc | openshift-machine-api control-plane-machine-set-operator-78cbb6b69f-zqxbw 0/1 Pending 0 42s 2025-10-13 19:25:44.118636 | crc | openshift-machine-api machine-api-operator-5694c8668f-zggdj 0/2 Pending 0 42s 2025-10-13 19:25:44.118648 | crc | openshift-machine-config-operator machine-config-controller-84d6567774-qlblm 0/2 Pending 0 42s 2025-10-13 19:25:44.118660 | crc | openshift-machine-config-operator machine-config-daemon-jlhbw 0/2 Pending 0 43s 2025-10-13 19:25:44.118672 | crc | openshift-machine-config-operator machine-config-operator-74547568cd-ktq5j 0/2 Pending 0 42s 2025-10-13 19:25:44.118685 | crc | openshift-marketplace marketplace-operator-79b997595-zggfl 0/1 Pending 0 42s 2025-10-13 19:25:44.118701 | crc | openshift-multus multus-additional-cni-plugins-cwxl8 0/1 Pending 0 43s 2025-10-13 19:25:44.118713 | crc | openshift-multus multus-admission-controller-857f4d67dd-7hjd4 0/2 Pending 0 42s 2025-10-13 19:25:44.118748 | crc | openshift-multus multus-g6bs4 0/1 Pending 0 43s 2025-10-13 19:25:44.118762 | crc | openshift-multus network-metrics-daemon-mvzcq 0/2 Pending 0 43s 2025-10-13 19:25:44.118785 | crc | openshift-network-console networking-console-plugin-85b44fc459-gdk6g 1/1 Running 2 232d 2025-10-13 19:25:44.118804 | crc | openshift-network-diagnostics network-check-source-55646444c4-trplf 1/1 Running 2 232d 2025-10-13 19:25:44.118818 | crc | openshift-network-diagnostics network-check-target-xd92c 1/1 Running 2 232d 2025-10-13 19:25:44.118835 | crc | openshift-network-node-identity network-node-identity-vrzqb 2/2 Running 7 232d 2025-10-13 19:25:44.118851 | crc | openshift-network-operator iptables-alerter-4ln5h 1/1 Running 2 232d 2025-10-13 19:25:44.118867 | crc | openshift-network-operator network-operator-58b4c7f79c-55gtf 1/1 Running 4 232d 2025-10-13 19:25:44.118885 | crc | openshift-oauth-apiserver apiserver-7bbb656c7d-svdbt 0/1 Pending 0 42s 2025-10-13 19:25:44.118909 | crc | openshift-operator-lifecycle-manager catalog-operator-68c6474976-gnhqs 0/1 Pending 0 42s 2025-10-13 19:25:44.118930 | crc | openshift-operator-lifecycle-manager collect-profiles-29339715-7q2tb 0/1 Pending 0 42s 2025-10-13 19:25:44.118946 | crc | openshift-operator-lifecycle-manager olm-operator-6b444d44fb-mb5b9 0/1 Pending 0 42s 2025-10-13 19:25:44.118961 | crc | openshift-operator-lifecycle-manager package-server-manager-789f6589d5-9nn5x 0/2 Pending 0 42s 2025-10-13 19:25:44.118978 | crc | openshift-operator-lifecycle-manager packageserver-d55dfcdfc-6jmbc 0/1 Pending 0 42s 2025-10-13 19:25:44.118993 | crc | openshift-ovn-kubernetes ovnkube-control-plane-749d76644c-lhjss 0/2 Pending 0 42s 2025-10-13 19:25:44.119011 | crc | openshift-ovn-kubernetes ovnkube-node-ns9xq 0/8 Pending 0 42s 2025-10-13 19:25:44.119030 | crc | openshift-route-controller-manager route-controller-manager-6576b87f9c-484r5 0/1 Pending 0 42s 2025-10-13 19:25:44.119048 | crc | openshift-service-ca-operator service-ca-operator-777779d784-25l8h 0/1 Pending 0 42s 2025-10-13 19:25:44.119070 | crc | openshift-service-ca service-ca-9c57cc56f-5rhd8 0/1 Pending 0 42s 2025-10-13 19:25:44.304201 | crc | ok 2025-10-13 19:25:44.315674 | 2025-10-13 19:25:44.315796 | TASK [deploy-crc-cloud : Replace default pubkey] 2025-10-13 19:25:44.351302 | crc | ok 2025-10-13 19:25:44.365692 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/pubkey.yaml 2025-10-13 19:25:44.392258 | 2025-10-13 19:25:44.392416 | TASK [deploy-crc-cloud : Check if id_rsa.pub exists] 2025-10-13 19:25:44.649004 | crc | ok 2025-10-13 19:25:44.656374 | 2025-10-13 19:25:44.656438 | TASK [deploy-crc-cloud : Read pub key] 2025-10-13 19:25:45.192850 | crc | skipping: Conditional result was False 2025-10-13 19:25:45.208628 | 2025-10-13 19:25:45.208819 | TASK [deploy-crc-cloud : Wait for machineconfig] 2025-10-13 19:25:45.235108 | crc | skipping: Conditional result was False 2025-10-13 19:25:45.248145 | 2025-10-13 19:25:45.248269 | TASK [deploy-crc-cloud : Patch machineconfig 99-master-ssh] 2025-10-13 19:25:45.803582 | crc | skipping: Conditional result was False 2025-10-13 19:25:45.812020 | 2025-10-13 19:25:45.812101 | TASK [deploy-crc-cloud : Wait for cluster become healthy] 2025-10-13 19:25:45.843841 | crc | ok 2025-10-13 19:25:45.852342 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/wait_cluster_become_healthy.yaml 2025-10-13 19:25:45.872054 | 2025-10-13 19:25:45.872140 | TASK [deploy-crc-cloud : Check if specified OpenShift components are healthy etcd|openshift-apiserver] 2025-10-13 19:25:46.303849 | crc | True 2025-10-13 19:25:46.304500 | crc | False 2025-10-13 19:27:19.612515 | crc | changed 2025-10-13 19:27:19.629304 | 2025-10-13 19:27:19.629505 | TASK [deploy-crc-cloud : Output success message if components are healthy] 2025-10-13 19:27:19.684195 | crc | ok: OpenShift cluster components have become healthy in approximately 20 * 15 seconds. 2025-10-13 19:27:19.700833 | 2025-10-13 19:27:19.701007 | TASK [deploy-crc-cloud : Fail if any components are still unhealthy] 2025-10-13 19:27:19.727492 | crc | skipping: Conditional result was False 2025-10-13 19:27:19.739302 | 2025-10-13 19:27:19.739474 | TASK [deploy-crc-cloud : Set credentials] 2025-10-13 19:27:19.781106 | crc | ok 2025-10-13 19:27:19.802436 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/set_credentials.yaml 2025-10-13 19:27:19.836189 | 2025-10-13 19:27:19.836321 | TASK [deploy-crc-cloud : Ensure htpasswd.txt does not exists] 2025-10-13 19:27:20.198275 | crc | ok 2025-10-13 19:27:20.215669 | 2025-10-13 19:27:20.215947 | TASK [deploy-crc-cloud : Create temporary directory] 2025-10-13 19:27:20.719699 | crc | changed 2025-10-13 19:27:20.734811 | 2025-10-13 19:27:20.734942 | TASK [deploy-crc-cloud : Create Dockerfile] 2025-10-13 19:27:21.723636 | crc | changed 2025-10-13 19:27:21.746040 | 2025-10-13 19:27:21.746236 | TASK [deploy-crc-cloud : Build container image for htpasswd] 2025-10-13 19:27:34.164452 | crc | STEP 1/3: FROM quay.io/centos/centos:stream9-minimal 2025-10-13 19:27:34.167559 | crc | Trying to pull quay.io/centos/centos:stream9-minimal... 2025-10-13 19:27:34.875469 | crc | Getting image source signatures 2025-10-13 19:27:34.875638 | crc | Copying blob sha256:719e3e6e8ce296c698ff5415c7e5530575d6ceda2e8bd21ff63024eab178fe21 2025-10-13 19:27:36.604332 | crc | Copying config sha256:696c992e82392945f4e72ebc1979dca4f96921915a13e72f05df26901876c9d5 2025-10-13 19:27:36.611804 | crc | Writing manifest to image destination 2025-10-13 19:27:36.649915 | crc | STEP 2/3: RUN microdnf --setopt=tsflags=nodocs --setopt=install_weak_deps=0 install -y httpd-tools 2025-10-13 19:27:37.064681 | crc | Downloading metadata... 2025-10-13 19:27:37.667139 | crc | Downloading metadata... 2025-10-13 19:27:40.476868 | crc | Downloading metadata... 2025-10-13 19:27:48.459217 | crc | Package Repository Size 2025-10-13 19:27:48.581540 | crc | Installing: 2025-10-13 19:27:48.581593 | crc | apr-1.7.0-12.el9.x86_64 appstream 126.2 kB 2025-10-13 19:27:48.581601 | crc | apr-util-1.6.1-23.el9.x86_64 appstream 97.3 kB 2025-10-13 19:27:48.581608 | crc | apr-util-bdb-1.6.1-23.el9.x86_64 appstream 13.3 kB 2025-10-13 19:27:48.581614 | crc | expat-2.5.0-5.el9.x86_64 baseos 118.6 kB 2025-10-13 19:27:48.581621 | crc | httpd-tools-2.4.62-7.el9.x86_64 appstream 81.5 kB 2025-10-13 19:27:48.581628 | crc | libdb-5.3.28-57.el9.x86_64 baseos 752.9 kB 2025-10-13 19:27:48.581635 | crc | Transaction Summary: 2025-10-13 19:27:48.581643 | crc | Installing: 6 packages 2025-10-13 19:27:48.581650 | crc | Reinstalling: 0 packages 2025-10-13 19:27:48.581657 | crc | Upgrading: 0 packages 2025-10-13 19:27:48.581664 | crc | Obsoleting: 0 packages 2025-10-13 19:27:48.581670 | crc | Removing: 0 packages 2025-10-13 19:27:48.581682 | crc | Downgrading: 0 packages 2025-10-13 19:27:48.581700 | crc | Downloading packages... 2025-10-13 19:27:49.673344 | crc | warning: Signature not supported. Hash algorithm SHA1 not available. 2025-10-13 19:27:49.686624 | crc | 2025-10-13 19:27:49.686679 | crc | (microdnf:1): libdnf-WARNING **: 19:27:49.673: failed to parse public key for /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-SIG-Extras 2025-10-13 19:27:49.686698 | crc | Running transaction test... 2025-10-13 19:27:51.720659 | crc | Installing: apr;1.7.0-12.el9;x86_64;appstream 2025-10-13 19:27:51.722819 | crc | Installing: expat;2.5.0-5.el9;x86_64;baseos 2025-10-13 19:27:51.726930 | crc | Installing: libdb;5.3.28-57.el9;x86_64;baseos 2025-10-13 19:27:51.740607 | crc | Installing: apr-util-bdb;1.6.1-23.el9;x86_64;appstream 2025-10-13 19:27:51.742987 | crc | Installing: apr-util;1.6.1-23.el9;x86_64;appstream 2025-10-13 19:27:51.747040 | crc | Installing: httpd-tools;2.4.62-7.el9;x86_64;appstream 2025-10-13 19:27:51.784365 | crc | Complete. 2025-10-13 19:27:54.896566 | crc | --> 244636235c34 2025-10-13 19:27:54.916081 | crc | STEP 3/3: ENTRYPOINT ["htpasswd", "-Bbn"] 2025-10-13 19:27:54.945804 | crc | COMMIT localhost/htpasswd:latest 2025-10-13 19:27:54.945877 | crc | --> a5a1b063c727 2025-10-13 19:27:54.946021 | crc | Successfully tagged localhost/htpasswd:latest 2025-10-13 19:27:54.973824 | crc | a5a1b063c72778aa9daf471fd7bd23bcf3e11c05d84eefe7846140aa55516194 2025-10-13 19:27:55.351089 | crc | changed 2025-10-13 19:27:55.359684 | 2025-10-13 19:27:55.359822 | LOOP [deploy-crc-cloud : Get htpasswd] 2025-10-13 19:27:55.478337 | crc | Output suppressed because no_log was given 2025-10-13 19:27:55.497991 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/get_htpasswd.yaml 2025-10-13 19:27:55.499157 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/get_htpasswd.yaml 2025-10-13 19:27:55.500040 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/get_htpasswd.yaml 2025-10-13 19:27:55.512436 | 2025-10-13 19:27:55.512527 | TASK [deploy-crc-cloud : Get htpasswd for developer] 2025-10-13 19:27:55.940265 | crc | time="2025-10-13T19:27:55Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2025-10-13 19:27:56.552623 | crc | changed 2025-10-13 19:27:56.561227 | 2025-10-13 19:27:56.561319 | TASK [deploy-crc-cloud : Get htpasswd for kubeadmin] 2025-10-13 19:27:56.969268 | crc | time="2025-10-13T19:27:56Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2025-10-13 19:27:57.599305 | crc | changed 2025-10-13 19:27:57.613681 | 2025-10-13 19:27:57.613864 | TASK [deploy-crc-cloud : Get htpasswd for redhat] 2025-10-13 19:27:58.010671 | crc | time="2025-10-13T19:27:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2025-10-13 19:27:58.665009 | crc | changed 2025-10-13 19:27:58.672439 | 2025-10-13 19:27:58.672511 | TASK [deploy-crc-cloud : Cleanup htpasswd.txt file] 2025-10-13 19:27:59.227265 | crc | changed 2025-10-13 19:27:59.245699 | 2025-10-13 19:27:59.245930 | TASK [deploy-crc-cloud : Create secret with generic htpass-secret] 2025-10-13 19:27:59.809155 | crc | changed 2025-10-13 19:27:59.817047 | 2025-10-13 19:27:59.817138 | TASK [deploy-crc-cloud : Replace htpass-secret] 2025-10-13 19:28:00.258448 | crc | secret/htpass-secret replaced 2025-10-13 19:28:00.396435 | crc | changed 2025-10-13 19:28:00.404849 | 2025-10-13 19:28:00.404956 | TASK [deploy-crc-cloud : Remove temporary directory] 2025-10-13 19:28:00.671851 | crc | changed 2025-10-13 19:28:00.679783 | 2025-10-13 19:28:00.679894 | TASK [deploy-crc-cloud : Replace default CA] 2025-10-13 19:28:00.705505 | crc | ok 2025-10-13 19:28:00.721098 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/replace_default_ca.yaml 2025-10-13 19:28:00.746856 | 2025-10-13 19:28:00.746984 | TASK [deploy-crc-cloud : Generate key] 2025-10-13 19:28:06.827612 | crc | changed 2025-10-13 19:28:06.844935 | 2025-10-13 19:28:06.845083 | TASK [deploy-crc-cloud : Generate cert] 2025-10-13 19:28:07.407807 | crc | changed 2025-10-13 19:28:07.423796 | 2025-10-13 19:28:07.423961 | TASK [deploy-crc-cloud : Generate csr] 2025-10-13 19:28:07.963400 | crc | .............+.+........+.+..+....+..............+.+......+...+......+........+......+.......+........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+.....+.+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.......+......+.....+......+...+...+...+.......+.........+...+...+...+...........+.+..+...+....+...+........+...+.+......+..+.+............+..................+............+..............+.+...+.........+..+..........+...+..+...+......+....+........+..................+......+.+..+.+..+.......+..+.............+...+........+....+.....+.+..............+...+....+........+.......+...+...+...+...........+...+......+.+........+......+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2025-10-13 19:28:08.020069 | crc | .+.....+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+.......+..........................+...+.+.....+.........+.+.....+.............+...............+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2025-10-13 19:28:08.027474 | crc | ----- 2025-10-13 19:28:08.504446 | crc | changed 2025-10-13 19:28:08.516374 | 2025-10-13 19:28:08.516536 | TASK [deploy-crc-cloud : Generate user cert] 2025-10-13 19:28:08.961377 | crc | Certificate request self-signature ok 2025-10-13 19:28:08.975537 | crc | subject=O = ${GROUP}, CN = core 2025-10-13 19:28:09.084118 | crc | changed 2025-10-13 19:28:09.098939 | 2025-10-13 19:28:09.099154 | TASK [deploy-crc-cloud : Create configmap] 2025-10-13 19:28:09.645833 | crc | configmap/client-ca-custom created 2025-10-13 19:28:10.167778 | crc | changed 2025-10-13 19:28:10.184442 | 2025-10-13 19:28:10.184648 | TASK [deploy-crc-cloud : Patch apiserver] 2025-10-13 19:28:10.671521 | crc | apiserver.config.openshift.io/cluster patched 2025-10-13 19:28:10.759321 | crc | changed 2025-10-13 19:28:10.776046 | 2025-10-13 19:28:10.776301 | TASK [deploy-crc-cloud : Create configmap] 2025-10-13 19:28:11.307974 | crc | W1013 19:28:11.307795 14193 helpers.go:703] --dry-run is deprecated and can be replaced with --dry-run=client. 2025-10-13 19:28:11.344719 | crc | configmap/admin-kubeconfig-client-ca replaced 2025-10-13 19:28:11.388125 | crc | changed 2025-10-13 19:28:11.396100 | 2025-10-13 19:28:11.396177 | TASK [deploy-crc-cloud : Login to the OpenShift cluster] 2025-10-13 19:28:11.429561 | crc | ok 2025-10-13 19:28:11.443205 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/login.yaml 2025-10-13 19:28:11.480383 | 2025-10-13 19:28:11.480523 | TASK [deploy-crc-cloud : Try to login after all changes] 2025-10-13 19:28:11.928813 | crc | WARNING: Using insecure TLS client config. Setting this option is not supported! 2025-10-13 19:28:12.017023 | crc | 2025-10-13 19:28:12.017083 | crc | Login failed (401 Unauthorized) 2025-10-13 19:28:12.029559 | crc | Verify you have provided the correct credentials. 2025-10-13 19:28:43.810285 | crc | ok 2025-10-13 19:28:43.827415 | 2025-10-13 19:28:43.827555 | TASK [deploy-crc-cloud : Patch pull secret] 2025-10-13 19:28:43.869930 | crc | ok 2025-10-13 19:28:43.887260 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/patch_pull_secret.yaml 2025-10-13 19:28:43.926593 | 2025-10-13 19:28:43.926693 | TASK [deploy-crc-cloud : Patch pull secret] 2025-10-13 19:28:44.500430 | crc | Output suppressed because no_log was given 2025-10-13 19:28:44.515634 | 2025-10-13 19:28:44.515837 | TASK [deploy-crc-cloud : Wait for cluster become healthy after patching CA and pull secret] 2025-10-13 19:28:44.560564 | crc | ok 2025-10-13 19:28:44.578229 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/wait_cluster_become_healthy.yaml 2025-10-13 19:28:44.617781 | 2025-10-13 19:28:44.617935 | TASK [deploy-crc-cloud : Check if specified OpenShift components are healthy etcd|openshift-apiserver] 2025-10-13 19:28:45.147294 | crc | True 2025-10-13 19:28:45.148443 | crc | True 2025-10-13 19:28:45.199584 | crc | changed 2025-10-13 19:28:45.215945 | 2025-10-13 19:28:45.216205 | TASK [deploy-crc-cloud : Output success message if components are healthy] 2025-10-13 19:28:45.261920 | crc | ok: OpenShift cluster components have become healthy in approximately 20 * 15 seconds. 2025-10-13 19:28:45.279228 | 2025-10-13 19:28:45.279385 | TASK [deploy-crc-cloud : Fail if any components are still unhealthy] 2025-10-13 19:28:45.305861 | crc | skipping: Conditional result was False 2025-10-13 19:28:45.316778 | 2025-10-13 19:28:45.316879 | TASK [deploy-crc-cloud : Create certificate and patch secret] 2025-10-13 19:28:45.342523 | crc | skipping: Conditional result was False 2025-10-13 19:28:45.353621 | 2025-10-13 19:28:45.353713 | TASK [deploy-crc-cloud : Wait for cluster become healthy after adding domain] 2025-10-13 19:28:45.388410 | crc | ok 2025-10-13 19:28:45.402190 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/wait_cluster_become_healthy.yaml 2025-10-13 19:28:45.441921 | 2025-10-13 19:28:45.442078 | TASK [deploy-crc-cloud : Check if specified OpenShift components are healthy etcd|openshift-apiserver] 2025-10-13 19:28:45.941608 | crc | True 2025-10-13 19:28:45.942591 | crc | True 2025-10-13 19:28:45.994490 | crc | changed 2025-10-13 19:28:46.010246 | 2025-10-13 19:28:46.010398 | TASK [deploy-crc-cloud : Output success message if components are healthy] 2025-10-13 19:28:46.065861 | crc | ok: OpenShift cluster components have become healthy in approximately 20 * 15 seconds. 2025-10-13 19:28:46.081064 | 2025-10-13 19:28:46.081207 | TASK [deploy-crc-cloud : Fail if any components are still unhealthy] 2025-10-13 19:28:46.110514 | crc | skipping: Conditional result was False 2025-10-13 19:28:46.123890 | 2025-10-13 19:28:46.124001 | TASK [deploy-crc-cloud : Patch ingress config] 2025-10-13 19:28:46.151515 | crc | skipping: Conditional result was False 2025-10-13 19:28:46.163304 | 2025-10-13 19:28:46.163430 | TASK [deploy-crc-cloud : Patch api server] 2025-10-13 19:28:46.200712 | crc | skipping: Conditional result was False 2025-10-13 19:28:46.209367 | 2025-10-13 19:28:46.209469 | TASK [deploy-crc-cloud : Patch default route] 2025-10-13 19:28:46.246681 | crc | skipping: Conditional result was False 2025-10-13 19:28:46.265533 | 2025-10-13 19:28:46.265690 | TASK [deploy-crc-cloud : Wait for cluster become healthy after changing ingress api server and default route] 2025-10-13 19:28:46.306611 | crc | ok 2025-10-13 19:28:46.317797 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src/github.com/crc-org/crc-cloud/ansible/roles/deploy-crc-cloud/tasks/wait_cluster_become_healthy.yaml 2025-10-13 19:28:46.356875 | 2025-10-13 19:28:46.356973 | TASK [deploy-crc-cloud : Check if specified OpenShift components are healthy authentication|console|etcd|ingress|openshift-apiserver] 2025-10-13 19:28:46.911539 | crc | True 2025-10-13 19:28:46.912216 | crc | True 2025-10-13 19:28:46.912233 | crc | True 2025-10-13 19:28:46.912240 | crc | True 2025-10-13 19:28:46.912247 | crc | True 2025-10-13 19:28:46.965324 | crc | changed 2025-10-13 19:28:46.982110 | 2025-10-13 19:28:46.982351 | TASK [deploy-crc-cloud : Output success message if components are healthy] 2025-10-13 19:28:47.038130 | crc | ok: OpenShift cluster components have become healthy in approximately 20 * 15 seconds. 2025-10-13 19:28:47.056428 | 2025-10-13 19:28:47.056646 | TASK [deploy-crc-cloud : Fail if any components are still unhealthy] 2025-10-13 19:28:47.084383 | crc | skipping: Conditional result was False 2025-10-13 19:28:47.097968 | 2025-10-13 19:28:47.098349 | TASK [deploy-crc-cloud : Get console route] 2025-10-13 19:28:47.126236 | crc | skipping: Conditional result was False 2025-10-13 19:28:47.148375 | 2025-10-13 19:28:47.148556 | TASK [Start crc-cloud role when Zuul is not defined] 2025-10-13 19:28:47.197592 | crc | skipping: Conditional result was False 2025-10-13 19:28:47.218737 | 2025-10-13 19:28:47.218954 | TASK [prepare-crc-cloud : Recreate kubelet config.json] 2025-10-13 19:28:47.256961 | crc | ok 2025-10-13 19:28:47.272840 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/inject-pull-secret.yaml 2025-10-13 19:28:47.303649 | 2025-10-13 19:28:47.303817 | TASK [prepare-crc-cloud : Fail when openshift_pull_sec not provided] 2025-10-13 19:28:47.360663 | crc | skipping: Conditional result was False 2025-10-13 19:28:47.377611 | 2025-10-13 19:28:47.377787 | TASK [prepare-crc-cloud : Cleanup file] 2025-10-13 19:28:47.935273 | crc | Output suppressed because no_log was given 2025-10-13 19:28:47.952329 | 2025-10-13 19:28:47.952494 | TASK [prepare-crc-cloud : Copy pull-secret to kubelet config.json] 2025-10-13 19:28:48.283073 | crc | Output suppressed because no_log was given 2025-10-13 19:28:48.298528 | 2025-10-13 19:28:48.298662 | TASK [prepare-crc-cloud : Replace singleqoute with doublequote] 2025-10-13 19:28:48.772690 | crc | changed: 42 replacements made 2025-10-13 19:28:48.789457 | 2025-10-13 19:28:48.789666 | TASK [prepare-crc-cloud : Remove spaces] 2025-10-13 19:28:49.154112 | crc | changed: 20 replacements made 2025-10-13 19:28:49.170157 | 2025-10-13 19:28:49.170306 | TASK [prepare-crc-cloud : Ensure you are logged in to the OpenShift] 2025-10-13 19:28:49.219360 | crc | ok 2025-10-13 19:28:49.236894 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/openshift_login.yaml 2025-10-13 19:28:49.268289 | 2025-10-13 19:28:49.268398 | TASK [prepare-crc-cloud : Login to the OpenShift] 2025-10-13 19:28:49.746324 | crc | WARNING: Using insecure TLS client config. Setting this option is not supported! 2025-10-13 19:28:49.876348 | crc | 2025-10-13 19:28:49.876408 | crc | Login successful. 2025-10-13 19:28:49.894209 | crc | 2025-10-13 19:28:49.894261 | crc | You have access to 65 projects, the list has been suppressed. You can list all projects with 'oc projects' 2025-10-13 19:28:49.929650 | crc | 2025-10-13 19:28:49.929698 | crc | Using project "default". 2025-10-13 19:28:50.313940 | crc | ok 2025-10-13 19:28:50.329895 | 2025-10-13 19:28:50.330054 | TASK [prepare-crc-cloud : Post tasks after crc-cloud script execution] 2025-10-13 19:28:50.374044 | crc | ok 2025-10-13 19:28:50.441372 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/post.yaml 2025-10-13 19:28:50.464208 | 2025-10-13 19:28:50.464332 | LOOP [prepare-crc-cloud : Set DNS nameservers provided by cloud provider] 2025-10-13 19:28:50.805612 | crc | changed: line added 2025-10-13 19:28:50.806101 | crc | changed: All items complete 2025-10-13 19:28:50.806170 | 2025-10-13 19:28:51.132379 | crc | changed: line added 2025-10-13 19:28:51.155435 | 2025-10-13 19:28:51.155639 | TASK [prepare-crc-cloud : Increase dnsmasq cache size] 2025-10-13 19:28:51.487315 | crc | changed: line added 2025-10-13 19:28:51.504044 | 2025-10-13 19:28:51.504229 | TASK [prepare-crc-cloud : Reload NetworkManager after adding cache and DNS server] 2025-10-13 19:28:52.434519 | crc | changed 2025-10-13 19:28:52.460800 | 2025-10-13 19:28:52.460989 | TASK [prepare-crc-cloud : Ensure kube config does not exists] 2025-10-13 19:28:52.785274 | crc | ok 2025-10-13 19:28:52.795316 | 2025-10-13 19:28:52.795404 | TASK [prepare-crc-cloud : Copy new generated KUBECONFIG] 2025-10-13 19:28:52.821466 | crc | skipping: Conditional result was False 2025-10-13 19:28:52.832617 | 2025-10-13 19:28:52.832713 | TASK [prepare-crc-cloud : Delete all openshift-marketplace pods] 2025-10-13 19:28:53.343182 | crc | pod "certified-operators-8nn6k" deleted 2025-10-13 19:28:53.349962 | crc | pod "community-operators-kqkhb" deleted 2025-10-13 19:28:53.365700 | crc | pod "marketplace-operator-79b997595-zggfl" deleted 2025-10-13 19:28:53.378700 | crc | pod "redhat-marketplace-hvxkp" deleted 2025-10-13 19:28:53.396490 | crc | pod "redhat-operators-d4vnz" deleted 2025-10-13 19:28:55.417476 | crc | ok 2025-10-13 19:28:55.433470 | 2025-10-13 19:28:55.433648 | TASK [prepare-crc-cloud : Pause machineconfigpool] 2025-10-13 19:28:55.476454 | crc | ok 2025-10-13 19:28:55.494410 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/trusted/project_0/review.rdoproject.org/config/roles/prepare-crc-cloud/tasks/pause_mcp.yaml 2025-10-13 19:28:55.531082 | 2025-10-13 19:28:55.531183 | LOOP [prepare-crc-cloud : Pause the machineconfig configuration if mcp is not needed] 2025-10-13 19:28:56.107230 | crc | ok 2025-10-13 19:28:56.545818 | crc | ok 2025-10-13 19:28:56.570015 | 2025-10-13 19:28:56.570238 | TASK [prepare-crc-cloud : Print current machineconfigpool] 2025-10-13 19:28:57.071202 | crc | NAME CONFIG UPDATED UPDATING DEGRADED MACHINECOUNT READYMACHINECOUNT UPDATEDMACHINECOUNT DEGRADEDMACHINECOUNT AGE 2025-10-13 19:28:57.071314 | crc | master rendered-master-f83a149c7490c3b0bf850df839837383 False True True 1 0 0 1 232d 2025-10-13 19:28:57.076666 | crc | worker rendered-worker-594cc07c9feefb5e37f2530ac457d36c True False False 0 0 0 0 232d 2025-10-13 19:28:57.136440 | crc | ok 2025-10-13 19:28:57.146697 | 2025-10-13 19:28:57.146846 | TASK [prepare-crc-cloud : Set low profile to etcd to avoid flakiness] 2025-10-13 19:28:57.173810 | crc | skipping: Conditional result was False 2025-10-13 19:28:57.192303 | 2025-10-13 19:28:57.192477 | TASK [prepare-crc-cloud : Fix machineconfigpool degradation] 2025-10-13 19:28:57.218816 | crc | skipping: Conditional result was False 2025-10-13 19:28:57.231114 | 2025-10-13 19:28:57.231241 | TASK [prepare-crc-cloud : Remove drain machineconfig for the node] 2025-10-13 19:28:57.258099 | crc | skipping: Conditional result was False 2025-10-13 19:28:57.269642 | 2025-10-13 19:28:57.269777 | TASK [prepare-crc-cloud : Post machineconfigpool tasks] 2025-10-13 19:28:57.296332 | crc | skipping: Conditional result was False 2025-10-13 19:28:57.355676 | 2025-10-13 19:28:57.355832 | TASK [prepare-crc-cloud : Enable monitoring and cluster-monitoring-operator] 2025-10-13 19:28:57.380935 | crc | skipping: Conditional result was False 2025-10-13 19:28:57.395335 | 2025-10-13 19:28:57.395434 | TASK [Run crc-extracted preparation] 2025-10-13 19:28:57.420427 | crc | skipping: Conditional result was False 2025-10-13 19:28:57.428287 | 2025-10-13 19:28:57.428366 | TASK [Fail when image build date does not exists] 2025-10-13 19:28:57.453329 | crc | skipping: Conditional result was False 2025-10-13 19:28:57.482232 | 2025-10-13 19:28:57.482342 | PLAY [Set IOPS and Read/Write disk limitation] 2025-10-13 19:28:57.511078 | 2025-10-13 19:28:57.511193 | TASK [Set limit for disk usage - IOPS and Read/Write] 2025-10-13 19:28:57.580935 | crc | ok 2025-10-13 19:28:57.586093 | controller | ok 2025-10-13 19:28:57.614820 | 2025-10-13 19:28:57.614934 | TASK [disk-usage-limitation : Get block device major:minor] 2025-10-13 19:28:58.063448 | crc | 252:0 2025-10-13 19:28:58.093335 | controller | 252:0 2025-10-13 19:28:58.190472 | crc | ok 2025-10-13 19:28:58.204818 | controller | ok 2025-10-13 19:28:58.218062 | 2025-10-13 19:28:58.218252 | LOOP [disk-usage-limitation : Ensure that some cgroup dirs exists] 2025-10-13 19:28:58.480325 | controller | ok: "/sys/fs/cgroup/init.scope" 2025-10-13 19:28:58.481822 | controller | ok: All items complete 2025-10-13 19:28:58.481935 | 2025-10-13 19:28:58.697955 | crc | ok: "/sys/fs/cgroup/init.scope" 2025-10-13 19:28:58.711689 | controller | changed: "/sys/fs/cgroup/machine.slice" 2025-10-13 19:28:58.927419 | controller | ok: "/sys/fs/cgroup/system.slice" 2025-10-13 19:28:59.065715 | crc | ok: "/sys/fs/cgroup/machine.slice" 2025-10-13 19:28:59.151118 | controller | ok: "/sys/fs/cgroup/user.slice" 2025-10-13 19:28:59.329083 | crc | ok: "/sys/fs/cgroup/system.slice" 2025-10-13 19:28:59.585008 | crc | ok: "/sys/fs/cgroup/user.slice" 2025-10-13 19:28:59.612017 | 2025-10-13 19:28:59.612226 | TASK [disk-usage-limitation : Enable IO limit] 2025-10-13 19:28:59.896078 | controller | changed: line replaced 2025-10-13 19:28:59.994808 | crc | changed: line replaced 2025-10-13 19:29:00.008277 | 2025-10-13 19:29:00.008408 | TASK [disk-usage-limitation : Flush handlers that will call systemd daemon-reload] 2025-10-13 19:29:00.076396 | 2025-10-13 19:29:00.076523 | TASK [disk-usage-limitation : Flush handlers that will call systemd daemon-reload] 2025-10-13 19:29:00.088603 | 2025-10-13 19:29:00.088668 | TASK [disk-usage-limitation : Reload systemd daemon after enabling IOAccounting] 2025-10-13 19:29:01.003859 | controller | ok 2025-10-13 19:29:02.121234 | crc | ok 2025-10-13 19:29:02.129279 | 2025-10-13 19:29:02.129385 | TASK [disk-usage-limitation : Wait for system.slice cgroup to have io.max file] 2025-10-13 19:29:02.403121 | controller | ok 2025-10-13 19:29:02.486039 | crc | ok 2025-10-13 19:29:02.494813 | 2025-10-13 19:29:02.494968 | LOOP [disk-usage-limitation : Set IOPS limit in the root cgroup] 2025-10-13 19:29:02.792120 | controller | ok 2025-10-13 19:29:02.792402 | controller | ok: All items complete 2025-10-13 19:29:02.792429 | 2025-10-13 19:29:02.894918 | crc | ok 2025-10-13 19:29:03.021927 | controller | ok 2025-10-13 19:29:03.189494 | crc | ok 2025-10-13 19:29:03.246052 | controller | ok 2025-10-13 19:29:03.464596 | controller | ok 2025-10-13 19:29:03.479379 | crc | ok 2025-10-13 19:29:03.780425 | crc | ok 2025-10-13 19:29:03.805709 | 2025-10-13 19:29:03.805917 | TASK [disk-usage-limitation : Verify the IOPS limit] 2025-10-13 19:29:04.208657 | crc | init 2025-10-13 19:29:04.210249 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.210471 | crc | machine 2025-10-13 19:29:04.211654 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.211849 | crc | system 2025-10-13 19:29:04.213078 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.213254 | crc | user 2025-10-13 19:29:04.214142 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.124832 | controller | init 2025-10-13 19:29:04.125267 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.125280 | controller | machine 2025-10-13 19:29:04.125287 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.125293 | controller | system 2025-10-13 19:29:04.125302 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.129430 | controller | user 2025-10-13 19:29:04.129448 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:04.403007 | controller | ok 2025-10-13 19:29:04.418553 | crc | ok 2025-10-13 19:29:04.432036 | 2025-10-13 19:29:04.432257 | TASK [disk-usage-limitation : Check if kubepods.slice exists] 2025-10-13 19:29:04.725769 | controller | ok 2025-10-13 19:29:04.763854 | crc | ok 2025-10-13 19:29:04.777838 | 2025-10-13 19:29:04.778035 | TASK [disk-usage-limitation : Set the limit] 2025-10-13 19:29:05.392249 | controller | skipping: Conditional result was False 2025-10-13 19:29:05.407924 | crc | ok 2025-10-13 19:29:05.422232 | 2025-10-13 19:29:05.422379 | TASK [disk-usage-limitation : Verify the IOPS limit - kubepods slice] 2025-10-13 19:29:05.830908 | crc | kubepods 2025-10-13 19:29:05.831860 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.020658 | controller | skipping: Conditional result was False 2025-10-13 19:29:06.038571 | crc | ok 2025-10-13 19:29:06.053101 | 2025-10-13 19:29:06.053312 | TASK [disk-usage-limitation : Print the current io.max value] 2025-10-13 19:29:06.135853 | controller | ok: 2025-10-13 19:29:06.136113 | controller | init 2025-10-13 19:29:06.136151 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.136180 | controller | machine 2025-10-13 19:29:06.136208 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.136233 | controller | system 2025-10-13 19:29:06.136258 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.136282 | controller | user 2025-10-13 19:29:06.136307 | controller | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.145238 | crc | ok: 2025-10-13 19:29:06.145302 | crc | init 2025-10-13 19:29:06.145334 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.145362 | crc | machine 2025-10-13 19:29:06.145387 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.145411 | crc | system 2025-10-13 19:29:06.145434 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.145457 | crc | user 2025-10-13 19:29:06.145479 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 kubepods 2025-10-13 19:29:06.145501 | crc | 252:0 rbps=262144000 wbps=262144000 riops=18000 wiops=18000 2025-10-13 19:29:06.214241 | 2025-10-13 19:29:06.214371 | PLAY RECAP 2025-10-13 19:29:06.214416 | controller | ok: 9 changed: 2 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2025-10-13 19:29:06.214442 | crc | ok: 104 changed: 43 unreachable: 0 failed: 0 skipped: 27 rescued: 0 ignored: 0 2025-10-13 19:29:06.214466 | 2025-10-13 19:29:06.343427 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/crc/prepare-crc.yaml@master] 2025-10-13 19:29:06.347001 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/crc/podman.yaml@master] 2025-10-13 19:29:06.919709 | 2025-10-13 19:29:06.919912 | PLAY [all,!compute] 2025-10-13 19:29:06.954593 | 2025-10-13 19:29:06.954694 | TASK [Enable container-tools rhel-modules for c8/crc node] 2025-10-13 19:29:07.522311 | controller | skipping: Conditional result was False 2025-10-13 19:29:07.523366 | crc | skipping: Conditional result was False 2025-10-13 19:29:07.537222 | 2025-10-13 19:29:07.537403 | TASK [Install podman] 2025-10-13 19:29:07.640954 | crc | skipping: Conditional result was False 2025-10-13 19:30:13.109932 | controller | changed 2025-10-13 19:30:13.124427 | 2025-10-13 19:30:13.124617 | TASK [Set var name for quay login zuul secret] 2025-10-13 19:30:13.202119 | controller | skipping: Conditional result was False 2025-10-13 19:30:13.213177 | crc | skipping: Conditional result was False 2025-10-13 19:30:13.222574 | 2025-10-13 19:30:13.222745 | TASK [Print the username] 2025-10-13 19:30:13.652085 | controller | openstack-k8s-operators+cirobot 2025-10-13 19:30:13.801486 | crc | skipping: Conditional result was False 2025-10-13 19:30:13.817224 | controller | ok: Runtime: 0:00:00.005504 2025-10-13 19:30:13.830438 | 2025-10-13 19:30:13.830591 | TASK [Fail when user or password is not set] 2025-10-13 19:30:13.889330 | controller | skipping: Conditional result was False 2025-10-13 19:30:13.930874 | crc | skipping: Conditional result was False 2025-10-13 19:30:13.940095 | 2025-10-13 19:30:13.940217 | TASK [Set vars for quay login] 2025-10-13 19:30:14.081998 | controller | Output suppressed because no_log was given 2025-10-13 19:30:14.089596 | 2025-10-13 19:30:14.089681 | LOOP [Perform container registry login(s) with podman] 2025-10-13 19:30:14.940345 | controller | Output suppressed because no_log was given 2025-10-13 19:30:14.949362 | 2025-10-13 19:30:14.949455 | LOOP [Perform container registry login(s) with buildah] 2025-10-13 19:30:15.015500 | controller | Output suppressed because no_log was given 2025-10-13 19:30:15.015806 | 2025-10-13 19:30:15.040834 | 2025-10-13 19:30:15.040961 | TASK [Set Insecure registry for content provider] 2025-10-13 19:30:15.104262 | controller | skipping: Conditional result was False 2025-10-13 19:30:15.115293 | crc | skipping: Conditional result was False 2025-10-13 19:30:15.160539 | 2025-10-13 19:30:15.160634 | PLAY RECAP 2025-10-13 19:30:15.160677 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 5 rescued: 0 ignored: 0 2025-10-13 19:30:15.160702 | crc | ok: 0 changed: 0 unreachable: 0 failed: 0 skipped: 9 rescued: 0 ignored: 0 2025-10-13 19:30:15.160719 | 2025-10-13 19:30:15.264996 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/crc/podman.yaml@master] 2025-10-13 19:30:15.268604 | PRE-RUN START: [trusted : review.rdoproject.org/config/playbooks/data_plane_adoption/dpa_RH_subscription_registry_login.yaml@master] 2025-10-13 19:30:15.876994 | 2025-10-13 19:30:15.877164 | PLAY [rh-subscription] 2025-10-13 19:30:15.877257 | 2025-10-13 19:30:15.877291 | PLAY RECAP 2025-10-13 19:30:15.877318 | 2025-10-13 19:30:15.969481 | PRE-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/data_plane_adoption/dpa_RH_subscription_registry_login.yaml@master] 2025-10-13 19:30:15.976683 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-customizations.yml@main] 2025-10-13 19:30:16.625328 | 2025-10-13 19:30:16.625454 | PLAY [Tweak CRC node] 2025-10-13 19:30:16.652600 | 2025-10-13 19:30:16.652769 | TASK [Load network parameters] 2025-10-13 19:30:17.310551 | crc | ok 2025-10-13 19:30:17.333463 | 2025-10-13 19:30:17.333866 | TASK [Check which dnsmasq config we must edit] 2025-10-13 19:30:17.758265 | crc | ok 2025-10-13 19:30:17.772243 | 2025-10-13 19:30:17.772346 | TASK [Ensure crc knows about its second NIC] 2025-10-13 19:30:18.656009 | crc | changed 2025-10-13 19:30:18.708382 | 2025-10-13 19:30:18.708547 | TASK [Ensure crc does not get "public" DNS] 2025-10-13 19:30:19.629643 | crc | changed 2025-10-13 19:30:19.637011 | 2025-10-13 19:30:19.637109 | TASK [Restart NetworkManager] 2025-10-13 19:30:20.832350 | crc | changed 2025-10-13 19:30:20.841150 | 2025-10-13 19:30:20.841220 | LOOP [Configure dns forwarders] 2025-10-13 19:30:21.273403 | crc | ok 2025-10-13 19:30:21.557710 | crc | ok 2025-10-13 19:30:21.566973 | 2025-10-13 19:30:21.567098 | TASK [Configure local DNS for CRC pod] 2025-10-13 19:30:22.016446 | crc | ok 2025-10-13 19:30:22.023230 | 2025-10-13 19:30:22.023300 | TASK [Configure dnsmasq listen-address to listen on both br-ex and ci-private-network] 2025-10-13 19:30:22.426176 | crc | changed: line added 2025-10-13 19:30:22.440157 | 2025-10-13 19:30:22.440305 | TASK [Restart native dnsmasq service] 2025-10-13 19:30:23.020324 | crc | changed 2025-10-13 19:30:23.028920 | 2025-10-13 19:30:23.028989 | TASK [Stop dnsmasq] 2025-10-13 19:30:23.053277 | crc | skipping: Conditional result was False 2025-10-13 19:30:23.064794 | 2025-10-13 19:30:23.064893 | TASK [Make sure that crc-dnsmasq is not running] 2025-10-13 19:30:23.090651 | crc | skipping: Conditional result was False 2025-10-13 19:30:23.108232 | 2025-10-13 19:30:23.108531 | TASK [Start dnsmasq] 2025-10-13 19:30:23.135284 | crc | skipping: Conditional result was False 2025-10-13 19:30:23.147882 | 2025-10-13 19:30:23.148004 | TASK [Wait for CRC to be ready] 2025-10-13 19:30:23.797029 | crc | WARNING: Using insecure TLS client config. Setting this option is not supported! 2025-10-13 19:30:23.982064 | crc | 2025-10-13 19:30:23.982870 | crc | Login successful. 2025-10-13 19:30:24.013255 | crc | 2025-10-13 19:30:24.013330 | crc | You have access to 65 projects, the list has been suppressed. You can list all projects with 'oc projects' 2025-10-13 19:30:24.036287 | crc | 2025-10-13 19:30:24.036374 | crc | Using project "default". 2025-10-13 19:30:24.201020 | crc | changed 2025-10-13 19:30:24.212163 | 2025-10-13 19:30:24.212280 | TASK [Set insecure registry on crc node] 2025-10-13 19:30:24.236406 | crc | skipping: Conditional result was False 2025-10-13 19:30:24.300577 | 2025-10-13 19:30:24.300686 | PLAY [Tweak Controller] 2025-10-13 19:30:24.320575 | 2025-10-13 19:30:24.320697 | TASK [Install other packages] 2025-10-13 19:30:29.054951 | controller | changed 2025-10-13 19:30:29.064064 | 2025-10-13 19:30:29.064157 | LOOP [Ensure we know compute host keys] 2025-10-13 19:30:29.617831 | controller | changed 2025-10-13 19:30:29.618034 | controller | ok: All items complete 2025-10-13 19:30:29.618071 | 2025-10-13 19:30:29.870842 | controller | changed 2025-10-13 19:30:29.886379 | 2025-10-13 19:30:29.886578 | TASK [Generate an ssh keypair] 2025-10-13 19:30:30.206143 | controller | Generating public/private ecdsa key pair. 2025-10-13 19:30:30.206191 | controller | Your identification has been saved in /home/zuul/.ssh/id_cifw 2025-10-13 19:30:30.206203 | controller | Your public key has been saved in /home/zuul/.ssh/id_cifw.pub 2025-10-13 19:30:30.206214 | controller | The key fingerprint is: 2025-10-13 19:30:30.206225 | controller | SHA256:CZpDFtMAehDjkgAaJ/wvJiJyppo2YEcibkm2WyuF0+w zuul@np0005486072.novalocal 2025-10-13 19:30:30.206235 | controller | The key's randomart image is: 2025-10-13 19:30:30.206284 | controller | +---[ECDSA 256]---+ 2025-10-13 19:30:30.206293 | controller | |@.o.+o | 2025-10-13 19:30:30.206299 | controller | |+X o. | 2025-10-13 19:30:30.206305 | controller | |=.o o . | 2025-10-13 19:30:30.206311 | controller | |o= = o . . | 2025-10-13 19:30:30.206317 | controller | |= O = S | 2025-10-13 19:30:30.206322 | controller | |=XoO o | 2025-10-13 19:30:30.206328 | controller | |B+X o | 2025-10-13 19:30:30.206334 | controller | |.* E | 2025-10-13 19:30:30.206340 | controller | |= o | 2025-10-13 19:30:30.206346 | controller | +----[SHA256]-----+ 2025-10-13 19:30:30.442993 | controller | changed 2025-10-13 19:30:30.449516 | 2025-10-13 19:30:30.449617 | TASK [Get public key] 2025-10-13 19:30:30.758467 | controller | ok 2025-10-13 19:30:30.769265 | 2025-10-13 19:30:30.769389 | TASK [Register pub key as a fact] 2025-10-13 19:30:30.811366 | controller | ok 2025-10-13 19:30:30.822304 | 2025-10-13 19:30:30.822435 | TASK [Load network parameters] 2025-10-13 19:30:31.080962 | controller | ok 2025-10-13 19:30:31.086796 | 2025-10-13 19:30:31.086909 | TASK [Check if cloud-init is overriding NM settings] 2025-10-13 19:30:31.438258 | controller | ok 2025-10-13 19:30:31.445018 | 2025-10-13 19:30:31.445124 | TASK [Remove cloud-init DNS override if present] 2025-10-13 19:30:31.460833 | controller | skipping: Conditional result was False 2025-10-13 19:30:31.468573 | 2025-10-13 19:30:31.468717 | TASK [Reload the NetworkManager to pick the changes] 2025-10-13 19:30:31.496920 | controller | skipping: Conditional result was False 2025-10-13 19:30:31.503745 | 2025-10-13 19:30:31.503852 | TASK [Get the default iface connection] 2025-10-13 19:30:31.905743 | controller | System eth0 2025-10-13 19:30:32.048800 | controller | changed 2025-10-13 19:30:32.061372 | 2025-10-13 19:30:32.061494 | TASK [Prepend CRC DNS server in the controllers default Network Manager connection configuation] 2025-10-13 19:30:32.656590 | controller | Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/5) 2025-10-13 19:30:33.116156 | controller | changed 2025-10-13 19:30:33.141460 | 2025-10-13 19:30:33.141570 | PLAY [Ensure persistent SSH access] 2025-10-13 19:30:33.169605 | 2025-10-13 19:30:33.169695 | TASK [Inject key in ansible_user] 2025-10-13 19:30:33.787805 | crc | changed 2025-10-13 19:30:33.875861 | controller | changed 2025-10-13 19:30:33.891358 | 2025-10-13 19:30:33.891466 | TASK [Inject key in root] 2025-10-13 19:30:34.372575 | crc | changed 2025-10-13 19:30:34.468309 | controller | changed 2025-10-13 19:30:34.576485 | 2025-10-13 19:30:34.576580 | PLAY [Add cloud-admin user on Compute] 2025-10-13 19:30:34.577428 | 2025-10-13 19:30:34.577473 | PLAY [Set some fancy hostname] 2025-10-13 19:30:34.593779 | 2025-10-13 19:30:34.593868 | TASK [Inject hostname in configuration file] 2025-10-13 19:30:35.617005 | controller | changed 2025-10-13 19:30:35.637949 | 2025-10-13 19:30:35.638037 | PLAY RECAP 2025-10-13 19:30:35.638082 | controller | ok: 12 changed: 8 unreachable: 0 failed: 0 skipped: 2 rescued: 0 ignored: 0 2025-10-13 19:30:35.638108 | crc | ok: 12 changed: 8 unreachable: 0 failed: 0 skipped: 4 rescued: 0 ignored: 0 2025-10-13 19:30:35.638126 | 2025-10-13 19:30:35.743501 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-customizations.yml@main] 2025-10-13 19:30:35.751291 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/e2e-prepare.yml@main] 2025-10-13 19:30:36.378629 | 2025-10-13 19:30:36.378791 | PLAY [Get all repos on all hosts] 2025-10-13 19:30:36.414457 | 2025-10-13 19:30:36.414568 | TASK [Clone repos in the job workspace] 2025-10-13 19:30:36.441271 | controller | ok 2025-10-13 19:30:36.457834 | crc | ok 2025-10-13 19:30:36.480716 | 2025-10-13 19:30:36.480865 | TASK [prepare-workspace : Start zuul_console daemon.] 2025-10-13 19:30:37.142266 | crc | ok 2025-10-13 19:30:37.194601 | controller | ok 2025-10-13 19:30:37.201232 | 2025-10-13 19:30:37.201323 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2025-10-13 19:30:45.691037 | crc | Output suppressed because no_log was given 2025-10-13 19:30:46.869009 | controller | Output suppressed because no_log was given 2025-10-13 19:30:46.935557 | 2025-10-13 19:30:46.935647 | PLAY [Run ci/playbooks/e2e-prepare.yml] 2025-10-13 19:30:46.953043 | 2025-10-13 19:30:46.953181 | TASK [Read group_vars] 2025-10-13 19:30:46.984981 | controller | ok 2025-10-13 19:30:47.004771 | 2025-10-13 19:30:47.004889 | TASK [cifmw_helpers : Check directory is available] 2025-10-13 19:30:47.504486 | controller | ok 2025-10-13 19:30:47.522749 | 2025-10-13 19:30:47.522936 | TASK [cifmw_helpers : Find yaml files] 2025-10-13 19:30:48.018290 | controller | ok: All paths examined 2025-10-13 19:30:48.030317 | 2025-10-13 19:30:48.030444 | TASK [cifmw_helpers : Print available yaml files] 2025-10-13 19:30:48.119989 | controller | ok: Found yaml files to parse: ['/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/group_vars/all.yml'] 2025-10-13 19:30:48.133417 | 2025-10-13 19:30:48.133588 | LOOP [cifmw_helpers : Create files on localhost and use include_vars] 2025-10-13 19:30:48.172325 | controller | Output suppressed because no_log was given 2025-10-13 19:30:48.190178 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/include_file.yml 2025-10-13 19:30:48.212480 | 2025-10-13 19:30:48.212639 | TASK [cifmw_helpers : Fail if file is not yaml or yml extension] 2025-10-13 19:30:48.280235 | controller | skipping: Conditional result was False 2025-10-13 19:30:48.290820 | 2025-10-13 19:30:48.290973 | TASK [cifmw_helpers : Check if file is available] 2025-10-13 19:30:48.633430 | controller | ok 2025-10-13 19:30:48.641309 | 2025-10-13 19:30:48.641427 | TASK [cifmw_helpers : Create temporary directory] 2025-10-13 19:30:49.036434 | controller -> localhost | changed 2025-10-13 19:30:49.043689 | 2025-10-13 19:30:49.043829 | TASK [cifmw_helpers : Read vars] 2025-10-13 19:30:49.465820 | controller | ok 2025-10-13 19:30:49.476312 | 2025-10-13 19:30:49.476519 | TASK [cifmw_helpers : Create new variable files with content] 2025-10-13 19:30:50.107422 | controller -> localhost | changed 2025-10-13 19:30:50.114756 | 2025-10-13 19:30:50.114841 | TASK [cifmw_helpers : Include vars] 2025-10-13 19:30:50.167044 | controller -> localhost | ok 2025-10-13 19:30:50.179469 | 2025-10-13 19:30:50.179549 | TASK [Read group_vars] 2025-10-13 19:30:50.199922 | controller | ok 2025-10-13 19:30:50.222055 | 2025-10-13 19:30:50.222159 | TASK [cifmw_helpers : Check directory is available] 2025-10-13 19:30:50.503903 | controller | ok 2025-10-13 19:30:50.517367 | 2025-10-13 19:30:50.517517 | TASK [cifmw_helpers : Find yaml files] 2025-10-13 19:30:50.797951 | controller | ok: All paths examined 2025-10-13 19:30:50.848057 | 2025-10-13 19:30:50.848234 | TASK [cifmw_helpers : Print available yaml files] 2025-10-13 19:30:50.941526 | controller | ok: Found yaml files to parse: ['/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/group_vars/all.yml'] 2025-10-13 19:30:50.955379 | 2025-10-13 19:30:50.955530 | LOOP [cifmw_helpers : Create files on localhost and use include_vars] 2025-10-13 19:30:51.005528 | controller | Output suppressed because no_log was given 2025-10-13 19:30:51.006054 | controller | Output suppressed because no_log was given 2025-10-13 19:30:51.006121 | 2025-10-13 19:30:51.038431 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/include_file.yml 2025-10-13 19:30:51.054911 | 2025-10-13 19:30:51.055022 | TASK [cifmw_helpers : Fail if file is not yaml or yml extension] 2025-10-13 19:30:51.122221 | controller | skipping: Conditional result was False 2025-10-13 19:30:51.131868 | 2025-10-13 19:30:51.131995 | TASK [cifmw_helpers : Check if file is available] 2025-10-13 19:30:51.426147 | controller | ok 2025-10-13 19:30:51.444024 | 2025-10-13 19:30:51.444224 | TASK [cifmw_helpers : Create temporary directory] 2025-10-13 19:30:51.738770 | controller -> localhost | changed 2025-10-13 19:30:51.754414 | 2025-10-13 19:30:51.754570 | TASK [cifmw_helpers : Read vars] 2025-10-13 19:30:52.040547 | controller | ok 2025-10-13 19:30:52.053135 | 2025-10-13 19:30:52.053271 | TASK [cifmw_helpers : Create new variable files with content] 2025-10-13 19:30:52.573061 | controller -> localhost | changed 2025-10-13 19:30:52.580246 | 2025-10-13 19:30:52.580374 | TASK [cifmw_helpers : Include vars] 2025-10-13 19:30:52.636267 | controller -> localhost | ok 2025-10-13 19:30:52.649214 | 2025-10-13 19:30:52.649279 | TASK [Create zuul-output directory] 2025-10-13 19:30:53.045250 | controller | ok 2025-10-13 19:30:53.060786 | 2025-10-13 19:30:53.060943 | TASK [Install required packages] 2025-10-13 19:30:54.154268 | controller | ok: Nothing to do 2025-10-13 19:30:54.168340 | 2025-10-13 19:30:54.168471 | TASK [Output pip related things] 2025-10-13 19:30:54.844682 | controller | pip 21.3.1 from /usr/lib/python3.9/site-packages/pip (python 3.9) 2025-10-13 19:30:55.225783 | controller | changed 2025-10-13 19:30:55.239111 | 2025-10-13 19:30:55.239259 | TASK [Install requirements] 2025-10-13 19:31:58.627845 | controller | changed 2025-10-13 19:31:58.647744 | 2025-10-13 19:31:58.647893 | TASK [Add cronjob to trigger job stats] 2025-10-13 19:31:58.797869 | controller | skipping: Conditional result was False 2025-10-13 19:31:58.845955 | 2025-10-13 19:31:58.846084 | LOOP [Construct project change list] 2025-10-13 19:31:58.944688 | controller | ok: 2025-10-13 19:31:58.945471 | controller | { 2025-10-13 19:31:58.945575 | controller | "branch": "main", 2025-10-13 19:31:58.945626 | controller | "change": "3404", 2025-10-13 19:31:58.945667 | controller | "change_message": "Add loop_var in cifmw_helpers task files; trim vars in helper; improve finding files in var_dir\n\nTo avoid unecessary conflicts issue where \"item\" was already used in higher task, let's add loop_var to have better control on the vars what are parsed.\r\n\r\nAlso trim variables in var_dir and var_file and improve finding files\r\nto parse in var_dir helper.", 2025-10-13 19:31:58.945717 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3404", 2025-10-13 19:31:58.945825 | controller | "commit_id": "9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8", 2025-10-13 19:31:58.945869 | controller | "patchset": "9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8", 2025-10-13 19:31:58.945906 | controller | "project": { 2025-10-13 19:31:58.945943 | controller | "canonical_hostname": "github.com", 2025-10-13 19:31:58.945981 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 19:31:58.946017 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 19:31:58.946056 | controller | "short_name": "ci-framework", 2025-10-13 19:31:58.946092 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 19:31:58.946128 | controller | }, 2025-10-13 19:31:58.946165 | controller | "topic": null 2025-10-13 19:31:58.946201 | controller | } 2025-10-13 19:31:58.964414 | controller | ok: 2025-10-13 19:31:58.964559 | controller | { 2025-10-13 19:31:58.964629 | controller | "branch": "main", 2025-10-13 19:31:58.964672 | controller | "change": "3406", 2025-10-13 19:31:58.964714 | controller | "change_message": "Add include_file and include_dir helpers\n\nThe future group_vars directory, might not contain \"clear\" variables in the yaml file - instead of each variable has own type like string, integer, bool etc. it would be jinja2 variable, which is not \"translated\" in Ansible during setting facts.\r\n\r\nThis helper would be useful for parsing group_vars variables, that might be based on jinja2 vars.", 2025-10-13 19:31:58.964851 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3406", 2025-10-13 19:31:58.964902 | controller | "commit_id": "3b7e5d87cb08f8ceea89c6e58502f20dfffec667", 2025-10-13 19:31:58.964950 | controller | "patchset": "3b7e5d87cb08f8ceea89c6e58502f20dfffec667", 2025-10-13 19:31:58.964989 | controller | "project": { 2025-10-13 19:31:58.965050 | controller | "canonical_hostname": "github.com", 2025-10-13 19:31:58.965090 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 19:31:58.965127 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 19:31:58.965163 | controller | "short_name": "ci-framework", 2025-10-13 19:31:58.965198 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 19:31:58.965233 | controller | }, 2025-10-13 19:31:58.965269 | controller | "topic": null 2025-10-13 19:31:58.965304 | controller | } 2025-10-13 19:31:58.977673 | controller | ok: 2025-10-13 19:31:58.977784 | controller | { 2025-10-13 19:31:58.977834 | controller | "branch": "main", 2025-10-13 19:31:58.977863 | controller | "change": "3402", 2025-10-13 19:31:58.977886 | controller | "change_message": "Check global vars\n\nChecking Amartya change https://github.com/openstack-k8s-operators/ci-framework/pull/3237\r\n\r\nDepends-On: https://github.com/openstack-k8s-operators/ci-framework/pull/3404\r\nDepends-On: https://github.com/openstack-k8s-operators/ci-framework/pull/3406", 2025-10-13 19:31:58.977911 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3402", 2025-10-13 19:31:58.977934 | controller | "commit_id": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 19:31:58.977957 | controller | "patchset": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 19:31:58.977978 | controller | "project": { 2025-10-13 19:31:58.978000 | controller | "canonical_hostname": "github.com", 2025-10-13 19:31:58.978021 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 19:31:58.978042 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 19:31:58.978063 | controller | "short_name": "ci-framework", 2025-10-13 19:31:58.978084 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 19:31:58.978105 | controller | }, 2025-10-13 19:31:58.978127 | controller | "topic": null 2025-10-13 19:31:58.978148 | controller | } 2025-10-13 19:31:59.049503 | 2025-10-13 19:31:59.049676 | PLAY [Run ci/playbooks/build_runner_image.yml] 2025-10-13 19:31:59.085601 | 2025-10-13 19:31:59.085790 | TASK [Filter out host if needed] 2025-10-13 19:31:59.103008 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-10-13 19:31:59.114026 | 2025-10-13 19:31:59.114133 | TASK [Filter out host if needed] 2025-10-13 19:31:59.122768 | crc | skipping: end_host conditional evaluated to False, continuing execution for crc 2025-10-13 19:31:59.128175 | 2025-10-13 19:31:59.128232 | TASK [Get git tag for image tagging] 2025-10-13 19:31:59.698384 | controller | skipping: Conditional result was False 2025-10-13 19:31:59.699609 | crc | skipping: Conditional result was False 2025-10-13 19:31:59.714701 | 2025-10-13 19:31:59.714875 | TASK [Set openstack-runner image] 2025-10-13 19:31:59.757685 | controller | skipping: Conditional result was False 2025-10-13 19:31:59.768862 | crc | skipping: Conditional result was False 2025-10-13 19:31:59.777692 | 2025-10-13 19:31:59.777817 | TASK [Build openstack-runner image] 2025-10-13 19:31:59.810846 | controller | skipping: Conditional result was False 2025-10-13 19:31:59.832037 | crc | skipping: Conditional result was False 2025-10-13 19:31:59.843088 | 2025-10-13 19:31:59.843186 | TASK [Push openstack-runner image] 2025-10-13 19:31:59.877463 | controller | skipping: Conditional result was False 2025-10-13 19:31:59.889291 | crc | skipping: Conditional result was False 2025-10-13 19:31:59.899579 | 2025-10-13 19:31:59.899678 | TASK [Make sure ci-framework directory exists] 2025-10-13 19:31:59.936578 | controller | skipping: Conditional result was False 2025-10-13 19:31:59.958588 | crc | skipping: Conditional result was False 2025-10-13 19:31:59.968149 | 2025-10-13 19:31:59.968246 | TASK [Create EDPM ansible var file] 2025-10-13 19:32:00.000893 | controller | skipping: Conditional result was False 2025-10-13 19:32:00.013001 | crc | skipping: Conditional result was False 2025-10-13 19:32:00.068460 | 2025-10-13 19:32:00.068583 | PLAY RECAP 2025-10-13 19:32:00.068632 | controller | ok: 25 changed: 7 unreachable: 0 failed: 0 skipped: 9 rescued: 0 ignored: 0 2025-10-13 19:32:00.068657 | crc | ok: 2 changed: 1 unreachable: 0 failed: 0 skipped: 6 rescued: 0 ignored: 0 2025-10-13 19:32:00.068674 | 2025-10-13 19:32:00.215497 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/e2e-prepare.yml@main] 2025-10-13 19:32:00.225435 | PRE-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-10-13 19:32:00.826338 | 2025-10-13 19:32:00.826461 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-10-13 19:32:00.852023 | 2025-10-13 19:32:00.852156 | TASK [Create zuul-output directory] 2025-10-13 19:32:01.383333 | controller | changed 2025-10-13 19:32:01.397588 | 2025-10-13 19:32:01.397797 | TASK [Slurp Zuul inventory test] 2025-10-13 19:32:01.764791 | controller -> localhost | ok 2025-10-13 19:32:01.775765 | 2025-10-13 19:32:01.775874 | TASK [Save zuul inventory] 2025-10-13 19:32:02.915384 | controller | changed 2025-10-13 19:32:02.931156 | 2025-10-13 19:32:02.931343 | TASK [Save zuul vars without the change_message] 2025-10-13 19:32:03.769681 | controller | changed 2025-10-13 19:32:03.816131 | 2025-10-13 19:32:03.816261 | PLAY RECAP 2025-10-13 19:32:03.816321 | controller | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-13 19:32:03.816349 | 2025-10-13 19:32:03.928618 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-10-13 19:32:03.932195 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-10-13 19:32:04.550990 | 2025-10-13 19:32:04.551178 | PLAY [Run ci/playbooks/dump_zuul_data.yml] 2025-10-13 19:32:04.578000 | 2025-10-13 19:32:04.578148 | TASK [Create zuul-output directory] 2025-10-13 19:32:05.159028 | controller | ok 2025-10-13 19:32:05.172139 | 2025-10-13 19:32:05.172294 | TASK [Slurp Zuul inventory test] 2025-10-13 19:32:05.616906 | controller -> localhost | ok 2025-10-13 19:32:05.636506 | 2025-10-13 19:32:05.636692 | TASK [Save zuul inventory] 2025-10-13 19:32:06.474980 | controller | ok 2025-10-13 19:32:06.488412 | 2025-10-13 19:32:06.488595 | TASK [Save zuul vars without the change_message] 2025-10-13 19:32:07.209197 | controller | ok 2025-10-13 19:32:07.243371 | 2025-10-13 19:32:07.243512 | PLAY RECAP 2025-10-13 19:32:07.243571 | controller | ok: 4 changed: 0 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-13 19:32:07.243600 | 2025-10-13 19:32:07.444428 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml@main] 2025-10-13 19:32:07.447706 | RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run.yml@main] 2025-10-13 19:32:08.088670 | 2025-10-13 19:32:08.088799 | PLAY [Run ci/playbooks/kuttl/run.yml] 2025-10-13 19:32:08.111000 | 2025-10-13 19:32:08.111080 | TASK [Read group_vars] 2025-10-13 19:32:08.132776 | controller | ok 2025-10-13 19:32:08.149526 | 2025-10-13 19:32:08.149599 | TASK [cifmw_helpers : Check directory is available] 2025-10-13 19:32:08.737024 | controller | ok 2025-10-13 19:32:08.751878 | 2025-10-13 19:32:08.752027 | TASK [cifmw_helpers : Find yaml files] 2025-10-13 19:32:09.153075 | controller | ok: All paths examined 2025-10-13 19:32:09.159767 | 2025-10-13 19:32:09.159835 | TASK [cifmw_helpers : Print available yaml files] 2025-10-13 19:32:09.248897 | controller | ok: Found yaml files to parse: ['/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/group_vars/all.yml'] 2025-10-13 19:32:09.262483 | 2025-10-13 19:32:09.262627 | LOOP [cifmw_helpers : Create files on localhost and use include_vars] 2025-10-13 19:32:09.311957 | controller | Output suppressed because no_log was given 2025-10-13 19:32:09.339424 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/include_file.yml 2025-10-13 19:32:09.355537 | 2025-10-13 19:32:09.355632 | TASK [cifmw_helpers : Fail if file is not yaml or yml extension] 2025-10-13 19:32:09.401592 | controller | skipping: Conditional result was False 2025-10-13 19:32:09.411009 | 2025-10-13 19:32:09.411267 | TASK [cifmw_helpers : Check if file is available] 2025-10-13 19:32:09.665264 | controller | ok 2025-10-13 19:32:09.678404 | 2025-10-13 19:32:09.678538 | TASK [cifmw_helpers : Create temporary directory] 2025-10-13 19:32:10.091851 | controller -> localhost | changed 2025-10-13 19:32:10.098889 | 2025-10-13 19:32:10.098956 | TASK [cifmw_helpers : Read vars] 2025-10-13 19:32:10.817919 | controller | ok 2025-10-13 19:32:10.833164 | 2025-10-13 19:32:10.833301 | TASK [cifmw_helpers : Create new variable files with content] 2025-10-13 19:32:11.481986 | controller -> localhost | changed 2025-10-13 19:32:11.489926 | 2025-10-13 19:32:11.489999 | TASK [cifmw_helpers : Include vars] 2025-10-13 19:32:11.556585 | controller -> localhost | ok 2025-10-13 19:32:11.573746 | 2025-10-13 19:32:11.573866 | TASK [Run kuttl tests playbook] 2025-10-13 19:32:12.812785 | controller | 2025-10-13 19:32:13.756931 | controller | PLAY [Bootstrap playbook] ****************************************************** 2025-10-13 19:32:13.756985 | controller | 2025-10-13 19:32:13.756993 | controller | TASK [Gathering Facts ] ******************************************************** 2025-10-13 19:32:13.757000 | controller | Monday 13 October 2025 19:32:12 +0000 (0:00:00.033) 0:00:00.033 ******** 2025-10-13 19:32:13.757010 | controller | ok: [localhost] 2025-10-13 19:32:13.784589 | controller | 2025-10-13 19:32:13.784627 | controller | TASK [cifmw_setup : Set custom cifmw PATH reusable fact cifmw_path={{ ansible_user_dir }}/.crc/bin:{{ ansible_user_dir }}/.crc/bin/oc:{{ ansible_user_dir }}/bin:{{ ansible_env.PATH }}, cacheable=True] *** 2025-10-13 19:32:13.784638 | controller | Monday 13 October 2025 19:32:13 +0000 (0:00:00.944) 0:00:00.977 ******** 2025-10-13 19:32:13.784649 | controller | ok: [localhost] 2025-10-13 19:32:13.836170 | controller | 2025-10-13 19:32:13.836209 | controller | TASK [cifmw_setup : Get customized parameters ci_framework_params={{ 2025-10-13 19:32:13.836219 | controller | hostvars[inventory_hostname] | 2025-10-13 19:32:13.836231 | controller | dict2items | 2025-10-13 19:32:13.836238 | controller | selectattr("key", "match", 2025-10-13 19:32:13.836246 | controller | "^(cifmw|pre|post)_(?!install_yamls|openshift_token|openshift_login|openshift_kubeconfig).*") | 2025-10-13 19:32:13.836253 | controller | list | items2dict 2025-10-13 19:32:13.836261 | controller | }}] *** 2025-10-13 19:32:13.836268 | controller | Monday 13 October 2025 19:32:13 +0000 (0:00:00.027) 0:00:01.005 ******** 2025-10-13 19:32:13.836282 | controller | ok: [localhost] 2025-10-13 19:32:14.185838 | controller | 2025-10-13 19:32:14.185871 | controller | TASK [install_ca : Ensure target directory exists path={{ cifmw_install_ca_trust_dir }}, state=directory, mode=0755] *** 2025-10-13 19:32:14.185879 | controller | Monday 13 October 2025 19:32:13 +0000 (0:00:00.051) 0:00:01.057 ******** 2025-10-13 19:32:14.185891 | controller | ok: [localhost] 2025-10-13 19:32:14.220183 | controller | 2025-10-13 19:32:14.220239 | controller | TASK [install_ca : Install internal CA from url url={{ cifmw_install_ca_url }}, dest={{ cifmw_install_ca_trust_dir }}, validate_certs={{ cifmw_install_ca_url_validate_certs | default(omit) }}, mode=0644] *** 2025-10-13 19:32:14.220247 | controller | Monday 13 October 2025 19:32:14 +0000 (0:00:00.345) 0:00:01.403 ******** 2025-10-13 19:32:14.220263 | controller | skipping: [localhost] 2025-10-13 19:32:14.254806 | controller | 2025-10-13 19:32:14.254867 | controller | TASK [install_ca : Install custom CA bundle from inline dest={{ cifmw_install_ca_trust_dir }}/cifmw_inline_ca_bundle.crt, content={{ cifmw_install_ca_bundle_inline }}, mode=0644] *** 2025-10-13 19:32:14.254876 | controller | Monday 13 October 2025 19:32:14 +0000 (0:00:00.037) 0:00:01.440 ******** 2025-10-13 19:32:14.254888 | controller | skipping: [localhost] 2025-10-13 19:32:14.282943 | controller | 2025-10-13 19:32:14.282986 | controller | TASK [install_ca : Install custom CA bundle from file dest={{ cifmw_install_ca_trust_dir }}/{{ cifmw_install_ca_bundle_src | basename }}, src={{ cifmw_install_ca_bundle_src }}, mode=0644] *** 2025-10-13 19:32:14.282994 | controller | Monday 13 October 2025 19:32:14 +0000 (0:00:00.034) 0:00:01.474 ******** 2025-10-13 19:32:14.283007 | controller | skipping: [localhost] 2025-10-13 19:32:15.813940 | controller | 2025-10-13 19:32:15.813989 | controller | TASK [install_ca : Update ca bundle _raw_params=update-ca-trust] *************** 2025-10-13 19:32:15.814000 | controller | Monday 13 October 2025 19:32:14 +0000 (0:00:00.028) 0:00:01.503 ******** 2025-10-13 19:32:15.814017 | controller | changed: [localhost] 2025-10-13 19:32:16.441954 | controller | 2025-10-13 19:32:16.442017 | controller | TASK [repo_setup : Ensure directories are present path={{ cifmw_repo_setup_basedir }}/{{ item }}, state=directory, mode=0755] *** 2025-10-13 19:32:16.442026 | controller | Monday 13 October 2025 19:32:15 +0000 (0:00:01.531) 0:00:03.034 ******** 2025-10-13 19:32:16.442044 | controller | changed: [localhost] => (item=tmp) 2025-10-13 19:32:17.531425 | controller | changed: [localhost] => (item=artifacts/repositories) 2025-10-13 19:32:17.531501 | controller | changed: [localhost] => (item=venv/repo_setup) 2025-10-13 19:32:17.531510 | controller | 2025-10-13 19:32:17.531516 | controller | TASK [repo_setup : Make sure git-core package is installed name=git-core, state=present] *** 2025-10-13 19:32:17.531523 | controller | Monday 13 October 2025 19:32:16 +0000 (0:00:00.626) 0:00:03.661 ******** 2025-10-13 19:32:17.531556 | controller | ok: [localhost] 2025-10-13 19:32:18.578969 | controller | 2025-10-13 19:32:18.579066 | controller | TASK [repo_setup : Get repo-setup repository accept_hostkey=True, dest={{ cifmw_repo_setup_basedir }}/tmp/repo-setup, repo={{ cifmw_repo_setup_src }}] *** 2025-10-13 19:32:18.579086 | controller | Monday 13 October 2025 19:32:17 +0000 (0:00:01.087) 0:00:04.749 ******** 2025-10-13 19:32:18.579110 | controller | changed: [localhost] 2025-10-13 19:32:27.259545 | controller | 2025-10-13 19:32:27.259582 | controller | TASK [repo_setup : Initialize python venv and install requirements virtualenv={{ cifmw_repo_setup_venv }}, requirements={{ cifmw_repo_setup_basedir }}/tmp/repo-setup/requirements.txt, virtualenv_command=python3 -m venv --system-site-packages --upgrade-deps] *** 2025-10-13 19:32:27.259593 | controller | Monday 13 October 2025 19:32:18 +0000 (0:00:01.049) 0:00:05.799 ******** 2025-10-13 19:32:27.259605 | controller | changed: [localhost] 2025-10-13 19:32:28.030014 | controller | 2025-10-13 19:32:28.030056 | controller | TASK [repo_setup : Install repo-setup package chdir={{ cifmw_repo_setup_basedir }}/tmp/repo-setup, creates={{ cifmw_repo_setup_venv }}/bin/repo-setup, _raw_params={{ cifmw_repo_setup_venv }}/bin/python setup.py install] *** 2025-10-13 19:32:28.030067 | controller | Monday 13 October 2025 19:32:27 +0000 (0:00:08.681) 0:00:14.480 ******** 2025-10-13 19:32:28.030079 | controller | changed: [localhost] 2025-10-13 19:32:28.052571 | controller | 2025-10-13 19:32:28.052611 | controller | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider cifmw_repo_setup_dlrn_hash_tag={{ content_provider_dlrn_md5_hash }}] *** 2025-10-13 19:32:28.052625 | controller | Monday 13 October 2025 19:32:28 +0000 (0:00:00.770) 0:00:15.250 ******** 2025-10-13 19:32:28.052639 | controller | skipping: [localhost] 2025-10-13 19:32:28.649212 | controller | 2025-10-13 19:32:28.649259 | controller | TASK [repo_setup : Run repo-setup _raw_params={{ cifmw_repo_setup_venv }}/bin/repo-setup {{ cifmw_repo_setup_promotion }} {{ cifmw_repo_setup_additional_repos }} -d {{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }} -b {{ cifmw_repo_setup_branch }} --rdo-mirror {{ cifmw_repo_setup_rdo_mirror }} {% if cifmw_repo_setup_dlrn_hash_tag | length > 0 %} --dlrn-hash-tag {{ cifmw_repo_setup_dlrn_hash_tag }} {% endif %} -o {{ cifmw_repo_setup_output }}] *** 2025-10-13 19:32:28.649271 | controller | Monday 13 October 2025 19:32:28 +0000 (0:00:00.022) 0:00:15.273 ******** 2025-10-13 19:32:28.649285 | controller | changed: [localhost] 2025-10-13 19:32:28.688648 | controller | 2025-10-13 19:32:28.688693 | controller | TASK [repo_setup : Get component repo url={{ cifmw_repo_setup_dlrn_uri }}/{{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }}-{{ cifmw_repo_setup_branch }}/component/{{ cifmw_repo_setup_component_name }}/{{ cifmw_repo_setup_component_promotion_tag }}/delorean.repo, dest={{ cifmw_repo_setup_output }}/{{ cifmw_repo_setup_component_name }}_{{ cifmw_repo_setup_component_promotion_tag }}_delorean.repo, mode=0644] *** 2025-10-13 19:32:28.688703 | controller | Monday 13 October 2025 19:32:28 +0000 (0:00:00.596) 0:00:15.870 ******** 2025-10-13 19:32:28.688715 | controller | skipping: [localhost] 2025-10-13 19:32:28.724997 | controller | 2025-10-13 19:32:28.725039 | controller | TASK [repo_setup : Rename component repo path={{ cifmw_repo_setup_output }}/{{ cifmw_repo_setup_component_name }}_{{ cifmw_repo_setup_component_promotion_tag }}_delorean.repo, regexp=delorean-component-{{ cifmw_repo_setup_component_name }}, replace={{ cifmw_repo_setup_component_name }}-{{ cifmw_repo_setup_component_promotion_tag }}] *** 2025-10-13 19:32:28.725050 | controller | Monday 13 October 2025 19:32:28 +0000 (0:00:00.039) 0:00:15.909 ******** 2025-10-13 19:32:28.725061 | controller | skipping: [localhost] 2025-10-13 19:32:28.763127 | controller | 2025-10-13 19:32:28.763171 | controller | TASK [repo_setup : Disable component repo in current-podified dlrn repo path={{ cifmw_repo_setup_output }}/delorean.repo, section=delorean-component-{{ cifmw_repo_setup_component_name }}, option=enabled, value=0, mode=0644] *** 2025-10-13 19:32:28.763181 | controller | Monday 13 October 2025 19:32:28 +0000 (0:00:00.036) 0:00:15.945 ******** 2025-10-13 19:32:28.763203 | controller | skipping: [localhost] 2025-10-13 19:32:29.220477 | controller | 2025-10-13 19:32:29.221445 | controller | TASK [repo_setup : Run repo-setup-get-hash _raw_params={{ cifmw_repo_setup_venv }}/bin/repo-setup-get-hash --dlrn-url {{ cifmw_repo_setup_dlrn_uri[:-1] }} --os-version {{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }} --release {{ cifmw_repo_setup_branch }} {% if cifmw_repo_setup_component_name | length > 0 -%} --component {{ cifmw_repo_setup_component_name }} --tag {{ cifmw_repo_setup_component_promotion_tag }} {% else -%} --tag {{cifmw_repo_setup_promotion }} {% endif -%} {% if (cifmw_repo_setup_dlrn_hash_tag | length > 0) and (cifmw_repo_setup_component_name | length <= 0) -%} --dlrn-hash-tag {{ cifmw_repo_setup_dlrn_hash_tag }} {% endif -%} --json] *** 2025-10-13 19:32:29.221460 | controller | Monday 13 October 2025 19:32:28 +0000 (0:00:00.038) 0:00:15.983 ******** 2025-10-13 19:32:29.221928 | controller | changed: [localhost] 2025-10-13 19:32:29.907387 | controller | 2025-10-13 19:32:29.907541 | controller | TASK [repo_setup : Dump full hash in delorean.repo.md5 file content={{ _repo_setup_json['full_hash'] }} 2025-10-13 19:32:29.907565 | controller | , dest={{ cifmw_repo_setup_basedir }}/artifacts/repositories/delorean.repo.md5, mode=0644] *** 2025-10-13 19:32:29.907583 | controller | Monday 13 October 2025 19:32:29 +0000 (0:00:00.457) 0:00:16.441 ******** 2025-10-13 19:32:29.907614 | controller | changed: [localhost] 2025-10-13 19:32:29.942606 | controller | 2025-10-13 19:32:29.942688 | controller | TASK [repo_setup : Dump current-podified hash url={{ cifmw_repo_setup_dlrn_uri }}/{{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }}-{{ cifmw_repo_setup_branch }}/current-podified/delorean.repo.md5, dest={{ cifmw_repo_setup_basedir }}/artifacts/repositories/delorean.repo.md5, mode=0644] *** 2025-10-13 19:32:29.942704 | controller | Monday 13 October 2025 19:32:29 +0000 (0:00:00.686) 0:00:17.127 ******** 2025-10-13 19:32:29.942723 | controller | skipping: [localhost] 2025-10-13 19:32:29.977017 | controller | 2025-10-13 19:32:29.977085 | controller | TASK [repo_setup : Slurp current podified hash src={{ cifmw_repo_setup_basedir }}/artifacts/repositories/delorean.repo.md5] *** 2025-10-13 19:32:29.977100 | controller | Monday 13 October 2025 19:32:29 +0000 (0:00:00.035) 0:00:17.163 ******** 2025-10-13 19:32:29.977121 | controller | skipping: [localhost] 2025-10-13 19:32:30.008817 | controller | 2025-10-13 19:32:30.008872 | controller | TASK [repo_setup : Update the value of full_hash _repo_setup_json={{ _repo_setup_json | combine({'full_hash': _hash}, recursive=true) }}] *** 2025-10-13 19:32:30.008884 | controller | Monday 13 October 2025 19:32:29 +0000 (0:00:00.034) 0:00:17.197 ******** 2025-10-13 19:32:30.008900 | controller | skipping: [localhost] 2025-10-13 19:32:30.054667 | controller | 2025-10-13 19:32:30.054735 | controller | TASK [repo_setup : Export hashes facts for further use cifmw_repo_setup_full_hash={{ _repo_setup_json['full_hash'] }}, cifmw_repo_setup_commit_hash={{ _repo_setup_json['commit_hash'] }}, cifmw_repo_setup_distro_hash={{ _repo_setup_json['distro_hash'] }}, cifmw_repo_setup_extended_hash={{ _repo_setup_json['extended_hash'] }}, cifmw_repo_setup_dlrn_api_url={{ _repo_setup_json['dlrn_api_url'] }}, cifmw_repo_setup_dlrn_url={{ _repo_setup_json['dlrn_url'] }}, cifmw_repo_setup_release={{ _repo_setup_json['release'] }}, cacheable=True] *** 2025-10-13 19:32:30.054749 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.031) 0:00:17.229 ******** 2025-10-13 19:32:30.054766 | controller | ok: [localhost] 2025-10-13 19:32:30.082620 | controller | 2025-10-13 19:32:30.082682 | controller | TASK [repo_setup : Create download directory path={{ cifmw_repo_setup_rhos_release_path }}, state=directory, mode=0755] *** 2025-10-13 19:32:30.082693 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.044) 0:00:17.273 ******** 2025-10-13 19:32:30.082710 | controller | skipping: [localhost] 2025-10-13 19:32:30.109928 | controller | 2025-10-13 19:32:30.109997 | controller | TASK [repo_setup : Print the URL to request msg={{ cifmw_repo_setup_rhos_release_rpm }}] *** 2025-10-13 19:32:30.110012 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.029) 0:00:17.303 ******** 2025-10-13 19:32:30.110033 | controller | skipping: [localhost] 2025-10-13 19:32:30.137142 | controller | 2025-10-13 19:32:30.137215 | controller | TASK [Download the RPM name=krb_request] *************************************** 2025-10-13 19:32:30.137226 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.027) 0:00:17.330 ******** 2025-10-13 19:32:30.137242 | controller | skipping: [localhost] 2025-10-13 19:32:30.164009 | controller | 2025-10-13 19:32:30.164074 | controller | TASK [repo_setup : Install RHOS Release tool name={{ 2025-10-13 19:32:30.164086 | controller | cifmw_repo_setup_rhos_release_rpm 2025-10-13 19:32:30.164096 | controller | if cifmw_repo_setup_rhos_release_rpm is not url 2025-10-13 19:32:30.164105 | controller | else cifmw_krb_request_out.path 2025-10-13 19:32:30.164115 | controller | }}, state=present, disable_gpg_check={{ cifmw_repo_setup_rhos_release_gpg_check | bool }}] *** 2025-10-13 19:32:30.164124 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.027) 0:00:17.357 ******** 2025-10-13 19:32:30.164142 | controller | skipping: [localhost] 2025-10-13 19:32:30.188104 | controller | 2025-10-13 19:32:30.188165 | controller | TASK [repo_setup : Get rhos-release tool version _raw_params=rhos-release --version] *** 2025-10-13 19:32:30.188175 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.026) 0:00:17.384 ******** 2025-10-13 19:32:30.188191 | controller | skipping: [localhost] 2025-10-13 19:32:30.212757 | controller | 2025-10-13 19:32:30.212809 | controller | TASK [repo_setup : Print rhos-release tool version msg={{ rr_version.stdout }}] *** 2025-10-13 19:32:30.212817 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.024) 0:00:17.408 ******** 2025-10-13 19:32:30.212831 | controller | skipping: [localhost] 2025-10-13 19:32:30.242895 | controller | 2025-10-13 19:32:30.243001 | controller | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }} _raw_params=rhos-release {{ cifmw_repo_setup_rhos_release_args }} \ 2025-10-13 19:32:30.243010 | controller | -t {{ cifmw_repo_setup_output }}] *** 2025-10-13 19:32:30.243017 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.024) 0:00:17.433 ******** 2025-10-13 19:32:30.243040 | controller | skipping: [localhost] 2025-10-13 19:32:30.474724 | controller | 2025-10-13 19:32:30.474843 | controller | TASK [repo_setup : Check for /etc/ci/mirror_info.sh path=/etc/ci/mirror_info.sh] *** 2025-10-13 19:32:30.474852 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.029) 0:00:17.463 ******** 2025-10-13 19:32:30.474877 | controller | ok: [localhost] 2025-10-13 19:32:30.704849 | controller | 2025-10-13 19:32:30.704905 | controller | TASK [repo_setup : Use RDO proxy mirrors chdir={{ cifmw_repo_setup_output }}, _raw_params=set -o pipefail 2025-10-13 19:32:30.704912 | controller | source /etc/ci/mirror_info.sh 2025-10-13 19:32:30.704919 | controller | sed -i -e "s|https://trunk.rdoproject.org|$NODEPOOL_RDO_PROXY|g" *.repo 2025-10-13 19:32:30.704926 | controller | ] *** 2025-10-13 19:32:30.704933 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.231) 0:00:17.695 ******** 2025-10-13 19:32:30.704945 | controller | changed: [localhost] 2025-10-13 19:32:30.942157 | controller | 2025-10-13 19:32:30.942195 | controller | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist) chdir={{ cifmw_repo_setup_output }}, _raw_params=set -o pipefail 2025-10-13 19:32:30.942203 | controller | source /etc/ci/mirror_info.sh 2025-10-13 19:32:30.942212 | controller | sed -i -e "s|http://mirror.stream.centos.org|$NODEPOOL_CENTOS_MIRROR|g" *.repo 2025-10-13 19:32:30.942220 | controller | ] *** 2025-10-13 19:32:30.942228 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.230) 0:00:17.925 ******** 2025-10-13 19:32:30.942238 | controller | changed: [localhost] 2025-10-13 19:32:30.968642 | controller | 2025-10-13 19:32:30.968686 | controller | TASK [repo_setup : Check for gating.repo file on content provider url=http://{{ content_provider_registry_ip }}:8766/gating.repo] *** 2025-10-13 19:32:30.968697 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.237) 0:00:18.162 ******** 2025-10-13 19:32:30.968712 | controller | skipping: [localhost] 2025-10-13 19:32:31.003061 | controller | 2025-10-13 19:32:31.003123 | controller | TASK [repo_setup : Populate gating repo from content provider ip content=[gating-repo] 2025-10-13 19:32:31.003134 | controller | baseurl=http://{{ content_provider_registry_ip }}:8766/ 2025-10-13 19:32:31.003144 | controller | enabled=1 2025-10-13 19:32:31.003153 | controller | gpgcheck=0 2025-10-13 19:32:31.003162 | controller | priority=1 2025-10-13 19:32:31.003171 | controller | , dest={{ cifmw_repo_setup_output }}/gating.repo, mode=0644] *** 2025-10-13 19:32:31.003191 | controller | Monday 13 October 2025 19:32:30 +0000 (0:00:00.026) 0:00:18.189 ******** 2025-10-13 19:32:31.003208 | controller | skipping: [localhost] 2025-10-13 19:32:31.051618 | controller | 2025-10-13 19:32:31.051866 | controller | TASK [repo_setup : Check for DLRN repo at the destination path={{ cifmw_repo_setup_output }}/delorean.repo] *** 2025-10-13 19:32:31.051882 | controller | Monday 13 October 2025 19:32:31 +0000 (0:00:00.034) 0:00:18.224 ******** 2025-10-13 19:32:31.051899 | controller | skipping: [localhost] 2025-10-13 19:32:31.088443 | controller | 2025-10-13 19:32:31.088490 | controller | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo path={{ cifmw_repo_setup_output }}/delorean.repo, regexp=priority=1, replace=priority=20] *** 2025-10-13 19:32:31.088498 | controller | Monday 13 October 2025 19:32:31 +0000 (0:00:00.046) 0:00:18.270 ******** 2025-10-13 19:32:31.088514 | controller | skipping: [localhost] 2025-10-13 19:32:31.125050 | controller | 2025-10-13 19:32:31.125103 | controller | TASK [repo_setup : Check for DLRN component repo path={{ cifmw_repo_setup_output }}/{{ _comp_repo }}] *** 2025-10-13 19:32:31.125110 | controller | Monday 13 October 2025 19:32:31 +0000 (0:00:00.036) 0:00:18.306 ******** 2025-10-13 19:32:31.125126 | controller | skipping: [localhost] 2025-10-13 19:32:31.160616 | controller | 2025-10-13 19:32:31.160670 | controller | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo path={{ cifmw_repo_setup_output }}//{{ _comp_repo }}, regexp=priority=1, replace=priority=2] *** 2025-10-13 19:32:31.160679 | controller | Monday 13 October 2025 19:32:31 +0000 (0:00:00.037) 0:00:18.343 ******** 2025-10-13 19:32:31.160696 | controller | skipping: [localhost] 2025-10-13 19:32:31.484794 | controller | 2025-10-13 19:32:31.484875 | controller | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory paths=/etc/yum.repos.d/, patterns=*.repo, recurse=False] *** 2025-10-13 19:32:31.484883 | controller | Monday 13 October 2025 19:32:31 +0000 (0:00:00.035) 0:00:18.379 ******** 2025-10-13 19:32:31.484896 | controller | ok: [localhost] 2025-10-13 19:32:31.900186 | controller | 2025-10-13 19:32:31.900251 | controller | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory path={{ item }}, state=absent] *** 2025-10-13 19:32:31.900259 | controller | Monday 13 October 2025 19:32:31 +0000 (0:00:00.326) 0:00:18.705 ******** 2025-10-13 19:32:31.900272 | controller | changed: [localhost] => (item=/etc/yum.repos.d/centos-addons.repo) 2025-10-13 19:32:32.359811 | controller | changed: [localhost] => (item=/etc/yum.repos.d/centos.repo) 2025-10-13 19:32:32.359859 | controller | 2025-10-13 19:32:32.359867 | controller | TASK [repo_setup : Cleanup existing metadata _raw_params=dnf clean metadata] *** 2025-10-13 19:32:32.359873 | controller | Monday 13 October 2025 19:32:31 +0000 (0:00:00.415) 0:00:19.121 ******** 2025-10-13 19:32:32.359884 | controller | changed: [localhost] 2025-10-13 19:32:32.619582 | controller | 2025-10-13 19:32:32.619632 | controller | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory mode=0755, remote_src=True, src={{ cifmw_repo_setup_output }}/, dest=/etc/yum.repos.d] *** 2025-10-13 19:32:32.619642 | controller | Monday 13 October 2025 19:32:32 +0000 (0:00:00.459) 0:00:19.580 ******** 2025-10-13 19:32:32.619660 | controller | changed: [localhost] 2025-10-13 19:32:32.664649 | controller | 2025-10-13 19:32:32.664684 | controller | TASK [ci_setup : Gather variables for each operating system _raw_params={{ item }}] *** 2025-10-13 19:32:32.664691 | controller | Monday 13 October 2025 19:32:32 +0000 (0:00:00.259) 0:00:19.840 ******** 2025-10-13 19:32:32.664703 | controller | ok: [localhost] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-10-13 19:32:32.686526 | controller | 2025-10-13 19:32:32.686560 | controller | TASK [ci_setup : List packages to install var=cifmw_ci_setup_packages] ********* 2025-10-13 19:32:32.686567 | controller | Monday 13 October 2025 19:32:32 +0000 (0:00:00.045) 0:00:19.885 ******** 2025-10-13 19:32:32.686578 | controller | ok: [localhost] => 2025-10-13 19:32:58.957893 | controller | cifmw_ci_setup_packages: 2025-10-13 19:32:58.957935 | controller | - bash-completion 2025-10-13 19:32:58.957943 | controller | - ca-certificates 2025-10-13 19:32:58.957949 | controller | - git-core 2025-10-13 19:32:58.957961 | controller | - make 2025-10-13 19:32:58.957967 | controller | - tar 2025-10-13 19:32:58.957977 | controller | - tmux 2025-10-13 19:32:58.957983 | controller | - python3-pip 2025-10-13 19:32:58.957988 | controller | 2025-10-13 19:32:58.957995 | controller | TASK [ci_setup : Install needed packages name={{ cifmw_ci_setup_packages }}, state=latest] *** 2025-10-13 19:32:58.958001 | controller | Monday 13 October 2025 19:32:32 +0000 (0:00:00.021) 0:00:19.907 ******** 2025-10-13 19:32:58.958012 | controller | changed: [localhost] 2025-10-13 19:32:59.131327 | controller | 2025-10-13 19:32:59.131370 | controller | TASK [ci_setup : Gather version of openshift client _raw_params=oc version --client -o yaml] *** 2025-10-13 19:32:59.131381 | controller | Monday 13 October 2025 19:32:58 +0000 (0:00:26.271) 0:00:46.178 ******** 2025-10-13 19:32:59.131423 | controller | ok: [localhost] 2025-10-13 19:32:59.317784 | controller | 2025-10-13 19:32:59.317825 | controller | TASK [ci_setup : Ensure openshift client install path is present path={{ cifmw_ci_setup_oc_install_path }}, state=directory, mode=0755] *** 2025-10-13 19:32:59.317835 | controller | Monday 13 October 2025 19:32:59 +0000 (0:00:00.173) 0:00:46.352 ******** 2025-10-13 19:32:59.317848 | controller | changed: [localhost] 2025-10-13 19:33:04.638579 | controller | 2025-10-13 19:33:04.638626 | controller | TASK [ci_setup : Install openshift client src={{ cifmw_ci_setup_openshift_client_download_uri }}/{{ cifmw_ci_setup_openshift_client_version }}/openshift-client-linux.tar.gz, dest={{ cifmw_ci_setup_oc_install_path }}, remote_src=True, mode=0755, creates={{ cifmw_ci_setup_oc_install_path }}/oc] *** 2025-10-13 19:33:04.638642 | controller | Monday 13 October 2025 19:32:59 +0000 (0:00:00.186) 0:00:46.538 ******** 2025-10-13 19:33:04.638657 | controller | changed: [localhost] 2025-10-13 19:33:04.678228 | controller | 2025-10-13 19:33:04.678276 | controller | TASK [ci_setup : Add the OC path to cifmw_path if needed cifmw_path={{ cifmw_ci_setup_oc_install_path }}:{{ ansible_env.PATH }}, cacheable=True] *** 2025-10-13 19:33:04.678287 | controller | Monday 13 October 2025 19:33:04 +0000 (0:00:05.320) 0:00:51.859 ******** 2025-10-13 19:33:04.678302 | controller | skipping: [localhost] 2025-10-13 19:33:05.043501 | controller | 2025-10-13 19:33:05.043587 | controller | TASK [ci_setup : Create completion file] *************************************** 2025-10-13 19:33:05.043601 | controller | Monday 13 October 2025 19:33:04 +0000 (0:00:00.039) 0:00:51.898 ******** 2025-10-13 19:33:05.043635 | controller | changed: [localhost] 2025-10-13 19:33:05.365817 | controller | 2025-10-13 19:33:05.365871 | controller | TASK [ci_setup : Source completion from within .bashrc create=True, mode=0644, path={{ ansible_user_dir }}/.bashrc, block=if [ -f ~/.oc_completion ]; then 2025-10-13 19:33:05.365879 | controller | source ~/.oc_completion 2025-10-13 19:33:05.365886 | controller | fi] *** 2025-10-13 19:33:05.365892 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.364) 0:00:52.263 ******** 2025-10-13 19:33:05.365906 | controller | changed: [localhost] 2025-10-13 19:33:05.403086 | controller | 2025-10-13 19:33:05.403153 | controller | TASK [ci_setup : Check rhsm status _raw_params=subscription-manager status] **** 2025-10-13 19:33:05.403164 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.322) 0:00:52.585 ******** 2025-10-13 19:33:05.403183 | controller | skipping: [localhost] 2025-10-13 19:33:05.434737 | controller | 2025-10-13 19:33:05.434794 | controller | TASK [ci_setup : Gather the repos to be enabled _repos={{ 2025-10-13 19:33:05.434805 | controller | cifmw_ci_setup_rhel_rhsm_default_repos + 2025-10-13 19:33:05.434815 | controller | (cifmw_ci_setup_rhel_rhsm_extra_repos | default([])) 2025-10-13 19:33:05.434823 | controller | }}] *** 2025-10-13 19:33:05.434831 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.037) 0:00:52.623 ******** 2025-10-13 19:33:05.434848 | controller | skipping: [localhost] 2025-10-13 19:33:05.465078 | controller | 2025-10-13 19:33:05.465144 | controller | TASK [ci_setup : Enabling the required repositories. name={{ item }}, state={{ rhsm_repo_state | default('enabled') }}] *** 2025-10-13 19:33:05.465155 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.031) 0:00:52.654 ******** 2025-10-13 19:33:05.465175 | controller | skipping: [localhost] 2025-10-13 19:33:05.495059 | controller | 2025-10-13 19:33:05.495116 | controller | TASK [ci_setup : Get current /etc/redhat-release _raw_params=cat /etc/redhat-release] *** 2025-10-13 19:33:05.495127 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.030) 0:00:52.685 ******** 2025-10-13 19:33:05.495157 | controller | skipping: [localhost] 2025-10-13 19:33:05.526011 | controller | 2025-10-13 19:33:05.526084 | controller | TASK [ci_setup : Print current /etc/redhat-release msg={{ _current_rh_release.stdout }}] *** 2025-10-13 19:33:05.526094 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.029) 0:00:52.715 ******** 2025-10-13 19:33:05.526116 | controller | skipping: [localhost] 2025-10-13 19:33:05.564340 | controller | 2025-10-13 19:33:05.564425 | controller | TASK [ci_setup : Ensure the repos are enabled in the system using yum name={{ item.name }}, baseurl={{ item.baseurl }}, description={{ item.description | default(item.name) }}, gpgcheck={{ item.gpgcheck | default(false) }}, enabled=True, state={{ yum_repo_state | default('present') }}] *** 2025-10-13 19:33:05.564439 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.030) 0:00:52.745 ******** 2025-10-13 19:33:05.564460 | controller | skipping: [localhost] 2025-10-13 19:33:06.725258 | controller | 2025-10-13 19:33:06.725332 | controller | TASK [ci_setup : Manage directories path={{ item }}, state={{ directory_state }}, mode=0755, owner={{ ansible_user_id }}, group={{ ansible_user_id }}] *** 2025-10-13 19:33:06.725341 | controller | Monday 13 October 2025 19:33:05 +0000 (0:00:00.039) 0:00:52.784 ******** 2025-10-13 19:33:06.725359 | controller | changed: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/manifests/openstack/cr) 2025-10-13 19:33:06.855734 | controller | changed: [localhost] => (item=/home/zuul/ci-framework-data/logs) 2025-10-13 19:33:06.855775 | controller | ok: [localhost] => (item=/home/zuul/ci-framework-data/tmp) 2025-10-13 19:33:06.855783 | controller | changed: [localhost] => (item=/home/zuul/ci-framework-data/volumes) 2025-10-13 19:33:06.855791 | controller | ok: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/parameters) 2025-10-13 19:33:06.855798 | controller | 2025-10-13 19:33:06.855804 | controller | TASK [Prepare install_yamls make targets name=install_yamls, apply={'tags': ['bootstrap']}] *** 2025-10-13 19:33:06.855811 | controller | Monday 13 October 2025 19:33:06 +0000 (0:00:01.160) 0:00:53.945 ******** 2025-10-13 19:33:06.855822 | controller | 2025-10-13 19:33:07.387294 | controller | TASK [install_yamls : Ensure directories exist path={{ item }}, state=directory, mode=0755] *** 2025-10-13 19:33:07.387351 | controller | Monday 13 October 2025 19:33:06 +0000 (0:00:00.131) 0:00:54.076 ******** 2025-10-13 19:33:07.387367 | controller | ok: [localhost] => (item=/home/zuul/ci-framework-data/artifacts) 2025-10-13 19:33:07.421664 | controller | changed: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/roles/install_yamls_makes/tasks) 2025-10-13 19:33:07.421738 | controller | ok: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/parameters) 2025-10-13 19:33:07.421745 | controller | 2025-10-13 19:33:07.421752 | controller | TASK [Create variables with local repos based on Zuul items name=install_yamls, tasks_from=zuul_set_operators_repo.yml] *** 2025-10-13 19:33:07.421759 | controller | Monday 13 October 2025 19:33:07 +0000 (0:00:00.531) 0:00:54.608 ******** 2025-10-13 19:33:07.421777 | controller | 2025-10-13 19:33:07.464707 | controller | TASK [install_yamls : Set fact with local repos based on Zuul items cifmw_install_yamls_operators_repo={{ cifmw_install_yamls_operators_repo | default({}) | combine(_repo_operator_info | items2dict) }}] *** 2025-10-13 19:33:07.464760 | controller | Monday 13 October 2025 19:33:07 +0000 (0:00:00.034) 0:00:54.642 ******** 2025-10-13 19:33:07.464777 | controller | skipping: [localhost] => (item={'branch': 'main', 'change': '3404', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3404', 'commit_id': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'patchset': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07.512089 | controller | skipping: [localhost] => (item={'branch': 'main', 'change': '3406', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3406', 'commit_id': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'patchset': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07.512160 | controller | skipping: [localhost] => (item={'branch': 'main', 'change': '3402', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3402', 'commit_id': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'patchset': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07.512168 | controller | skipping: [localhost] 2025-10-13 19:33:07.512175 | controller | 2025-10-13 19:33:07.512182 | controller | TASK [install_yamls : Print helpful data for debugging msg=_repo_operator_name: {{ _repo_operator_name }} 2025-10-13 19:33:07.512189 | controller | _repo_operator_info: {{ _repo_operator_info }} 2025-10-13 19:33:07.512196 | controller | cifmw_install_yamls_operators_repo: {{ cifmw_install_yamls_operators_repo }} 2025-10-13 19:33:07.512203 | controller | ] *** 2025-10-13 19:33:07.512209 | controller | Monday 13 October 2025 19:33:07 +0000 (0:00:00.042) 0:00:54.685 ******** 2025-10-13 19:33:07.512225 | controller | skipping: [localhost] => (item={'branch': 'main', 'change': '3404', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3404', 'commit_id': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'patchset': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07.638597 | controller | skipping: [localhost] => (item={'branch': 'main', 'change': '3406', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3406', 'commit_id': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'patchset': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07.638683 | controller | skipping: [localhost] => (item={'branch': 'main', 'change': '3402', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3402', 'commit_id': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'patchset': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07.638691 | controller | skipping: [localhost] 2025-10-13 19:33:07.638698 | controller | 2025-10-13 19:33:07.638705 | controller | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value _install_yamls_override_vars={{ 2025-10-13 19:33:07.638712 | controller | _install_yamls_override_vars | default({}) | 2025-10-13 19:33:07.638718 | controller | combine(item, recursive=True) 2025-10-13 19:33:07.638724 | controller | }}] *** 2025-10-13 19:33:07.638730 | controller | Monday 13 October 2025 19:33:07 +0000 (0:00:00.047) 0:00:54.733 ******** 2025-10-13 19:33:07.638747 | controller | ok: [localhost] => (item={'BMO_SETUP': False}) 2025-10-13 19:33:07.683281 | controller | 2025-10-13 19:33:07.683335 | controller | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact cifmw_install_yamls_environment={{ 2025-10-13 19:33:07.683343 | controller | _install_yamls_override_vars.keys() | 2025-10-13 19:33:07.683349 | controller | map('upper') | 2025-10-13 19:33:07.683355 | controller | zip(_install_yamls_override_vars.values()) | 2025-10-13 19:33:07.683370 | controller | items2dict(key_name=0, value_name=1) | 2025-10-13 19:33:07.683376 | controller | combine({ 2025-10-13 19:33:07.683383 | controller | 'OUT': cifmw_install_yamls_manifests_dir, 2025-10-13 19:33:07.683389 | controller | 'OUTPUT_DIR': cifmw_install_yamls_edpm_dir, 2025-10-13 19:33:07.683416 | controller | 'CHECKOUT_FROM_OPENSTACK_REF': cifmw_install_yamls_checkout_openstack_ref, 2025-10-13 19:33:07.683423 | controller | 'OPENSTACK_K8S_BRANCH': (zuul is defined and not zuul.branch |regex_search('master|rhos')) | ternary(zuul.branch, 'main') 2025-10-13 19:33:07.683429 | controller | }) | 2025-10-13 19:33:07.683435 | controller | combine(install_yamls_operators_repos) 2025-10-13 19:33:07.683441 | controller | }}, cacheable=True] *** 2025-10-13 19:33:07.683448 | controller | Monday 13 October 2025 19:33:07 +0000 (0:00:00.126) 0:00:54.859 ******** 2025-10-13 19:33:07.683463 | controller | ok: [localhost] 2025-10-13 19:33:08.202018 | controller | 2025-10-13 19:33:08.202109 | controller | TASK [install_yamls : Get environment structure base_path={{ cifmw_install_yamls_repo }}] *** 2025-10-13 19:33:08.202118 | controller | Monday 13 October 2025 19:33:07 +0000 (0:00:00.044) 0:00:54.904 ******** 2025-10-13 19:33:08.202134 | controller | ok: [localhost] 2025-10-13 19:33:08.392350 | controller | 2025-10-13 19:33:08.392487 | controller | TASK [install_yamls : Ensure Output directory exists path={{ cifmw_install_yamls_out_dir }}, state=directory, mode=0755] *** 2025-10-13 19:33:08.392506 | controller | Monday 13 October 2025 19:33:08 +0000 (0:00:00.518) 0:00:55.423 ******** 2025-10-13 19:33:08.392527 | controller | ok: [localhost] 2025-10-13 19:33:08.442091 | controller | 2025-10-13 19:33:08.442156 | controller | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables that=_cifmw_install_yamls_unmatched_vars | length == 0, msg=cifmw_install_yamls_vars contains a variable that is not defined in install_yamls Makefile nor cifmw_install_yamls_whitelisted_vars: {{ _cifmw_install_yamls_unmatched_vars | join(', ')}}, quiet=True] *** 2025-10-13 19:33:08.442165 | controller | Monday 13 October 2025 19:33:08 +0000 (0:00:00.189) 0:00:55.613 ******** 2025-10-13 19:33:08.442184 | controller | ok: [localhost] 2025-10-13 19:33:08.825320 | controller | 2025-10-13 19:33:08.825357 | controller | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh dest={{ cifmw_install_yamls_out_dir }}/{{ cifmw_install_yamls_envfile }}, content={% for k,v in cifmw_install_yamls_environment.items() %} 2025-10-13 19:33:08.825365 | controller | export {{ k }}={{ v }} 2025-10-13 19:33:08.825373 | controller | {% endfor %}, mode=0644] *** 2025-10-13 19:33:08.825379 | controller | Monday 13 October 2025 19:33:08 +0000 (0:00:00.049) 0:00:55.662 ******** 2025-10-13 19:33:08.825391 | controller | changed: [localhost] 2025-10-13 19:33:08.855358 | controller | 2025-10-13 19:33:08.855415 | controller | TASK [install_yamls : Set install_yamls default values cifmw_install_yamls_defaults={{ get_makefiles_env_output.makefiles_values | combine(cifmw_install_yamls_environment) }}, cacheable=True] *** 2025-10-13 19:33:08.855427 | controller | Monday 13 October 2025 19:33:08 +0000 (0:00:00.383) 0:00:56.046 ******** 2025-10-13 19:33:08.855439 | controller | ok: [localhost] 2025-10-13 19:33:08.879202 | controller | 2025-10-13 19:33:08.879240 | controller | TASK [install_yamls : Show the env structure var=cifmw_install_yamls_environment] *** 2025-10-13 19:33:08.879249 | controller | Monday 13 October 2025 19:33:08 +0000 (0:00:00.030) 0:00:56.076 ******** 2025-10-13 19:33:08.879261 | controller | ok: [localhost] => 2025-10-13 19:33:08.904705 | controller | cifmw_install_yamls_environment: 2025-10-13 19:33:08.904769 | controller | BMO_SETUP: false 2025-10-13 19:33:08.904780 | controller | CHECKOUT_FROM_OPENSTACK_REF: 'true' 2025-10-13 19:33:08.904786 | controller | OPENSTACK_K8S_BRANCH: main 2025-10-13 19:33:08.904792 | controller | OUT: /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 19:33:08.904799 | controller | OUTPUT_DIR: /home/zuul/ci-framework-data/artifacts/edpm 2025-10-13 19:33:08.904805 | controller | 2025-10-13 19:33:08.904811 | controller | TASK [install_yamls : Show the env structure defaults var=cifmw_install_yamls_defaults] *** 2025-10-13 19:33:08.904817 | controller | Monday 13 October 2025 19:33:08 +0000 (0:00:00.023) 0:00:56.100 ******** 2025-10-13 19:33:08.904831 | controller | ok: [localhost] => 2025-10-13 19:33:08.904849 | controller | cifmw_install_yamls_defaults: 2025-10-13 19:33:08.904856 | controller | ADOPTED_EXTERNAL_NETWORK: 172.21.1.0/24 2025-10-13 19:33:08.904862 | controller | ADOPTED_INTERNALAPI_NETWORK: 172.17.1.0/24 2025-10-13 19:33:08.904867 | controller | ADOPTED_STORAGEMGMT_NETWORK: 172.20.1.0/24 2025-10-13 19:33:08.904873 | controller | ADOPTED_STORAGE_NETWORK: 172.18.1.0/24 2025-10-13 19:33:08.904879 | controller | ADOPTED_TENANT_NETWORK: 172.9.1.0/24 2025-10-13 19:33:08.904887 | controller | ANSIBLEEE: config/samples/_v1beta1_ansibleee.yaml 2025-10-13 19:33:08.904893 | controller | ANSIBLEEE_BRANCH: main 2025-10-13 19:33:08.904899 | controller | ANSIBLEEE_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/config/samples/_v1beta1_ansibleee.yaml 2025-10-13 19:33:08.904905 | controller | ANSIBLEEE_IMG: quay.io/openstack-k8s-operators/openstack-ansibleee-operator-index:latest 2025-10-13 19:33:08.904912 | controller | ANSIBLEEE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/kuttl-test.yaml 2025-10-13 19:33:08.904919 | controller | ANSIBLEEE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/tests/kuttl/tests 2025-10-13 19:33:08.904926 | controller | ANSIBLEEE_KUTTL_NAMESPACE: ansibleee-kuttl-tests 2025-10-13 19:33:08.904932 | controller | ANSIBLEEE_REPO: https://github.com/openstack-k8s-operators/openstack-ansibleee-operator 2025-10-13 19:33:08.904938 | controller | ANSIBLEE_COMMIT_HASH: '' 2025-10-13 19:33:08.904944 | controller | BARBICAN: config/samples/barbican_v1beta1_barbican.yaml 2025-10-13 19:33:08.904953 | controller | BARBICAN_BRANCH: main 2025-10-13 19:33:08.904959 | controller | BARBICAN_COMMIT_HASH: '' 2025-10-13 19:33:08.904965 | controller | BARBICAN_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/config/samples/barbican_v1beta1_barbican.yaml 2025-10-13 19:33:08.904970 | controller | BARBICAN_DEPL_IMG: unused 2025-10-13 19:33:08.904976 | controller | BARBICAN_IMG: quay.io/openstack-k8s-operators/barbican-operator-index:latest 2025-10-13 19:33:08.904982 | controller | BARBICAN_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/kuttl-test.yaml 2025-10-13 19:33:08.904988 | controller | BARBICAN_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/tests/kuttl/tests 2025-10-13 19:33:08.904994 | controller | BARBICAN_KUTTL_NAMESPACE: barbican-kuttl-tests 2025-10-13 19:33:08.905000 | controller | BARBICAN_REPO: https://github.com/openstack-k8s-operators/barbican-operator.git 2025-10-13 19:33:08.905006 | controller | BARBICAN_SERVICE_ENABLED: 'true' 2025-10-13 19:33:08.905011 | controller | BARBICAN_SIMPLE_CRYPTO_ENCRYPTION_KEY: sEFmdFjDUqRM2VemYslV5yGNWjokioJXsg8Nrlc3drU= 2025-10-13 19:33:08.905018 | controller | BAREMETAL_BRANCH: main 2025-10-13 19:33:08.905024 | controller | BAREMETAL_COMMIT_HASH: '' 2025-10-13 19:33:08.905029 | controller | BAREMETAL_IMG: quay.io/openstack-k8s-operators/openstack-baremetal-operator-index:latest 2025-10-13 19:33:08.905035 | controller | BAREMETAL_OS_CONTAINER_IMG: '' 2025-10-13 19:33:08.905041 | controller | BAREMETAL_OS_IMG: '' 2025-10-13 19:33:08.905047 | controller | BAREMETAL_REPO: https://github.com/openstack-k8s-operators/openstack-baremetal-operator.git 2025-10-13 19:33:08.905052 | controller | BAREMETAL_TIMEOUT: 20m 2025-10-13 19:33:08.905058 | controller | BASH_IMG: quay.io/openstack-k8s-operators/bash:latest 2025-10-13 19:33:08.905064 | controller | BGP_ASN: '64999' 2025-10-13 19:33:08.905070 | controller | BGP_LEAF_1: 100.65.4.1 2025-10-13 19:33:08.905076 | controller | BGP_LEAF_2: 100.64.4.1 2025-10-13 19:33:08.905081 | controller | BGP_OVN_ROUTING: 'false' 2025-10-13 19:33:08.905087 | controller | BGP_PEER_ASN: '64999' 2025-10-13 19:33:08.905093 | controller | BGP_SOURCE_IP: 172.30.4.2 2025-10-13 19:33:08.905099 | controller | BGP_SOURCE_IP6: f00d:f00d:f00d:f00d:f00d:f00d:f00d:42 2025-10-13 19:33:08.905105 | controller | BMAAS_BRIDGE_IPV4_PREFIX: 172.20.1.2/24 2025-10-13 19:33:08.905111 | controller | BMAAS_BRIDGE_IPV6_PREFIX: fd00:bbbb::2/64 2025-10-13 19:33:08.905116 | controller | BMAAS_INSTANCE_DISK_SIZE: '20' 2025-10-13 19:33:08.905122 | controller | BMAAS_INSTANCE_MEMORY: '4096' 2025-10-13 19:33:08.905128 | controller | BMAAS_INSTANCE_NAME_PREFIX: crc-bmaas 2025-10-13 19:33:08.905137 | controller | BMAAS_INSTANCE_NET_MODEL: virtio 2025-10-13 19:33:08.905143 | controller | BMAAS_INSTANCE_OS_VARIANT: centos-stream9 2025-10-13 19:33:08.905149 | controller | BMAAS_INSTANCE_VCPUS: '2' 2025-10-13 19:33:08.905155 | controller | BMAAS_INSTANCE_VIRT_TYPE: kvm 2025-10-13 19:33:08.905160 | controller | BMAAS_IPV4: 'true' 2025-10-13 19:33:08.905166 | controller | BMAAS_IPV6: 'false' 2025-10-13 19:33:08.905172 | controller | BMAAS_LIBVIRT_USER: sushyemu 2025-10-13 19:33:08.905178 | controller | BMAAS_METALLB_ADDRESS_POOL: 172.20.1.64/26 2025-10-13 19:33:08.905184 | controller | BMAAS_METALLB_POOL_NAME: baremetal 2025-10-13 19:33:08.905190 | controller | BMAAS_NETWORK_IPV4_PREFIX: 172.20.1.1/24 2025-10-13 19:33:08.905195 | controller | BMAAS_NETWORK_IPV6_PREFIX: fd00:bbbb::1/64 2025-10-13 19:33:08.905201 | controller | BMAAS_NETWORK_NAME: crc-bmaas 2025-10-13 19:33:08.905207 | controller | BMAAS_NODE_COUNT: '1' 2025-10-13 19:33:08.905213 | controller | BMAAS_OCP_INSTANCE_NAME: crc 2025-10-13 19:33:08.905218 | controller | BMAAS_REDFISH_PASSWORD: password 2025-10-13 19:33:08.905224 | controller | BMAAS_REDFISH_USERNAME: admin 2025-10-13 19:33:08.905230 | controller | BMAAS_ROUTE_LIBVIRT_NETWORKS: crc-bmaas,crc,default 2025-10-13 19:33:08.905236 | controller | BMAAS_SUSHY_EMULATOR_DRIVER: libvirt 2025-10-13 19:33:08.905241 | controller | BMAAS_SUSHY_EMULATOR_IMAGE: quay.io/metal3-io/sushy-tools:latest 2025-10-13 19:33:08.905247 | controller | BMAAS_SUSHY_EMULATOR_NAMESPACE: sushy-emulator 2025-10-13 19:33:08.905253 | controller | BMAAS_SUSHY_EMULATOR_OS_CLIENT_CONFIG_FILE: /etc/openstack/clouds.yaml 2025-10-13 19:33:08.905259 | controller | BMAAS_SUSHY_EMULATOR_OS_CLOUD: openstack 2025-10-13 19:33:08.905265 | controller | BMH_NAMESPACE: openstack 2025-10-13 19:33:08.905270 | controller | BMO_BRANCH: release-0.9 2025-10-13 19:33:08.905276 | controller | BMO_COMMIT_HASH: '' 2025-10-13 19:33:08.905282 | controller | BMO_IPA_BRANCH: stable/2024.1 2025-10-13 19:33:08.905288 | controller | BMO_IRONIC_HOST: 192.168.122.10 2025-10-13 19:33:08.905294 | controller | BMO_PROVISIONING_INTERFACE: '' 2025-10-13 19:33:08.905299 | controller | BMO_REPO: https://github.com/metal3-io/baremetal-operator 2025-10-13 19:33:08.905305 | controller | BMO_SETUP: false 2025-10-13 19:33:08.905311 | controller | BMO_SETUP_ROUTE_REPLACE: 'true' 2025-10-13 19:33:08.905321 | controller | BM_CTLPLANE_INTERFACE: enp1s0 2025-10-13 19:33:08.905326 | controller | BM_INSTANCE_MEMORY: '8192' 2025-10-13 19:33:08.905332 | controller | BM_INSTANCE_NAME_PREFIX: edpm-compute-baremetal 2025-10-13 19:33:08.905338 | controller | BM_INSTANCE_NAME_SUFFIX: '0' 2025-10-13 19:33:08.905344 | controller | BM_NETWORK_NAME: default 2025-10-13 19:33:08.905353 | controller | BM_NODE_COUNT: '1' 2025-10-13 19:33:08.905359 | controller | BM_ROOT_PASSWORD: '' 2025-10-13 19:33:08.905364 | controller | BM_ROOT_PASSWORD_SECRET: '' 2025-10-13 19:33:08.905370 | controller | CEILOMETER_CENTRAL_DEPL_IMG: unused 2025-10-13 19:33:08.905376 | controller | CEILOMETER_NOTIFICATION_DEPL_IMG: unused 2025-10-13 19:33:08.905382 | controller | CEPH_BRANCH: release-1.15 2025-10-13 19:33:08.905388 | controller | CEPH_CLIENT: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/toolbox.yaml 2025-10-13 19:33:08.905413 | controller | CEPH_COMMON: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/common.yaml 2025-10-13 19:33:08.905419 | controller | CEPH_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/cluster-test.yaml 2025-10-13 19:33:08.905424 | controller | CEPH_CRDS: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/crds.yaml 2025-10-13 19:33:08.905430 | controller | CEPH_IMG: quay.io/ceph/demo:latest-squid 2025-10-13 19:33:08.905436 | controller | CEPH_OP: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/operator-openshift.yaml 2025-10-13 19:33:08.905442 | controller | CEPH_REPO: https://github.com/rook/rook.git 2025-10-13 19:33:08.905448 | controller | CERTMANAGER_TIMEOUT: 300s 2025-10-13 19:33:08.905453 | controller | CHECKOUT_FROM_OPENSTACK_REF: 'true' 2025-10-13 19:33:08.905459 | controller | CINDER: config/samples/cinder_v1beta1_cinder.yaml 2025-10-13 19:33:08.905465 | controller | CINDERAPI_DEPL_IMG: unused 2025-10-13 19:33:08.905471 | controller | CINDERBKP_DEPL_IMG: unused 2025-10-13 19:33:08.905480 | controller | CINDERSCH_DEPL_IMG: unused 2025-10-13 19:33:08.905486 | controller | CINDERVOL_DEPL_IMG: unused 2025-10-13 19:33:08.905492 | controller | CINDER_BRANCH: main 2025-10-13 19:33:08.905498 | controller | CINDER_COMMIT_HASH: '' 2025-10-13 19:33:08.905503 | controller | CINDER_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/config/samples/cinder_v1beta1_cinder.yaml 2025-10-13 19:33:08.905509 | controller | CINDER_IMG: quay.io/openstack-k8s-operators/cinder-operator-index:latest 2025-10-13 19:33:08.905515 | controller | CINDER_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/kuttl-test.yaml 2025-10-13 19:33:08.905521 | controller | CINDER_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/test/kuttl/tests 2025-10-13 19:33:08.905527 | controller | CINDER_KUTTL_NAMESPACE: cinder-kuttl-tests 2025-10-13 19:33:08.905533 | controller | CINDER_REPO: https://github.com/openstack-k8s-operators/cinder-operator.git 2025-10-13 19:33:08.905538 | controller | CLEANUP_DIR_CMD: rm -Rf 2025-10-13 19:33:08.905544 | controller | CRC_BGP_NIC_1_MAC: '52:54:00:11:11:11' 2025-10-13 19:33:08.905550 | controller | CRC_BGP_NIC_2_MAC: '52:54:00:11:11:12' 2025-10-13 19:33:08.905556 | controller | CRC_HTTPS_PROXY: '' 2025-10-13 19:33:08.905561 | controller | CRC_HTTP_PROXY: '' 2025-10-13 19:33:08.905567 | controller | CRC_STORAGE_NAMESPACE: crc-storage 2025-10-13 19:33:08.905573 | controller | CRC_STORAGE_RETRIES: '3' 2025-10-13 19:33:08.905579 | controller | CRC_URL: '''https://developers.redhat.com/content-gateway/rest/mirror/pub/openshift-v4/clients/crc/latest/crc-linux-amd64.tar.xz''' 2025-10-13 19:33:08.905584 | controller | CRC_VERSION: latest 2025-10-13 19:33:08.905590 | controller | DATAPLANE_ANSIBLE_SECRET: dataplane-ansible-ssh-private-key-secret 2025-10-13 19:33:08.905596 | controller | DATAPLANE_ANSIBLE_USER: '' 2025-10-13 19:33:08.905602 | controller | DATAPLANE_COMPUTE_IP: 192.168.122.100 2025-10-13 19:33:08.905619 | controller | DATAPLANE_CONTAINER_PREFIX: openstack 2025-10-13 19:33:08.905625 | controller | DATAPLANE_CONTAINER_TAG: current-podified 2025-10-13 19:33:08.905631 | controller | DATAPLANE_CUSTOM_SERVICE_RUNNER_IMG: quay.io/openstack-k8s-operators/openstack-ansibleee-runner:latest 2025-10-13 19:33:08.905637 | controller | DATAPLANE_DEFAULT_GW: 192.168.122.1 2025-10-13 19:33:08.905643 | controller | DATAPLANE_EXTRA_NOVA_CONFIG_FILE: /dev/null 2025-10-13 19:33:08.905648 | controller | DATAPLANE_GROWVOLS_ARGS: /=8GB /tmp=1GB /home=1GB /var=100% 2025-10-13 19:33:08.905654 | controller | DATAPLANE_KUSTOMIZE_SCENARIO: preprovisioned 2025-10-13 19:33:08.905660 | controller | DATAPLANE_NETWORKER_IP: 192.168.122.200 2025-10-13 19:33:08.905666 | controller | DATAPLANE_NETWORK_INTERFACE_NAME: eth0 2025-10-13 19:33:08.905671 | controller | DATAPLANE_NOVA_NFS_PATH: '' 2025-10-13 19:33:08.905677 | controller | DATAPLANE_NTP_SERVER: pool.ntp.org 2025-10-13 19:33:08.905683 | controller | DATAPLANE_PLAYBOOK: osp.edpm.download_cache 2025-10-13 19:33:08.905689 | controller | DATAPLANE_REGISTRY_URL: quay.io/podified-antelope-centos9 2025-10-13 19:33:08.905694 | controller | DATAPLANE_RUNNER_IMG: '' 2025-10-13 19:33:08.905700 | controller | DATAPLANE_SERVER_ROLE: compute 2025-10-13 19:33:08.905706 | controller | DATAPLANE_SSHD_ALLOWED_RANGES: '[''192.168.122.0/24'']' 2025-10-13 19:33:08.905711 | controller | DATAPLANE_TIMEOUT: 30m 2025-10-13 19:33:08.905717 | controller | DATAPLANE_TLS_ENABLED: 'true' 2025-10-13 19:33:08.905723 | controller | DATAPLANE_TOTAL_NETWORKER_NODES: '1' 2025-10-13 19:33:08.905729 | controller | DATAPLANE_TOTAL_NODES: '1' 2025-10-13 19:33:08.905734 | controller | DBSERVICE: galera 2025-10-13 19:33:08.905740 | controller | DESIGNATE: config/samples/designate_v1beta1_designate.yaml 2025-10-13 19:33:08.905746 | controller | DESIGNATE_BRANCH: main 2025-10-13 19:33:08.905752 | controller | DESIGNATE_COMMIT_HASH: '' 2025-10-13 19:33:08.905758 | controller | DESIGNATE_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/config/samples/designate_v1beta1_designate.yaml 2025-10-13 19:33:08.905763 | controller | DESIGNATE_IMG: quay.io/openstack-k8s-operators/designate-operator-index:latest 2025-10-13 19:33:08.905769 | controller | DESIGNATE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/kuttl-test.yaml 2025-10-13 19:33:08.905778 | controller | DESIGNATE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/tests/kuttl/tests 2025-10-13 19:33:08.905788 | controller | DESIGNATE_KUTTL_NAMESPACE: designate-kuttl-tests 2025-10-13 19:33:08.905794 | controller | DESIGNATE_REPO: https://github.com/openstack-k8s-operators/designate-operator.git 2025-10-13 19:33:08.905800 | controller | DNSDATA: config/samples/network_v1beta1_dnsdata.yaml 2025-10-13 19:33:08.905805 | controller | DNSDATA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_dnsdata.yaml 2025-10-13 19:33:08.905811 | controller | DNSMASQ: config/samples/network_v1beta1_dnsmasq.yaml 2025-10-13 19:33:08.905817 | controller | DNSMASQ_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_dnsmasq.yaml 2025-10-13 19:33:08.905823 | controller | DNS_DEPL_IMG: unused 2025-10-13 19:33:08.905829 | controller | DNS_DOMAIN: localdomain 2025-10-13 19:33:08.905834 | controller | DOWNLOAD_TOOLS_SELECTION: all 2025-10-13 19:33:08.905840 | controller | EDPM_ATTACH_EXTNET: 'true' 2025-10-13 19:33:08.905846 | controller | EDPM_COMPUTE_ADDITIONAL_HOST_ROUTES: '''[]''' 2025-10-13 19:33:08.905852 | controller | EDPM_COMPUTE_ADDITIONAL_NETWORKS: '''[]''' 2025-10-13 19:33:08.905857 | controller | EDPM_COMPUTE_CELLS: '1' 2025-10-13 19:33:08.905863 | controller | EDPM_COMPUTE_CEPH_ENABLED: 'true' 2025-10-13 19:33:08.905869 | controller | EDPM_COMPUTE_CEPH_NOVA: 'true' 2025-10-13 19:33:08.905875 | controller | EDPM_COMPUTE_DHCP_AGENT_ENABLED: 'true' 2025-10-13 19:33:08.905882 | controller | EDPM_COMPUTE_SRIOV_ENABLED: 'true' 2025-10-13 19:33:08.905889 | controller | EDPM_COMPUTE_SUFFIX: '0' 2025-10-13 19:33:08.905895 | controller | EDPM_CONFIGURE_DEFAULT_ROUTE: 'true' 2025-10-13 19:33:08.905901 | controller | EDPM_CONFIGURE_HUGEPAGES: 'false' 2025-10-13 19:33:08.905907 | controller | EDPM_CONFIGURE_NETWORKING: 'true' 2025-10-13 19:33:08.905913 | controller | EDPM_FIRSTBOOT_EXTRA: /tmp/edpm-firstboot-extra 2025-10-13 19:33:08.905918 | controller | EDPM_NETWORKER_SUFFIX: '0' 2025-10-13 19:33:08.905924 | controller | EDPM_TOTAL_NETWORKERS: '1' 2025-10-13 19:33:08.905930 | controller | EDPM_TOTAL_NODES: '1' 2025-10-13 19:33:08.905936 | controller | GALERA_REPLICAS: '' 2025-10-13 19:33:08.905942 | controller | GENERATE_SSH_KEYS: 'true' 2025-10-13 19:33:08.905948 | controller | GIT_CLONE_OPTS: '' 2025-10-13 19:33:08.905953 | controller | GLANCE: config/samples/glance_v1beta1_glance.yaml 2025-10-13 19:33:08.905959 | controller | GLANCEAPI_DEPL_IMG: unused 2025-10-13 19:33:08.905965 | controller | GLANCE_BRANCH: main 2025-10-13 19:33:08.905974 | controller | GLANCE_COMMIT_HASH: '' 2025-10-13 19:33:08.905981 | controller | GLANCE_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/config/samples/glance_v1beta1_glance.yaml 2025-10-13 19:33:08.905987 | controller | GLANCE_IMG: quay.io/openstack-k8s-operators/glance-operator-index:latest 2025-10-13 19:33:08.905993 | controller | GLANCE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/kuttl-test.yaml 2025-10-13 19:33:08.905999 | controller | GLANCE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/test/kuttl/tests 2025-10-13 19:33:08.906005 | controller | GLANCE_KUTTL_NAMESPACE: glance-kuttl-tests 2025-10-13 19:33:08.906011 | controller | GLANCE_REPO: https://github.com/openstack-k8s-operators/glance-operator.git 2025-10-13 19:33:08.906016 | controller | HEAT: config/samples/heat_v1beta1_heat.yaml 2025-10-13 19:33:08.906022 | controller | HEATAPI_DEPL_IMG: unused 2025-10-13 19:33:08.906028 | controller | HEATCFNAPI_DEPL_IMG: unused 2025-10-13 19:33:08.906034 | controller | HEATENGINE_DEPL_IMG: unused 2025-10-13 19:33:08.906040 | controller | HEAT_AUTH_ENCRYPTION_KEY: 767c3ed056cbaa3b9dfedb8c6f825bf0 2025-10-13 19:33:08.906046 | controller | HEAT_BRANCH: main 2025-10-13 19:33:08.906051 | controller | HEAT_COMMIT_HASH: '' 2025-10-13 19:33:08.906057 | controller | HEAT_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/config/samples/heat_v1beta1_heat.yaml 2025-10-13 19:33:08.906063 | controller | HEAT_IMG: quay.io/openstack-k8s-operators/heat-operator-index:latest 2025-10-13 19:33:08.906073 | controller | HEAT_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/kuttl-test.yaml 2025-10-13 19:33:08.906080 | controller | HEAT_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/tests/kuttl/tests 2025-10-13 19:33:08.906085 | controller | HEAT_KUTTL_NAMESPACE: heat-kuttl-tests 2025-10-13 19:33:08.906091 | controller | HEAT_REPO: https://github.com/openstack-k8s-operators/heat-operator.git 2025-10-13 19:33:08.906097 | controller | HEAT_SERVICE_ENABLED: 'true' 2025-10-13 19:33:08.906103 | controller | HORIZON: config/samples/horizon_v1beta1_horizon.yaml 2025-10-13 19:33:08.906109 | controller | HORIZON_BRANCH: main 2025-10-13 19:33:08.906115 | controller | HORIZON_COMMIT_HASH: '' 2025-10-13 19:33:08.906121 | controller | HORIZON_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/config/samples/horizon_v1beta1_horizon.yaml 2025-10-13 19:33:08.906126 | controller | HORIZON_DEPL_IMG: unused 2025-10-13 19:33:08.906132 | controller | HORIZON_IMG: quay.io/openstack-k8s-operators/horizon-operator-index:latest 2025-10-13 19:33:08.906138 | controller | HORIZON_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/kuttl-test.yaml 2025-10-13 19:33:08.906156 | controller | HORIZON_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/tests/kuttl/tests 2025-10-13 19:33:08.906162 | controller | HORIZON_KUTTL_NAMESPACE: horizon-kuttl-tests 2025-10-13 19:33:08.906168 | controller | HORIZON_REPO: https://github.com/openstack-k8s-operators/horizon-operator.git 2025-10-13 19:33:08.906174 | controller | INFRA_BRANCH: main 2025-10-13 19:33:08.906180 | controller | INFRA_COMMIT_HASH: '' 2025-10-13 19:33:08.906186 | controller | INFRA_IMG: quay.io/openstack-k8s-operators/infra-operator-index:latest 2025-10-13 19:33:08.906192 | controller | INFRA_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/kuttl-test.yaml 2025-10-13 19:33:08.906198 | controller | INFRA_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/tests/kuttl/tests 2025-10-13 19:33:08.906203 | controller | INFRA_KUTTL_NAMESPACE: infra-kuttl-tests 2025-10-13 19:33:08.906209 | controller | INFRA_REPO: https://github.com/openstack-k8s-operators/infra-operator.git 2025-10-13 19:33:08.906218 | controller | INSTALL_CERT_MANAGER: 'true' 2025-10-13 19:33:08.906224 | controller | INSTALL_NMSTATE: true || false 2025-10-13 19:33:08.906230 | controller | INSTALL_NNCP: true || false 2025-10-13 19:33:08.906235 | controller | INTERNALAPI_HOST_ROUTES: '' 2025-10-13 19:33:08.906241 | controller | IPV6_LAB_IPV4_NETWORK_IPADDRESS: 172.30.0.1/24 2025-10-13 19:33:08.906247 | controller | IPV6_LAB_IPV6_NETWORK_IPADDRESS: fd00:abcd:abcd:fc00::1/64 2025-10-13 19:33:08.906253 | controller | IPV6_LAB_LIBVIRT_STORAGE_POOL: default 2025-10-13 19:33:08.906259 | controller | IPV6_LAB_MANAGE_FIREWALLD: 'true' 2025-10-13 19:33:08.906264 | controller | IPV6_LAB_NAT64_HOST_IPV4: 172.30.0.2/24 2025-10-13 19:33:08.906270 | controller | IPV6_LAB_NAT64_HOST_IPV6: fd00:abcd:abcd:fc00::2/64 2025-10-13 19:33:08.906276 | controller | IPV6_LAB_NAT64_INSTANCE_NAME: nat64-router 2025-10-13 19:33:08.906282 | controller | IPV6_LAB_NAT64_IPV6_NETWORK: fd00:abcd:abcd:fc00::/64 2025-10-13 19:33:08.906289 | controller | IPV6_LAB_NAT64_TAYGA_DYNAMIC_POOL: 192.168.255.0/24 2025-10-13 19:33:08.906295 | controller | IPV6_LAB_NAT64_TAYGA_IPV4: 192.168.255.1 2025-10-13 19:33:08.906301 | controller | IPV6_LAB_NAT64_TAYGA_IPV6: fd00:abcd:abcd:fc00::3 2025-10-13 19:33:08.906306 | controller | IPV6_LAB_NAT64_TAYGA_IPV6_PREFIX: fd00:abcd:abcd:fcff::/96 2025-10-13 19:33:08.906312 | controller | IPV6_LAB_NAT64_UPDATE_PACKAGES: 'false' 2025-10-13 19:33:08.906318 | controller | IPV6_LAB_NETWORK_NAME: nat64 2025-10-13 19:33:08.906324 | controller | IPV6_LAB_SNO_CLUSTER_NETWORK: fd00:abcd:0::/48 2025-10-13 19:33:08.906329 | controller | IPV6_LAB_SNO_HOST_IP: fd00:abcd:abcd:fc00::11 2025-10-13 19:33:08.906335 | controller | IPV6_LAB_SNO_HOST_PREFIX: '64' 2025-10-13 19:33:08.906341 | controller | IPV6_LAB_SNO_INSTANCE_NAME: sno 2025-10-13 19:33:08.906347 | controller | IPV6_LAB_SNO_MACHINE_NETWORK: fd00:abcd:abcd:fc00::/64 2025-10-13 19:33:08.906352 | controller | IPV6_LAB_SNO_OCP_MIRROR_URL: https://mirror.openshift.com/pub/openshift-v4/clients/ocp 2025-10-13 19:33:08.906362 | controller | IPV6_LAB_SNO_OCP_VERSION: latest-4.14 2025-10-13 19:33:08.906369 | controller | IPV6_LAB_SNO_SERVICE_NETWORK: fd00:abcd:abcd:fc03::/112 2025-10-13 19:33:08.906375 | controller | IPV6_LAB_SSH_PUB_KEY: /home/zuul/.ssh/id_rsa.pub 2025-10-13 19:33:08.906380 | controller | IPV6_LAB_WORK_DIR: /home/zuul/.ipv6lab 2025-10-13 19:33:08.906386 | controller | IRONIC: config/samples/ironic_v1beta1_ironic.yaml 2025-10-13 19:33:08.906413 | controller | IRONICAPI_DEPL_IMG: unused 2025-10-13 19:33:08.906419 | controller | IRONICCON_DEPL_IMG: unused 2025-10-13 19:33:08.906425 | controller | IRONICINS_DEPL_IMG: unused 2025-10-13 19:33:08.906430 | controller | IRONICNAG_DEPL_IMG: unused 2025-10-13 19:33:08.906436 | controller | IRONICPXE_DEPL_IMG: unused 2025-10-13 19:33:08.906442 | controller | IRONIC_BRANCH: main 2025-10-13 19:33:08.906448 | controller | IRONIC_COMMIT_HASH: '' 2025-10-13 19:33:08.906453 | controller | IRONIC_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/config/samples/ironic_v1beta1_ironic.yaml 2025-10-13 19:33:08.906459 | controller | IRONIC_IMAGE_TAG: release-24.1 2025-10-13 19:33:08.906465 | controller | IRONIC_IMG: quay.io/openstack-k8s-operators/ironic-operator-index:latest 2025-10-13 19:33:08.906471 | controller | IRONIC_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/kuttl-test.yaml 2025-10-13 19:33:08.906477 | controller | IRONIC_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/tests/kuttl/tests 2025-10-13 19:33:08.906482 | controller | IRONIC_KUTTL_NAMESPACE: ironic-kuttl-tests 2025-10-13 19:33:08.906488 | controller | IRONIC_REPO: https://github.com/openstack-k8s-operators/ironic-operator.git 2025-10-13 19:33:08.906494 | controller | KEYSTONEAPI: config/samples/keystone_v1beta1_keystoneapi.yaml 2025-10-13 19:33:08.906500 | controller | KEYSTONEAPI_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/config/samples/keystone_v1beta1_keystoneapi.yaml 2025-10-13 19:33:08.906508 | controller | KEYSTONEAPI_DEPL_IMG: unused 2025-10-13 19:33:08.906516 | controller | KEYSTONE_BRANCH: main 2025-10-13 19:33:08.906522 | controller | KEYSTONE_COMMIT_HASH: '' 2025-10-13 19:33:08.906528 | controller | KEYSTONE_FEDERATION_CLIENT_SECRET: COX8bmlKAWn56XCGMrKQJj7dgHNAOl6f 2025-10-13 19:33:08.906534 | controller | KEYSTONE_FEDERATION_CRYPTO_PASSPHRASE: openstack 2025-10-13 19:33:08.906540 | controller | KEYSTONE_IMG: quay.io/openstack-k8s-operators/keystone-operator-index:latest 2025-10-13 19:33:08.906546 | controller | KEYSTONE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/kuttl-test.yaml 2025-10-13 19:33:08.906552 | controller | KEYSTONE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/tests/kuttl/tests 2025-10-13 19:33:08.906557 | controller | KEYSTONE_KUTTL_NAMESPACE: keystone-kuttl-tests 2025-10-13 19:33:08.906563 | controller | KEYSTONE_REPO: https://github.com/openstack-k8s-operators/keystone-operator.git 2025-10-13 19:33:08.906569 | controller | KUBEADMIN_PWD: '12345678' 2025-10-13 19:33:08.906575 | controller | LIBVIRT_SECRET: libvirt-secret 2025-10-13 19:33:08.906581 | controller | LOKI_DEPLOY_MODE: openshift-network 2025-10-13 19:33:08.906586 | controller | LOKI_DEPLOY_NAMESPACE: netobserv 2025-10-13 19:33:08.906592 | controller | LOKI_DEPLOY_SIZE: 1x.demo 2025-10-13 19:33:08.906598 | controller | LOKI_NAMESPACE: openshift-operators-redhat 2025-10-13 19:33:08.906604 | controller | LOKI_OPERATOR_GROUP: openshift-operators-redhat-loki 2025-10-13 19:33:08.906610 | controller | LOKI_SUBSCRIPTION: loki-operator 2025-10-13 19:33:08.906615 | controller | LVMS_CR: '1' 2025-10-13 19:33:08.906621 | controller | MANILA: config/samples/manila_v1beta1_manila.yaml 2025-10-13 19:33:08.906627 | controller | MANILAAPI_DEPL_IMG: unused 2025-10-13 19:33:08.906633 | controller | MANILASCH_DEPL_IMG: unused 2025-10-13 19:33:08.906638 | controller | MANILASHARE_DEPL_IMG: unused 2025-10-13 19:33:08.906644 | controller | MANILA_BRANCH: main 2025-10-13 19:33:08.906650 | controller | MANILA_COMMIT_HASH: '' 2025-10-13 19:33:08.906656 | controller | MANILA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/config/samples/manila_v1beta1_manila.yaml 2025-10-13 19:33:08.906665 | controller | MANILA_IMG: quay.io/openstack-k8s-operators/manila-operator-index:latest 2025-10-13 19:33:08.906671 | controller | MANILA_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/kuttl-test.yaml 2025-10-13 19:33:08.906680 | controller | MANILA_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/test/kuttl/tests 2025-10-13 19:33:08.906686 | controller | MANILA_KUTTL_NAMESPACE: manila-kuttl-tests 2025-10-13 19:33:08.906692 | controller | MANILA_REPO: https://github.com/openstack-k8s-operators/manila-operator.git 2025-10-13 19:33:08.906698 | controller | MANILA_SERVICE_ENABLED: 'true' 2025-10-13 19:33:08.906704 | controller | MARIADB: config/samples/mariadb_v1beta1_galera.yaml 2025-10-13 19:33:08.906709 | controller | MARIADB_BRANCH: main 2025-10-13 19:33:08.906715 | controller | MARIADB_CHAINSAW_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/chainsaw/config.yaml 2025-10-13 19:33:08.906721 | controller | MARIADB_CHAINSAW_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/chainsaw/tests 2025-10-13 19:33:08.906727 | controller | MARIADB_CHAINSAW_NAMESPACE: mariadb-chainsaw-tests 2025-10-13 19:33:08.906733 | controller | MARIADB_COMMIT_HASH: '' 2025-10-13 19:33:08.906739 | controller | MARIADB_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/config/samples/mariadb_v1beta1_galera.yaml 2025-10-13 19:33:08.906744 | controller | MARIADB_DEPL_IMG: unused 2025-10-13 19:33:08.906750 | controller | MARIADB_IMG: quay.io/openstack-k8s-operators/mariadb-operator-index:latest 2025-10-13 19:33:08.906756 | controller | MARIADB_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/kuttl-test.yaml 2025-10-13 19:33:08.906762 | controller | MARIADB_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/kuttl/tests 2025-10-13 19:33:08.906767 | controller | MARIADB_KUTTL_NAMESPACE: mariadb-kuttl-tests 2025-10-13 19:33:08.906773 | controller | MARIADB_REPO: https://github.com/openstack-k8s-operators/mariadb-operator.git 2025-10-13 19:33:08.906779 | controller | MEMCACHED: config/samples/memcached_v1beta1_memcached.yaml 2025-10-13 19:33:08.906785 | controller | MEMCACHED_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/memcached_v1beta1_memcached.yaml 2025-10-13 19:33:08.906791 | controller | MEMCACHED_DEPL_IMG: unused 2025-10-13 19:33:08.906796 | controller | METADATA_SHARED_SECRET: '1234567842' 2025-10-13 19:33:08.906804 | controller | METALLB_IPV6_POOL: fd00:aaaa::80-fd00:aaaa::90 2025-10-13 19:33:08.906812 | controller | METALLB_POOL: 192.168.122.80-192.168.122.90 2025-10-13 19:33:08.906818 | controller | MICROSHIFT: '0' 2025-10-13 19:33:08.906824 | controller | NAMESPACE: openstack 2025-10-13 19:33:08.906830 | controller | NETCONFIG: config/samples/network_v1beta1_netconfig.yaml 2025-10-13 19:33:08.906835 | controller | NETCONFIG_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_netconfig.yaml 2025-10-13 19:33:08.906841 | controller | NETCONFIG_DEPL_IMG: unused 2025-10-13 19:33:08.906847 | controller | NETOBSERV_DEPLOY_NAMESPACE: netobserv 2025-10-13 19:33:08.906853 | controller | NETOBSERV_NAMESPACE: openshift-netobserv-operator 2025-10-13 19:33:08.906859 | controller | NETOBSERV_OPERATOR_GROUP: openshift-netobserv-operator-net 2025-10-13 19:33:08.906864 | controller | NETOBSERV_SUBSCRIPTION: netobserv-operator 2025-10-13 19:33:08.906870 | controller | NETWORK_BGP: 'false' 2025-10-13 19:33:08.906876 | controller | NETWORK_DESIGNATE_ADDRESS_PREFIX: 172.28.0 2025-10-13 19:33:08.906882 | controller | NETWORK_DESIGNATE_EXT_ADDRESS_PREFIX: 172.50.0 2025-10-13 19:33:08.906888 | controller | NETWORK_INTERNALAPI_ADDRESS_PREFIX: 172.17.0 2025-10-13 19:33:08.906893 | controller | NETWORK_ISOLATION: 'true' 2025-10-13 19:33:08.906899 | controller | NETWORK_ISOLATION_INSTANCE_NAME: crc 2025-10-13 19:33:08.906905 | controller | NETWORK_ISOLATION_IPV4: 'true' 2025-10-13 19:33:08.906911 | controller | NETWORK_ISOLATION_IPV4_ADDRESS: 172.16.1.1/24 2025-10-13 19:33:08.906916 | controller | NETWORK_ISOLATION_IPV4_NAT: 'true' 2025-10-13 19:33:08.906922 | controller | NETWORK_ISOLATION_IPV6: 'false' 2025-10-13 19:33:08.906934 | controller | NETWORK_ISOLATION_IPV6_ADDRESS: fd00:aaaa::1/64 2025-10-13 19:33:08.906940 | controller | NETWORK_ISOLATION_IP_ADDRESS: 192.168.122.10 2025-10-13 19:33:08.906946 | controller | NETWORK_ISOLATION_MAC: '52:54:00:11:11:10' 2025-10-13 19:33:08.906951 | controller | NETWORK_ISOLATION_NETWORK_NAME: net-iso 2025-10-13 19:33:08.906957 | controller | NETWORK_ISOLATION_NET_NAME: default 2025-10-13 19:33:08.906963 | controller | NETWORK_ISOLATION_USE_DEFAULT_NETWORK: 'true' 2025-10-13 19:33:08.906969 | controller | NETWORK_MTU: '1500' 2025-10-13 19:33:08.906974 | controller | NETWORK_STORAGEMGMT_ADDRESS_PREFIX: 172.20.0 2025-10-13 19:33:08.906980 | controller | NETWORK_STORAGE_ADDRESS_PREFIX: 172.18.0 2025-10-13 19:33:08.906999 | controller | NETWORK_STORAGE_MACVLAN: '' 2025-10-13 19:33:08.907007 | controller | NETWORK_TENANT_ADDRESS_PREFIX: 172.19.0 2025-10-13 19:33:08.907013 | controller | NETWORK_VLAN_START: '20' 2025-10-13 19:33:08.907019 | controller | NETWORK_VLAN_STEP: '1' 2025-10-13 19:33:08.907024 | controller | NEUTRONAPI: config/samples/neutron_v1beta1_neutronapi.yaml 2025-10-13 19:33:08.907030 | controller | NEUTRONAPI_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/config/samples/neutron_v1beta1_neutronapi.yaml 2025-10-13 19:33:08.907036 | controller | NEUTRONAPI_DEPL_IMG: unused 2025-10-13 19:33:08.907042 | controller | NEUTRON_BRANCH: main 2025-10-13 19:33:08.907047 | controller | NEUTRON_COMMIT_HASH: '' 2025-10-13 19:33:08.907053 | controller | NEUTRON_IMG: quay.io/openstack-k8s-operators/neutron-operator-index:latest 2025-10-13 19:33:08.907059 | controller | NEUTRON_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/kuttl-test.yaml 2025-10-13 19:33:08.907065 | controller | NEUTRON_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/test/kuttl/tests 2025-10-13 19:33:08.907071 | controller | NEUTRON_KUTTL_NAMESPACE: neutron-kuttl-tests 2025-10-13 19:33:08.907076 | controller | NEUTRON_REPO: https://github.com/openstack-k8s-operators/neutron-operator.git 2025-10-13 19:33:08.907084 | controller | NFS_HOME: /home/nfs 2025-10-13 19:33:08.907090 | controller | NMSTATE_NAMESPACE: openshift-nmstate 2025-10-13 19:33:08.907095 | controller | NMSTATE_OPERATOR_GROUP: openshift-nmstate-tn6k8 2025-10-13 19:33:08.907101 | controller | NMSTATE_SUBSCRIPTION: kubernetes-nmstate-operator 2025-10-13 19:33:08.907110 | controller | NNCP_ADDITIONAL_HOST_ROUTES: '' 2025-10-13 19:33:08.907116 | controller | NNCP_BGP_1_INTERFACE: enp7s0 2025-10-13 19:33:08.907121 | controller | NNCP_BGP_1_IP_ADDRESS: 100.65.4.2 2025-10-13 19:33:08.907127 | controller | NNCP_BGP_2_INTERFACE: enp8s0 2025-10-13 19:33:08.907133 | controller | NNCP_BGP_2_IP_ADDRESS: 100.64.4.2 2025-10-13 19:33:08.907139 | controller | NNCP_BRIDGE: ospbr 2025-10-13 19:33:08.907144 | controller | NNCP_CLEANUP_TIMEOUT: 120s 2025-10-13 19:33:08.907150 | controller | NNCP_CTLPLANE_IPV6_ADDRESS_PREFIX: 'fd00:aaaa::' 2025-10-13 19:33:08.907156 | controller | NNCP_CTLPLANE_IPV6_ADDRESS_SUFFIX: '10' 2025-10-13 19:33:08.907162 | controller | NNCP_CTLPLANE_IP_ADDRESS_PREFIX: 192.168.122 2025-10-13 19:33:08.907167 | controller | NNCP_CTLPLANE_IP_ADDRESS_SUFFIX: '10' 2025-10-13 19:33:08.907173 | controller | NNCP_DNS_SERVER: 192.168.122.1 2025-10-13 19:33:08.907179 | controller | NNCP_DNS_SERVER_IPV6: fd00:aaaa::1 2025-10-13 19:33:08.907184 | controller | NNCP_GATEWAY: 192.168.122.1 2025-10-13 19:33:08.907190 | controller | NNCP_GATEWAY_IPV6: fd00:aaaa::1 2025-10-13 19:33:08.907196 | controller | NNCP_INTERFACE: enp6s0 2025-10-13 19:33:08.907202 | controller | NNCP_NODES: '' 2025-10-13 19:33:08.907207 | controller | NNCP_TIMEOUT: 240s 2025-10-13 19:33:08.907213 | controller | NOVA: config/samples/nova_v1beta1_nova_collapsed_cell.yaml 2025-10-13 19:33:08.907219 | controller | NOVA_BRANCH: main 2025-10-13 19:33:08.907225 | controller | NOVA_COMMIT_HASH: '' 2025-10-13 19:33:08.907230 | controller | NOVA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/nova-operator/config/samples/nova_v1beta1_nova_collapsed_cell.yaml 2025-10-13 19:33:08.907236 | controller | NOVA_IMG: quay.io/openstack-k8s-operators/nova-operator-index:latest 2025-10-13 19:33:08.907242 | controller | NOVA_REPO: https://github.com/openstack-k8s-operators/nova-operator.git 2025-10-13 19:33:08.907248 | controller | NUMBER_OF_INSTANCES: '1' 2025-10-13 19:33:08.907257 | controller | OCP_NETWORK_NAME: crc 2025-10-13 19:33:08.907262 | controller | OCTAVIA: config/samples/octavia_v1beta1_octavia.yaml 2025-10-13 19:33:08.907268 | controller | OCTAVIA_BRANCH: main 2025-10-13 19:33:08.907274 | controller | OCTAVIA_COMMIT_HASH: '' 2025-10-13 19:33:08.907280 | controller | OCTAVIA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/config/samples/octavia_v1beta1_octavia.yaml 2025-10-13 19:33:08.907286 | controller | OCTAVIA_IMG: quay.io/openstack-k8s-operators/octavia-operator-index:latest 2025-10-13 19:33:08.907291 | controller | OCTAVIA_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/kuttl-test.yaml 2025-10-13 19:33:08.907297 | controller | OCTAVIA_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/tests/kuttl/tests 2025-10-13 19:33:08.907303 | controller | OCTAVIA_KUTTL_NAMESPACE: octavia-kuttl-tests 2025-10-13 19:33:08.907309 | controller | OCTAVIA_REPO: https://github.com/openstack-k8s-operators/octavia-operator.git 2025-10-13 19:33:08.907315 | controller | OKD: 'false' 2025-10-13 19:33:08.907320 | controller | OPENSTACK_BRANCH: main 2025-10-13 19:33:08.907326 | controller | OPENSTACK_BUNDLE_IMG: quay.io/openstack-k8s-operators/openstack-operator-bundle:latest 2025-10-13 19:33:08.907332 | controller | OPENSTACK_COMMIT_HASH: '' 2025-10-13 19:33:08.907338 | controller | OPENSTACK_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml 2025-10-13 19:33:08.907344 | controller | OPENSTACK_CRDS_DIR: openstack_crds 2025-10-13 19:33:08.907350 | controller | OPENSTACK_CTLPLANE: config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml 2025-10-13 19:33:08.907356 | controller | OPENSTACK_IMG: quay.io/openstack-k8s-operators/openstack-operator-index:latest 2025-10-13 19:33:08.907361 | controller | OPENSTACK_K8S_BRANCH: main 2025-10-13 19:33:08.907367 | controller | OPENSTACK_K8S_TAG: latest 2025-10-13 19:33:08.907373 | controller | OPENSTACK_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/kuttl-test.yaml 2025-10-13 19:33:08.907379 | controller | OPENSTACK_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 19:33:08.907385 | controller | OPENSTACK_KUTTL_NAMESPACE: openstack-kuttl-tests 2025-10-13 19:33:08.907408 | controller | OPENSTACK_NEUTRON_CUSTOM_CONF: '' 2025-10-13 19:33:08.907417 | controller | OPENSTACK_REPO: https://github.com/openstack-k8s-operators/openstack-operator.git 2025-10-13 19:33:08.907422 | controller | OPENSTACK_STORAGE_BUNDLE_IMG: quay.io/openstack-k8s-operators/openstack-operator-storage-bundle:latest 2025-10-13 19:33:08.907428 | controller | OPERATOR_BASE_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator 2025-10-13 19:33:08.907434 | controller | OPERATOR_CHANNEL: '' 2025-10-13 19:33:08.907440 | controller | OPERATOR_NAMESPACE: openstack-operators 2025-10-13 19:33:08.907446 | controller | OPERATOR_SOURCE: '' 2025-10-13 19:33:08.907451 | controller | OPERATOR_SOURCE_NAMESPACE: '' 2025-10-13 19:33:08.907457 | controller | OUT: /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 19:33:08.907463 | controller | OUTPUT_DIR: /home/zuul/ci-framework-data/artifacts/edpm 2025-10-13 19:33:08.907469 | controller | OVNCONTROLLER: config/samples/ovn_v1beta1_ovncontroller.yaml 2025-10-13 19:33:08.907476 | controller | OVNCONTROLLER_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovncontroller.yaml 2025-10-13 19:33:08.907482 | controller | OVNCONTROLLER_NMAP: 'true' 2025-10-13 19:33:08.907488 | controller | OVNDBS: config/samples/ovn_v1beta1_ovndbcluster.yaml 2025-10-13 19:33:08.907494 | controller | OVNDBS_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovndbcluster.yaml 2025-10-13 19:33:08.907499 | controller | OVNNORTHD: config/samples/ovn_v1beta1_ovnnorthd.yaml 2025-10-13 19:33:08.907511 | controller | OVNNORTHD_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovnnorthd.yaml 2025-10-13 19:33:08.907516 | controller | OVN_BRANCH: main 2025-10-13 19:33:08.907525 | controller | OVN_COMMIT_HASH: '' 2025-10-13 19:33:08.907531 | controller | OVN_IMG: quay.io/openstack-k8s-operators/ovn-operator-index:latest 2025-10-13 19:33:08.907540 | controller | OVN_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/kuttl-test.yaml 2025-10-13 19:33:08.916763 | controller | OVN_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/tests/kuttl/tests 2025-10-13 19:33:08.916790 | controller | OVN_KUTTL_NAMESPACE: ovn-kuttl-tests 2025-10-13 19:33:08.916798 | controller | OVN_REPO: https://github.com/openstack-k8s-operators/ovn-operator.git 2025-10-13 19:33:08.916812 | controller | PASSWORD: '12345678' 2025-10-13 19:33:08.916820 | controller | PLACEMENTAPI: config/samples/placement_v1beta1_placementapi.yaml 2025-10-13 19:33:08.916827 | controller | PLACEMENTAPI_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/config/samples/placement_v1beta1_placementapi.yaml 2025-10-13 19:33:08.916834 | controller | PLACEMENTAPI_DEPL_IMG: unused 2025-10-13 19:33:08.916840 | controller | PLACEMENT_BRANCH: main 2025-10-13 19:33:08.916846 | controller | PLACEMENT_COMMIT_HASH: '' 2025-10-13 19:33:08.916852 | controller | PLACEMENT_IMG: quay.io/openstack-k8s-operators/placement-operator-index:latest 2025-10-13 19:33:08.916858 | controller | PLACEMENT_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/kuttl-test.yaml 2025-10-13 19:33:08.916864 | controller | PLACEMENT_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/tests/kuttl/tests 2025-10-13 19:33:08.916869 | controller | PLACEMENT_KUTTL_NAMESPACE: placement-kuttl-tests 2025-10-13 19:33:08.916875 | controller | PLACEMENT_REPO: https://github.com/openstack-k8s-operators/placement-operator.git 2025-10-13 19:33:08.916881 | controller | PULL_SECRET: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/pull-secret.txt 2025-10-13 19:33:08.916887 | controller | RABBITMQ: docs/examples/default-security-context/rabbitmq.yaml 2025-10-13 19:33:08.916893 | controller | RABBITMQ_BRANCH: patches 2025-10-13 19:33:08.916898 | controller | RABBITMQ_COMMIT_HASH: '' 2025-10-13 19:33:08.916904 | controller | RABBITMQ_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/rabbitmq-operator/docs/examples/default-security-context/rabbitmq.yaml 2025-10-13 19:33:08.916910 | controller | RABBITMQ_DEPL_IMG: unused 2025-10-13 19:33:08.916916 | controller | RABBITMQ_IMG: quay.io/openstack-k8s-operators/rabbitmq-cluster-operator-index:latest 2025-10-13 19:33:08.916922 | controller | RABBITMQ_REPO: https://github.com/openstack-k8s-operators/rabbitmq-cluster-operator.git 2025-10-13 19:33:08.916928 | controller | REDHAT_OPERATORS: 'false' 2025-10-13 19:33:08.916934 | controller | REDIS: config/samples/redis_v1beta1_redis.yaml 2025-10-13 19:33:08.916939 | controller | REDIS_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator-redis/config/samples/redis_v1beta1_redis.yaml 2025-10-13 19:33:08.916946 | controller | REDIS_DEPL_IMG: unused 2025-10-13 19:33:08.916951 | controller | RH_REGISTRY_PWD: '' 2025-10-13 19:33:08.916957 | controller | RH_REGISTRY_USER: '' 2025-10-13 19:33:08.916963 | controller | SECRET: osp-secret 2025-10-13 19:33:08.916968 | controller | SG_CORE_DEPL_IMG: unused 2025-10-13 19:33:08.916974 | controller | STANDALONE_COMPUTE_DRIVER: libvirt 2025-10-13 19:33:08.916990 | controller | STANDALONE_EXTERNAL_NET_PREFFIX: 172.21.0 2025-10-13 19:33:08.916996 | controller | STANDALONE_INTERNALAPI_NET_PREFIX: 172.17.0 2025-10-13 19:33:08.917002 | controller | STANDALONE_STORAGEMGMT_NET_PREFIX: 172.20.0 2025-10-13 19:33:08.917008 | controller | STANDALONE_STORAGE_NET_PREFIX: 172.18.0 2025-10-13 19:33:08.917014 | controller | STANDALONE_TENANT_NET_PREFIX: 172.19.0 2025-10-13 19:33:08.917019 | controller | STORAGEMGMT_HOST_ROUTES: '' 2025-10-13 19:33:08.917025 | controller | STORAGE_CLASS: local-storage 2025-10-13 19:33:08.917031 | controller | STORAGE_HOST_ROUTES: '' 2025-10-13 19:33:08.917037 | controller | SWIFT: config/samples/swift_v1beta1_swift.yaml 2025-10-13 19:33:08.917042 | controller | SWIFT_BRANCH: main 2025-10-13 19:33:08.917048 | controller | SWIFT_COMMIT_HASH: '' 2025-10-13 19:33:08.917054 | controller | SWIFT_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/config/samples/swift_v1beta1_swift.yaml 2025-10-13 19:33:08.917064 | controller | SWIFT_IMG: quay.io/openstack-k8s-operators/swift-operator-index:latest 2025-10-13 19:33:08.917072 | controller | SWIFT_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/kuttl-test.yaml 2025-10-13 19:33:08.917078 | controller | SWIFT_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/tests/kuttl/tests 2025-10-13 19:33:08.917084 | controller | SWIFT_KUTTL_NAMESPACE: swift-kuttl-tests 2025-10-13 19:33:08.917090 | controller | SWIFT_REPO: https://github.com/openstack-k8s-operators/swift-operator.git 2025-10-13 19:33:08.917096 | controller | TELEMETRY: config/samples/telemetry_v1beta1_telemetry.yaml 2025-10-13 19:33:08.917101 | controller | TELEMETRY_BRANCH: main 2025-10-13 19:33:08.917107 | controller | TELEMETRY_COMMIT_HASH: '' 2025-10-13 19:33:08.917113 | controller | TELEMETRY_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator/config/samples/telemetry_v1beta1_telemetry.yaml 2025-10-13 19:33:08.917119 | controller | TELEMETRY_IMG: quay.io/openstack-k8s-operators/telemetry-operator-index:latest 2025-10-13 19:33:08.917127 | controller | TELEMETRY_KUTTL_BASEDIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator 2025-10-13 19:33:08.917133 | controller | TELEMETRY_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator/kuttl-test.yaml 2025-10-13 19:33:08.917138 | controller | TELEMETRY_KUTTL_NAMESPACE: telemetry-kuttl-tests 2025-10-13 19:33:08.917144 | controller | TELEMETRY_KUTTL_RELPATH: tests/kuttl/suites 2025-10-13 19:33:08.917150 | controller | TELEMETRY_REPO: https://github.com/openstack-k8s-operators/telemetry-operator.git 2025-10-13 19:33:08.917156 | controller | TENANT_HOST_ROUTES: '' 2025-10-13 19:33:08.917162 | controller | TIMEOUT: 300s 2025-10-13 19:33:08.917167 | controller | TLS_ENABLED: 'false' 2025-10-13 19:33:08.917173 | controller | tripleo_deploy: 'export REGISTRY_USER:' 2025-10-13 19:33:08.917184 | controller | 2025-10-13 19:33:09.252701 | controller | TASK [install_yamls : Generate make targets install_yamls_path={{ cifmw_install_yamls_repo }}, output_directory={{ cifmw_install_yamls_tasks_out }}] *** 2025-10-13 19:33:09.252772 | controller | Monday 13 October 2025 19:33:08 +0000 (0:00:00.037) 0:00:56.137 ******** 2025-10-13 19:33:09.252789 | controller | ok: [localhost] 2025-10-13 19:33:09.281745 | controller | 2025-10-13 19:33:09.281796 | controller | TASK [install_yamls : Debug generate_make module var=cifmw_generate_makes] ***** 2025-10-13 19:33:09.281804 | controller | Monday 13 October 2025 19:33:09 +0000 (0:00:00.335) 0:00:56.473 ******** 2025-10-13 19:33:09.281821 | controller | ok: [localhost] => 2025-10-13 19:33:09.281828 | controller | cifmw_generate_makes: 2025-10-13 19:33:09.281841 | controller | changed: false 2025-10-13 19:33:09.281846 | controller | debug: 2025-10-13 19:33:09.281853 | controller | /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/Makefile: 2025-10-13 19:33:09.281859 | controller | - all 2025-10-13 19:33:09.281864 | controller | - help 2025-10-13 19:33:09.281871 | controller | - cleanup 2025-10-13 19:33:09.281877 | controller | - deploy_cleanup 2025-10-13 19:33:09.281882 | controller | - wait 2025-10-13 19:33:09.281888 | controller | - crc_storage 2025-10-13 19:33:09.281894 | controller | - crc_storage_cleanup 2025-10-13 19:33:09.281900 | controller | - crc_storage_release 2025-10-13 19:33:09.281906 | controller | - crc_storage_with_retries 2025-10-13 19:33:09.281913 | controller | - crc_storage_cleanup_with_retries 2025-10-13 19:33:09.281919 | controller | - operator_namespace 2025-10-13 19:33:09.281925 | controller | - namespace 2025-10-13 19:33:09.281931 | controller | - namespace_cleanup 2025-10-13 19:33:09.281937 | controller | - input 2025-10-13 19:33:09.281943 | controller | - input_cleanup 2025-10-13 19:33:09.281949 | controller | - crc_bmo_setup 2025-10-13 19:33:09.281954 | controller | - crc_bmo_cleanup 2025-10-13 19:33:09.281960 | controller | - openstack_prep 2025-10-13 19:33:09.281966 | controller | - openstack 2025-10-13 19:33:09.281972 | controller | - openstack_wait 2025-10-13 19:33:09.281978 | controller | - openstack_init 2025-10-13 19:33:09.281983 | controller | - openstack_cleanup 2025-10-13 19:33:09.281989 | controller | - openstack_repo 2025-10-13 19:33:09.282003 | controller | - openstack_deploy_prep 2025-10-13 19:33:09.282009 | controller | - openstack_deploy 2025-10-13 19:33:09.282014 | controller | - openstack_wait_deploy 2025-10-13 19:33:09.282020 | controller | - openstack_deploy_cleanup 2025-10-13 19:33:09.282026 | controller | - openstack_update_run 2025-10-13 19:33:09.282032 | controller | - update_services 2025-10-13 19:33:09.282037 | controller | - update_system 2025-10-13 19:33:09.282043 | controller | - openstack_patch_version 2025-10-13 19:33:09.282049 | controller | - edpm_deploy_generate_keys 2025-10-13 19:33:09.282055 | controller | - edpm_patch_ansible_runner_image 2025-10-13 19:33:09.282061 | controller | - edpm_deploy_prep 2025-10-13 19:33:09.282067 | controller | - edpm_deploy_cleanup 2025-10-13 19:33:09.282073 | controller | - edpm_deploy 2025-10-13 19:33:09.282078 | controller | - edpm_deploy_baremetal_prep 2025-10-13 19:33:09.282084 | controller | - edpm_deploy_baremetal 2025-10-13 19:33:09.282090 | controller | - edpm_wait_deploy_baremetal 2025-10-13 19:33:09.282096 | controller | - edpm_wait_deploy 2025-10-13 19:33:09.282102 | controller | - edpm_register_dns 2025-10-13 19:33:09.282108 | controller | - edpm_nova_discover_hosts 2025-10-13 19:33:09.282114 | controller | - openstack_crds 2025-10-13 19:33:09.282119 | controller | - openstack_crds_cleanup 2025-10-13 19:33:09.282125 | controller | - edpm_deploy_networker_prep 2025-10-13 19:33:09.282131 | controller | - edpm_deploy_networker_cleanup 2025-10-13 19:33:09.282137 | controller | - edpm_deploy_networker 2025-10-13 19:33:09.282143 | controller | - infra_prep 2025-10-13 19:33:09.282149 | controller | - infra 2025-10-13 19:33:09.282154 | controller | - infra_cleanup 2025-10-13 19:33:09.282160 | controller | - dns_deploy_prep 2025-10-13 19:33:09.282166 | controller | - dns_deploy 2025-10-13 19:33:09.282172 | controller | - dns_deploy_cleanup 2025-10-13 19:33:09.282177 | controller | - netconfig_deploy_prep 2025-10-13 19:33:09.282183 | controller | - netconfig_deploy 2025-10-13 19:33:09.282189 | controller | - netconfig_deploy_cleanup 2025-10-13 19:33:09.282195 | controller | - memcached_deploy_prep 2025-10-13 19:33:09.282201 | controller | - memcached_deploy 2025-10-13 19:33:09.282206 | controller | - memcached_deploy_cleanup 2025-10-13 19:33:09.282212 | controller | - keystone_prep 2025-10-13 19:33:09.282218 | controller | - keystone 2025-10-13 19:33:09.282224 | controller | - keystone_cleanup 2025-10-13 19:33:09.282229 | controller | - keystone_deploy_prep 2025-10-13 19:33:09.282235 | controller | - keystone_deploy 2025-10-13 19:33:09.282241 | controller | - keystone_deploy_cleanup 2025-10-13 19:33:09.282247 | controller | - barbican_prep 2025-10-13 19:33:09.282253 | controller | - barbican 2025-10-13 19:33:09.282258 | controller | - barbican_cleanup 2025-10-13 19:33:09.282264 | controller | - barbican_deploy_prep 2025-10-13 19:33:09.282270 | controller | - barbican_deploy 2025-10-13 19:33:09.282275 | controller | - barbican_deploy_validate 2025-10-13 19:33:09.282281 | controller | - barbican_deploy_cleanup 2025-10-13 19:33:09.282287 | controller | - mariadb 2025-10-13 19:33:09.282293 | controller | - mariadb_cleanup 2025-10-13 19:33:09.282299 | controller | - mariadb_deploy_prep 2025-10-13 19:33:09.282304 | controller | - mariadb_deploy 2025-10-13 19:33:09.282310 | controller | - mariadb_deploy_cleanup 2025-10-13 19:33:09.282316 | controller | - placement_prep 2025-10-13 19:33:09.282322 | controller | - placement 2025-10-13 19:33:09.282327 | controller | - placement_cleanup 2025-10-13 19:33:09.282333 | controller | - placement_deploy_prep 2025-10-13 19:33:09.282339 | controller | - placement_deploy 2025-10-13 19:33:09.282345 | controller | - placement_deploy_cleanup 2025-10-13 19:33:09.282351 | controller | - glance_prep 2025-10-13 19:33:09.282356 | controller | - glance 2025-10-13 19:33:09.282362 | controller | - glance_cleanup 2025-10-13 19:33:09.282368 | controller | - glance_deploy_prep 2025-10-13 19:33:09.282373 | controller | - glance_deploy 2025-10-13 19:33:09.282379 | controller | - glance_deploy_cleanup 2025-10-13 19:33:09.282385 | controller | - ovn_prep 2025-10-13 19:33:09.282391 | controller | - ovn 2025-10-13 19:33:09.282417 | controller | - ovn_cleanup 2025-10-13 19:33:09.282423 | controller | - ovn_deploy_prep 2025-10-13 19:33:09.282431 | controller | - ovn_deploy 2025-10-13 19:33:09.282441 | controller | - ovn_deploy_cleanup 2025-10-13 19:33:09.282449 | controller | - neutron_prep 2025-10-13 19:33:09.282455 | controller | - neutron 2025-10-13 19:33:09.282460 | controller | - neutron_cleanup 2025-10-13 19:33:09.282466 | controller | - neutron_deploy_prep 2025-10-13 19:33:09.282472 | controller | - neutron_deploy 2025-10-13 19:33:09.282478 | controller | - neutron_deploy_cleanup 2025-10-13 19:33:09.282483 | controller | - cinder_prep 2025-10-13 19:33:09.282489 | controller | - cinder 2025-10-13 19:33:09.282495 | controller | - cinder_cleanup 2025-10-13 19:33:09.282500 | controller | - cinder_deploy_prep 2025-10-13 19:33:09.282506 | controller | - cinder_deploy 2025-10-13 19:33:09.282512 | controller | - cinder_deploy_cleanup 2025-10-13 19:33:09.282517 | controller | - rabbitmq_prep 2025-10-13 19:33:09.282523 | controller | - rabbitmq 2025-10-13 19:33:09.282529 | controller | - rabbitmq_cleanup 2025-10-13 19:33:09.282535 | controller | - rabbitmq_deploy_prep 2025-10-13 19:33:09.282540 | controller | - rabbitmq_deploy 2025-10-13 19:33:09.282546 | controller | - rabbitmq_deploy_cleanup 2025-10-13 19:33:09.282552 | controller | - ironic_prep 2025-10-13 19:33:09.282557 | controller | - ironic 2025-10-13 19:33:09.282563 | controller | - ironic_cleanup 2025-10-13 19:33:09.282569 | controller | - ironic_deploy_prep 2025-10-13 19:33:09.282575 | controller | - ironic_deploy 2025-10-13 19:33:09.282580 | controller | - ironic_deploy_cleanup 2025-10-13 19:33:09.282586 | controller | - octavia_prep 2025-10-13 19:33:09.282592 | controller | - octavia 2025-10-13 19:33:09.282597 | controller | - octavia_cleanup 2025-10-13 19:33:09.282603 | controller | - octavia_deploy_prep 2025-10-13 19:33:09.282609 | controller | - octavia_deploy 2025-10-13 19:33:09.282615 | controller | - octavia_deploy_cleanup 2025-10-13 19:33:09.282620 | controller | - designate_prep 2025-10-13 19:33:09.282626 | controller | - designate 2025-10-13 19:33:09.282632 | controller | - designate_cleanup 2025-10-13 19:33:09.282637 | controller | - designate_deploy_prep 2025-10-13 19:33:09.282643 | controller | - designate_deploy 2025-10-13 19:33:09.282649 | controller | - designate_deploy_cleanup 2025-10-13 19:33:09.282655 | controller | - nova_prep 2025-10-13 19:33:09.282660 | controller | - nova 2025-10-13 19:33:09.282666 | controller | - nova_cleanup 2025-10-13 19:33:09.282672 | controller | - nova_deploy_prep 2025-10-13 19:33:09.282678 | controller | - nova_deploy 2025-10-13 19:33:09.282683 | controller | - nova_deploy_cleanup 2025-10-13 19:33:09.282689 | controller | - mariadb_kuttl_run 2025-10-13 19:33:09.282695 | controller | - mariadb_kuttl 2025-10-13 19:33:09.282700 | controller | - kuttl_db_prep 2025-10-13 19:33:09.282706 | controller | - kuttl_db_cleanup 2025-10-13 19:33:09.282712 | controller | - kuttl_common_prep 2025-10-13 19:33:09.282717 | controller | - kuttl_common_cleanup 2025-10-13 19:33:09.282723 | controller | - keystone_kuttl_run 2025-10-13 19:33:09.282729 | controller | - keystone_kuttl 2025-10-13 19:33:09.282735 | controller | - barbican_kuttl_run 2025-10-13 19:33:09.282741 | controller | - barbican_kuttl 2025-10-13 19:33:09.282752 | controller | - placement_kuttl_run 2025-10-13 19:33:09.282758 | controller | - placement_kuttl 2025-10-13 19:33:09.282763 | controller | - cinder_kuttl_run 2025-10-13 19:33:09.282769 | controller | - cinder_kuttl 2025-10-13 19:33:09.282775 | controller | - neutron_kuttl_run 2025-10-13 19:33:09.282780 | controller | - neutron_kuttl 2025-10-13 19:33:09.282786 | controller | - octavia_kuttl_run 2025-10-13 19:33:09.282792 | controller | - octavia_kuttl 2025-10-13 19:33:09.282798 | controller | - designate_kuttl 2025-10-13 19:33:09.282803 | controller | - designate_kuttl_run 2025-10-13 19:33:09.282821 | controller | - ovn_kuttl_run 2025-10-13 19:33:09.282827 | controller | - ovn_kuttl 2025-10-13 19:33:09.282833 | controller | - infra_kuttl_run 2025-10-13 19:33:09.282838 | controller | - infra_kuttl 2025-10-13 19:33:09.282844 | controller | - ironic_kuttl_run 2025-10-13 19:33:09.282850 | controller | - ironic_kuttl 2025-10-13 19:33:09.282858 | controller | - ironic_kuttl_crc 2025-10-13 19:33:09.282864 | controller | - heat_kuttl_run 2025-10-13 19:33:09.282869 | controller | - heat_kuttl 2025-10-13 19:33:09.282875 | controller | - heat_kuttl_crc 2025-10-13 19:33:09.282881 | controller | - ansibleee_kuttl_run 2025-10-13 19:33:09.282886 | controller | - ansibleee_kuttl_cleanup 2025-10-13 19:33:09.282895 | controller | - ansibleee_kuttl_prep 2025-10-13 19:33:09.282900 | controller | - ansibleee_kuttl 2025-10-13 19:33:09.282906 | controller | - glance_kuttl_run 2025-10-13 19:33:09.282912 | controller | - glance_kuttl 2025-10-13 19:33:09.282917 | controller | - manila_kuttl_run 2025-10-13 19:33:09.282923 | controller | - manila_kuttl 2025-10-13 19:33:09.282929 | controller | - swift_kuttl_run 2025-10-13 19:33:09.282934 | controller | - swift_kuttl 2025-10-13 19:33:09.282940 | controller | - horizon_kuttl_run 2025-10-13 19:33:09.282946 | controller | - horizon_kuttl 2025-10-13 19:33:09.282951 | controller | - openstack_kuttl_run 2025-10-13 19:33:09.282957 | controller | - openstack_kuttl 2025-10-13 19:33:09.282963 | controller | - mariadb_chainsaw_run 2025-10-13 19:33:09.282968 | controller | - mariadb_chainsaw 2025-10-13 19:33:09.282974 | controller | - horizon_prep 2025-10-13 19:33:09.282979 | controller | - horizon 2025-10-13 19:33:09.282985 | controller | - horizon_cleanup 2025-10-13 19:33:09.282991 | controller | - horizon_deploy_prep 2025-10-13 19:33:09.282996 | controller | - horizon_deploy 2025-10-13 19:33:09.283002 | controller | - horizon_deploy_cleanup 2025-10-13 19:33:09.283008 | controller | - heat_prep 2025-10-13 19:33:09.283013 | controller | - heat 2025-10-13 19:33:09.283019 | controller | - heat_cleanup 2025-10-13 19:33:09.283025 | controller | - heat_deploy_prep 2025-10-13 19:33:09.283030 | controller | - heat_deploy 2025-10-13 19:33:09.283036 | controller | - heat_deploy_cleanup 2025-10-13 19:33:09.283042 | controller | - ansibleee_prep 2025-10-13 19:33:09.283047 | controller | - ansibleee 2025-10-13 19:33:09.283053 | controller | - ansibleee_cleanup 2025-10-13 19:33:09.283059 | controller | - baremetal_prep 2025-10-13 19:33:09.283064 | controller | - baremetal 2025-10-13 19:33:09.283070 | controller | - baremetal_cleanup 2025-10-13 19:33:09.283076 | controller | - ceph_help 2025-10-13 19:33:09.283081 | controller | - ceph 2025-10-13 19:33:09.283087 | controller | - ceph_cleanup 2025-10-13 19:33:09.283093 | controller | - rook_prep 2025-10-13 19:33:09.283098 | controller | - rook 2025-10-13 19:33:09.283104 | controller | - rook_deploy_prep 2025-10-13 19:33:09.283110 | controller | - rook_deploy 2025-10-13 19:33:09.283115 | controller | - rook_crc_disk 2025-10-13 19:33:09.283121 | controller | - rook_cleanup 2025-10-13 19:33:09.283127 | controller | - lvms 2025-10-13 19:33:09.283132 | controller | - nmstate 2025-10-13 19:33:09.283138 | controller | - nncp 2025-10-13 19:33:09.283144 | controller | - nncp_cleanup 2025-10-13 19:33:09.283149 | controller | - netattach 2025-10-13 19:33:09.283155 | controller | - netattach_cleanup 2025-10-13 19:33:09.283161 | controller | - metallb 2025-10-13 19:33:09.283166 | controller | - metallb_config 2025-10-13 19:33:09.283172 | controller | - metallb_config_cleanup 2025-10-13 19:33:09.283178 | controller | - metallb_cleanup 2025-10-13 19:33:09.283183 | controller | - loki 2025-10-13 19:33:09.283189 | controller | - loki_cleanup 2025-10-13 19:33:09.283195 | controller | - loki_deploy 2025-10-13 19:33:09.283201 | controller | - loki_deploy_cleanup 2025-10-13 19:33:09.283206 | controller | - netobserv 2025-10-13 19:33:09.283212 | controller | - netobserv_cleanup 2025-10-13 19:33:09.283218 | controller | - netobserv_deploy 2025-10-13 19:33:09.283223 | controller | - netobserv_deploy_cleanup 2025-10-13 19:33:09.283229 | controller | - manila_prep 2025-10-13 19:33:09.283235 | controller | - manila 2025-10-13 19:33:09.283240 | controller | - manila_cleanup 2025-10-13 19:33:09.283246 | controller | - manila_deploy_prep 2025-10-13 19:33:09.283252 | controller | - manila_deploy 2025-10-13 19:33:09.283257 | controller | - manila_deploy_cleanup 2025-10-13 19:33:09.283263 | controller | - telemetry_prep 2025-10-13 19:33:09.283269 | controller | - telemetry 2025-10-13 19:33:09.283274 | controller | - telemetry_cleanup 2025-10-13 19:33:09.283283 | controller | - telemetry_deploy_prep 2025-10-13 19:33:09.283289 | controller | - telemetry_deploy 2025-10-13 19:33:09.283295 | controller | - telemetry_deploy_cleanup 2025-10-13 19:33:09.283303 | controller | - telemetry_kuttl_run 2025-10-13 19:33:09.283309 | controller | - telemetry_kuttl 2025-10-13 19:33:09.283315 | controller | - swift_prep 2025-10-13 19:33:09.283321 | controller | - swift 2025-10-13 19:33:09.283326 | controller | - swift_cleanup 2025-10-13 19:33:09.283332 | controller | - swift_deploy_prep 2025-10-13 19:33:09.283341 | controller | - swift_deploy 2025-10-13 19:33:09.283347 | controller | - swift_deploy_cleanup 2025-10-13 19:33:09.283353 | controller | - certmanager 2025-10-13 19:33:09.283358 | controller | - certmanager_cleanup 2025-10-13 19:33:09.283364 | controller | - validate_marketplace 2025-10-13 19:33:09.283370 | controller | - redis_deploy_prep 2025-10-13 19:33:09.283376 | controller | - redis_deploy 2025-10-13 19:33:09.283381 | controller | - redis_deploy_cleanup 2025-10-13 19:33:09.283387 | controller | - set_slower_etcd_profile 2025-10-13 19:33:09.283406 | controller | /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/devsetup/Makefile: 2025-10-13 19:33:09.283415 | controller | - help 2025-10-13 19:33:09.283421 | controller | - download_tools 2025-10-13 19:33:09.283427 | controller | - nfs 2025-10-13 19:33:09.283433 | controller | - nfs_cleanup 2025-10-13 19:33:09.283439 | controller | - crc 2025-10-13 19:33:09.283445 | controller | - crc_cleanup 2025-10-13 19:33:09.283450 | controller | - crc_scrub 2025-10-13 19:33:09.283456 | controller | - crc_attach_default_interface 2025-10-13 19:33:09.283462 | controller | - crc_attach_default_interface_cleanup 2025-10-13 19:33:09.283468 | controller | - ipv6_lab_network 2025-10-13 19:33:09.283474 | controller | - ipv6_lab_network_cleanup 2025-10-13 19:33:09.283480 | controller | - ipv6_lab_nat64_router 2025-10-13 19:33:09.283485 | controller | - ipv6_lab_nat64_router_cleanup 2025-10-13 19:33:09.283491 | controller | - ipv6_lab_sno 2025-10-13 19:33:09.283497 | controller | - ipv6_lab_sno_cleanup 2025-10-13 19:33:09.283502 | controller | - ipv6_lab 2025-10-13 19:33:09.283508 | controller | - ipv6_lab_cleanup 2025-10-13 19:33:09.283514 | controller | - attach_default_interface 2025-10-13 19:33:09.283519 | controller | - attach_default_interface_cleanup 2025-10-13 19:33:09.283525 | controller | - network_isolation_bridge 2025-10-13 19:33:09.283531 | controller | - network_isolation_bridge_cleanup 2025-10-13 19:33:09.283536 | controller | - edpm_baremetal_compute 2025-10-13 19:33:09.283542 | controller | - edpm_compute 2025-10-13 19:33:09.283548 | controller | - edpm_compute_bootc 2025-10-13 19:33:09.283553 | controller | - edpm_ansible_runner 2025-10-13 19:33:09.283559 | controller | - edpm_computes_bgp 2025-10-13 19:33:09.283565 | controller | - edpm_compute_repos 2025-10-13 19:33:09.283570 | controller | - edpm_compute_cleanup 2025-10-13 19:33:09.283576 | controller | - edpm_networker 2025-10-13 19:33:09.283582 | controller | - edpm_networker_cleanup 2025-10-13 19:33:09.283587 | controller | - edpm_deploy_instance 2025-10-13 19:33:09.283593 | controller | - tripleo_deploy 2025-10-13 19:33:09.283599 | controller | - standalone_deploy 2025-10-13 19:33:09.283604 | controller | - standalone_sync 2025-10-13 19:33:09.283610 | controller | - standalone 2025-10-13 19:33:09.283616 | controller | - standalone_cleanup 2025-10-13 19:33:09.283621 | controller | - standalone_snapshot 2025-10-13 19:33:09.283627 | controller | - standalone_revert 2025-10-13 19:33:09.283633 | controller | - cifmw_prepare 2025-10-13 19:33:09.283638 | controller | - cifmw_cleanup 2025-10-13 19:33:09.283644 | controller | - bmaas_network 2025-10-13 19:33:09.283650 | controller | - bmaas_network_cleanup 2025-10-13 19:33:09.283656 | controller | - bmaas_route_crc_and_crc_bmaas_networks 2025-10-13 19:33:09.283662 | controller | - bmaas_route_crc_and_crc_bmaas_networks_cleanup 2025-10-13 19:33:09.283672 | controller | - bmaas_crc_attach_network 2025-10-13 19:33:09.296896 | controller | - bmaas_crc_attach_network_cleanup 2025-10-13 19:33:09.296913 | controller | - bmaas_crc_baremetal_bridge 2025-10-13 19:33:09.296919 | controller | - bmaas_crc_baremetal_bridge_cleanup 2025-10-13 19:33:09.296925 | controller | - bmaas_baremetal_net_nad 2025-10-13 19:33:09.296931 | controller | - bmaas_baremetal_net_nad_cleanup 2025-10-13 19:33:09.296936 | controller | - bmaas_metallb 2025-10-13 19:33:09.296942 | controller | - bmaas_metallb_cleanup 2025-10-13 19:33:09.296948 | controller | - bmaas_virtual_bms 2025-10-13 19:33:09.296953 | controller | - bmaas_virtual_bms_cleanup 2025-10-13 19:33:09.296959 | controller | - bmaas_sushy_emulator 2025-10-13 19:33:09.296965 | controller | - bmaas_sushy_emulator_cleanup 2025-10-13 19:33:09.296970 | controller | - bmaas_sushy_emulator_wait 2025-10-13 19:33:09.296976 | controller | - bmaas_generate_nodes_yaml 2025-10-13 19:33:09.296988 | controller | - bmaas 2025-10-13 19:33:09.296994 | controller | - bmaas_cleanup 2025-10-13 19:33:09.296999 | controller | failed: false 2025-10-13 19:33:09.297005 | controller | success: true 2025-10-13 19:33:09.297015 | controller | 2025-10-13 19:33:09.711867 | controller | TASK [install_yamls : Create the install_yamls parameters file dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/install-yamls-params.yml, content={{ 2025-10-13 19:33:09.711934 | controller | { 2025-10-13 19:33:09.711942 | controller | 'cifmw_install_yamls_environment': cifmw_install_yamls_environment, 2025-10-13 19:33:09.711950 | controller | 'cifmw_install_yamls_defaults': cifmw_install_yamls_defaults 2025-10-13 19:33:09.711956 | controller | } | to_nice_yaml 2025-10-13 19:33:09.711963 | controller | }}, mode=0644] *** 2025-10-13 19:33:09.711969 | controller | Monday 13 October 2025 19:33:09 +0000 (0:00:00.044) 0:00:56.517 ******** 2025-10-13 19:33:09.711984 | controller | changed: [localhost] 2025-10-13 19:33:09.750958 | controller | 2025-10-13 19:33:09.751031 | controller | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed cifmw_install_yamls_environment={}] *** 2025-10-13 19:33:09.751040 | controller | Monday 13 October 2025 19:33:09 +0000 (0:00:00.414) 0:00:56.932 ******** 2025-10-13 19:33:09.751057 | controller | skipping: [localhost] 2025-10-13 19:33:10.720205 | controller | 2025-10-13 19:33:10.720328 | controller | TASK [discover_latest_image : Get latest image url={{ cifmw_discover_latest_image_base_url }}, image_prefix={{ cifmw_discover_latest_image_qcow_prefix }}, images_file={{ cifmw_discover_latest_image_images_file }}] *** 2025-10-13 19:33:10.720342 | controller | Monday 13 October 2025 19:33:09 +0000 (0:00:00.038) 0:00:56.971 ******** 2025-10-13 19:33:10.720373 | controller | changed: [localhost] 2025-10-13 19:33:10.768232 | controller | 2025-10-13 19:33:10.768350 | controller | TASK [discover_latest_image : Export facts accordingly cifmw_discovered_image_name={{ discovered_image['data']['image_name'] }}, cifmw_discovered_image_url={{ discovered_image['data']['image_url'] }}, cifmw_discovered_hash={{ discovered_image['data']['hash'] }}, cifmw_discovered_hash_algorithm={{ discovered_image['data']['hash_algorithm'] }}, cacheable=True] *** 2025-10-13 19:33:10.768367 | controller | Monday 13 October 2025 19:33:10 +0000 (0:00:00.969) 0:00:57.940 ******** 2025-10-13 19:33:10.768425 | controller | ok: [localhost] 2025-10-13 19:33:11.269766 | controller | 2025-10-13 19:33:11.269825 | controller | TASK [cifmw_setup : Create artifacts with custom params mode=0644, dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/custom-params.yml, content={{ ci_framework_params | to_nice_yaml }}] *** 2025-10-13 19:33:11.269834 | controller | Monday 13 October 2025 19:33:10 +0000 (0:00:00.048) 0:00:57.988 ******** 2025-10-13 19:33:11.269848 | controller | changed: [localhost] 2025-10-13 19:33:11.321047 | controller | 2025-10-13 19:33:11.321182 | controller | PLAY [Install deps and prepare for KUTTL run] ********************************** 2025-10-13 19:33:11.321199 | controller | 2025-10-13 19:33:11.321211 | controller | TASK [Download install_yamls deps name=install_yamls_makes, tasks_from=make_download_tools] *** 2025-10-13 19:33:11.321223 | controller | Monday 13 October 2025 19:33:11 +0000 (0:00:00.501) 0:00:58.491 ******** 2025-10-13 19:33:11.321257 | controller | 2025-10-13 19:33:11.356220 | controller | TASK [install_yamls_makes : Debug make_download_tools_env var=make_download_tools_env] *** 2025-10-13 19:33:11.356322 | controller | Monday 13 October 2025 19:33:11 +0000 (0:00:00.050) 0:00:58.541 ******** 2025-10-13 19:33:11.356349 | controller | skipping: [localhost] 2025-10-13 19:33:11.392974 | controller | 2025-10-13 19:33:11.393028 | controller | TASK [install_yamls_makes : Debug make_download_tools_params var=make_download_tools_params] *** 2025-10-13 19:33:11.393040 | controller | Monday 13 October 2025 19:33:11 +0000 (0:00:00.035) 0:00:58.577 ******** 2025-10-13 19:33:11.393059 | controller | skipping: [localhost] 2025-10-13 19:33:45.790773 | controller | 2025-10-13 19:33:45.790824 | controller | TASK [install_yamls_makes : Run download_tools output_dir={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts, chdir=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/devsetup, script=make download_tools, dry_run={{ make_download_tools_dryrun|default(false)|bool }}, extra_args={{ dict((make_download_tools_env|default({})), **(make_download_tools_params|default({}))) }}] *** 2025-10-13 19:33:45.790839 | controller | Monday 13 October 2025 19:33:11 +0000 (0:00:00.036) 0:00:58.613 ******** 2025-10-13 19:33:45.790858 | controller | [WARNING]: conditional statements should not include jinja2 templating 2025-10-13 19:33:45.805579 | controller | delimiters such as {{ }} or {% %}. Found: {{ make_download_tools_until | 2025-10-13 19:33:45.805606 | controller | default(true) }} 2025-10-13 19:33:45.805619 | controller | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_000_run_download.log 2025-10-13 19:33:45.867176 | controller | changed: [localhost] 2025-10-13 19:33:45.867271 | controller | 2025-10-13 19:33:45.867285 | controller | TASK [Login into Openshift cluster name=openshift_login] *********************** 2025-10-13 19:33:45.867299 | controller | Monday 13 October 2025 19:33:45 +0000 (0:00:34.412) 0:01:33.026 ******** 2025-10-13 19:33:45.867329 | controller | 2025-10-13 19:33:46.074215 | controller | TASK [openshift_login : Ensure output directory exists path={{ cifmw_openshift_login_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:33:46.074280 | controller | Monday 13 October 2025 19:33:45 +0000 (0:00:00.061) 0:01:33.087 ******** 2025-10-13 19:33:46.074297 | controller | ok: [localhost] 2025-10-13 19:33:46.158377 | controller | 2025-10-13 19:33:46.158494 | controller | TASK [openshift_login : OpenShift login _raw_params=login.yml] ***************** 2025-10-13 19:33:46.158504 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.207) 0:01:33.295 ******** 2025-10-13 19:33:46.158529 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/openshift_login/tasks/login.yml for localhost 2025-10-13 19:33:46.191670 | controller | 2025-10-13 19:33:46.191741 | controller | TASK [openshift_login : Check if the password file is present path={{ cifmw_openshift_login_password_file | default(cifmw_openshift_password_file) }}] *** 2025-10-13 19:33:46.191753 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.084) 0:01:33.379 ******** 2025-10-13 19:33:46.191773 | controller | skipping: [localhost] 2025-10-13 19:33:46.228215 | controller | 2025-10-13 19:33:46.228294 | controller | TASK [openshift_login : Fetch user password content src={{ cifmw_openshift_login_password_file | default(cifmw_openshift_password_file) }}] *** 2025-10-13 19:33:46.228306 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.032) 0:01:33.412 ******** 2025-10-13 19:33:46.228327 | controller | skipping: [localhost] 2025-10-13 19:33:46.261698 | controller | 2025-10-13 19:33:46.261771 | controller | TASK [openshift_login : Set user password as a fact cifmw_openshift_login_password={{ cifmw_openshift_login_password_file_slurp.content | b64decode }}, cacheable=True] *** 2025-10-13 19:33:46.261786 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.036) 0:01:33.448 ******** 2025-10-13 19:33:46.261809 | controller | skipping: [localhost] 2025-10-13 19:33:46.306705 | controller | 2025-10-13 19:33:46.306761 | controller | TASK [openshift_login : Set role variables cifmw_openshift_login_kubeconfig={{ 2025-10-13 19:33:46.306769 | controller | cifmw_openshift_login_kubeconfig | 2025-10-13 19:33:46.306776 | controller | default(cifmw_openshift_kubeconfig) | 2025-10-13 19:33:46.306782 | controller | default( 2025-10-13 19:33:46.306789 | controller | ansible_env.KUBECONFIG if 'KUBECONFIG' in ansible_env else 2025-10-13 19:33:46.306795 | controller | cifmw_openshift_login_kubeconfig_default_path 2025-10-13 19:33:46.306802 | controller | ) | trim 2025-10-13 19:33:46.306809 | controller | }}, cifmw_openshift_login_user={{ cifmw_openshift_login_user | default(cifmw_openshift_user) | default(omit) }}, cifmw_openshift_login_password={{ cifmw_openshift_login_password | default(cifmw_openshift_password) | default(omit) }}, cifmw_openshift_login_api={{ cifmw_openshift_login_api | default(cifmw_openshift_api) | default(omit) }}, cifmw_openshift_login_cert_login={{ cifmw_openshift_login_cert_login | default(false)}}, cifmw_openshift_login_provided_token={{ cifmw_openshift_provided_token | default(omit) }}, cacheable=True] *** 2025-10-13 19:33:46.306816 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.033) 0:01:33.482 ******** 2025-10-13 19:33:46.306829 | controller | ok: [localhost] 2025-10-13 19:33:46.493560 | controller | 2025-10-13 19:33:46.493670 | controller | TASK [openshift_login : Check if kubeconfig exists path={{ cifmw_openshift_login_kubeconfig }}] *** 2025-10-13 19:33:46.493679 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.044) 0:01:33.527 ******** 2025-10-13 19:33:46.493694 | controller | ok: [localhost] 2025-10-13 19:33:46.530249 | controller | 2025-10-13 19:33:46.530294 | controller | TASK [openshift_login : Assert that enough data is provided to log in to OpenShift that=cifmw_openshift_login_kubeconfig_stat.stat.exists or (cifmw_openshift_login_provided_token is defined and cifmw_openshift_login_provided_token != '') or ( 2025-10-13 19:33:46.530304 | controller | (cifmw_openshift_login_user is defined) and 2025-10-13 19:33:46.530313 | controller | (cifmw_openshift_login_password is defined) and 2025-10-13 19:33:46.530321 | controller | (cifmw_openshift_login_api is defined) 2025-10-13 19:33:46.530329 | controller | ), msg=If an existing kubeconfig is not provided user/pwd or provided/initial token and API URL must be given] *** 2025-10-13 19:33:46.530337 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.185) 0:01:33.713 ******** 2025-10-13 19:33:46.530373 | controller | ok: [localhost] => 2025-10-13 19:33:46.559978 | controller | changed: false 2025-10-13 19:33:46.560027 | controller | msg: All assertions passed 2025-10-13 19:33:46.560035 | controller | 2025-10-13 19:33:46.560043 | controller | TASK [openshift_login : Fetch kubeconfig content src={{ cifmw_openshift_login_kubeconfig }}] *** 2025-10-13 19:33:46.560052 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.037) 0:01:33.751 ******** 2025-10-13 19:33:46.560072 | controller | skipping: [localhost] 2025-10-13 19:33:46.589507 | controller | 2025-10-13 19:33:46.589565 | controller | TASK [openshift_login : Fetch x509 key based users cifmw_openshift_login_key_based_users={{ 2025-10-13 19:33:46.589574 | controller | ( 2025-10-13 19:33:46.589580 | controller | cifmw_openshift_login_kubeconfig_content_b64.content | 2025-10-13 19:33:46.589587 | controller | b64decode | 2025-10-13 19:33:46.589593 | controller | from_yaml 2025-10-13 19:33:46.589599 | controller | ). users | default([]) | 2025-10-13 19:33:46.589605 | controller | selectattr('user.client-certificate-data', 'defined') | 2025-10-13 19:33:46.589611 | controller | map(attribute="name") | 2025-10-13 19:33:46.589617 | controller | map("split", "/") | 2025-10-13 19:33:46.589623 | controller | map("first") 2025-10-13 19:33:46.589629 | controller | }}, cacheable=True] *** 2025-10-13 19:33:46.589635 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.028) 0:01:33.779 ******** 2025-10-13 19:33:46.589648 | controller | skipping: [localhost] 2025-10-13 19:33:46.615999 | controller | 2025-10-13 19:33:46.616049 | controller | TASK [openshift_login : Assign key based user if not provided and available cifmw_openshift_login_user={{ 2025-10-13 19:33:46.616057 | controller | (cifmw_openshift_login_assume_cert_system_user | ternary('system:', '')) + 2025-10-13 19:33:46.616064 | controller | (cifmw_openshift_login_key_based_users | map('replace', 'system:', '') | unique | first) 2025-10-13 19:33:46.616071 | controller | }}, cifmw_openshift_login_cert_login=True, cacheable=True] *** 2025-10-13 19:33:46.616077 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.030) 0:01:33.810 ******** 2025-10-13 19:33:46.616090 | controller | skipping: [localhost] 2025-10-13 19:33:46.646716 | controller | 2025-10-13 19:33:46.646782 | controller | TASK [openshift_login : Set the retry count cifmw_openshift_login_retries_cnt={{ 2025-10-13 19:33:46.646792 | controller | 0 if cifmw_openshift_login_retries_cnt is undefined else 2025-10-13 19:33:46.646800 | controller | cifmw_openshift_login_retries_cnt|int + 1 2025-10-13 19:33:46.646807 | controller | }}] *** 2025-10-13 19:33:46.646814 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.026) 0:01:33.837 ******** 2025-10-13 19:33:46.646827 | controller | ok: [localhost] 2025-10-13 19:33:46.679257 | controller | 2025-10-13 19:33:46.679309 | controller | TASK [openshift_login : Fetch token _raw_params=try_login.yml] ***************** 2025-10-13 19:33:46.679319 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.030) 0:01:33.867 ******** 2025-10-13 19:33:46.679335 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/openshift_login/tasks/try_login.yml for localhost 2025-10-13 19:33:47.027756 | controller | 2025-10-13 19:33:47.027845 | controller | TASK [openshift_login : Try get OpenShift access token _raw_params=oc whoami -t] *** 2025-10-13 19:33:47.027863 | controller | Monday 13 October 2025 19:33:46 +0000 (0:00:00.032) 0:01:33.900 ******** 2025-10-13 19:33:47.027883 | controller | task path: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/openshift_login/tasks/try_login.yml:17 2025-10-13 19:33:47.446207 | controller | fatal: [localhost]: FAILED! => 2025-10-13 19:33:47.446258 | controller | changed: true 2025-10-13 19:33:47.446267 | controller | cmd: 2025-10-13 19:33:47.446273 | controller | - oc 2025-10-13 19:33:47.446279 | controller | - whoami 2025-10-13 19:33:47.446285 | controller | - -t 2025-10-13 19:33:47.446291 | controller | delta: '0:00:00.142565' 2025-10-13 19:33:47.446297 | controller | end: '2025-10-13 19:33:46.987813' 2025-10-13 19:33:47.446304 | controller | msg: non-zero return code 2025-10-13 19:33:47.446310 | controller | rc: 1 2025-10-13 19:33:47.446316 | controller | start: '2025-10-13 19:33:46.845248' 2025-10-13 19:33:47.446322 | controller | stderr: |- 2025-10-13 19:33:47.446328 | controller | error: Missing or incomplete configuration info. Please point to an existing, complete config file: 2025-10-13 19:33:47.446334 | controller | 2025-10-13 19:33:47.446340 | controller | 2025-10-13 19:33:47.446346 | controller | 1. Via the command-line flag --kubeconfig 2025-10-13 19:33:47.446352 | controller | 2. Via the KUBECONFIG environment variable 2025-10-13 19:33:47.446359 | controller | 3. In your home directory as ~/.kube/config 2025-10-13 19:33:47.446364 | controller | 2025-10-13 19:33:47.446372 | controller | To view or setup config directly use the 'config' command. 2025-10-13 19:33:47.446380 | controller | stderr_lines: 2025-10-13 19:33:47.446388 | controller | - 'error: Missing or incomplete configuration info. Please point to an existing, 2025-10-13 19:33:47.446413 | controller | complete config file:' 2025-10-13 19:33:47.446420 | controller | - '' 2025-10-13 19:33:47.446425 | controller | - '' 2025-10-13 19:33:47.446431 | controller | - ' 1. Via the command-line flag --kubeconfig' 2025-10-13 19:33:47.446437 | controller | - ' 2. Via the KUBECONFIG environment variable' 2025-10-13 19:33:47.446443 | controller | - ' 3. In your home directory as ~/.kube/config' 2025-10-13 19:33:47.446449 | controller | - '' 2025-10-13 19:33:47.446455 | controller | - To view or setup config directly use the 'config' command. 2025-10-13 19:33:47.446461 | controller | stdout: '' 2025-10-13 19:33:47.446467 | controller | stdout_lines: [] 2025-10-13 19:33:47.446472 | controller | ...ignoring 2025-10-13 19:33:47.446478 | controller | 2025-10-13 19:33:47.446492 | controller | TASK [openshift_login : Fetch OpenShift token output_dir={{ cifmw_openshift_login_basedir }}/artifacts, script=oc login {%- if cifmw_openshift_login_provided_token is not defined %} {%- if cifmw_openshift_login_user is defined %} -u {{ cifmw_openshift_login_user }} {%- endif %} {%- if cifmw_openshift_login_password is defined %} -p {{ cifmw_openshift_login_password }} {%- endif %} {% else %} --token={{ cifmw_openshift_login_provided_token }} {%- endif %} {%- if cifmw_openshift_login_skip_tls_verify|bool %} --insecure-skip-tls-verify=true {%- endif %} {%- if cifmw_openshift_login_api is defined %} {{ cifmw_openshift_login_api }} {%- endif %}] *** 2025-10-13 19:33:47.446500 | controller | Monday 13 October 2025 19:33:47 +0000 (0:00:00.348) 0:01:34.248 ******** 2025-10-13 19:33:47.446513 | controller | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_001_fetch_openshift.log 2025-10-13 19:33:47.471697 | controller | changed: [localhost] 2025-10-13 19:33:47.471763 | controller | 2025-10-13 19:33:47.471770 | controller | TASK [openshift_login : Ensure kubeconfig is provided that=cifmw_openshift_login_kubeconfig != ""] *** 2025-10-13 19:33:47.471777 | controller | Monday 13 October 2025 19:33:47 +0000 (0:00:00.418) 0:01:34.667 ******** 2025-10-13 19:33:47.471793 | controller | ok: [localhost] => 2025-10-13 19:33:47.778225 | controller | changed: false 2025-10-13 19:33:47.778264 | controller | msg: All assertions passed 2025-10-13 19:33:47.778272 | controller | 2025-10-13 19:33:47.778279 | controller | TASK [openshift_login : Fetch new OpenShift access token _raw_params=oc whoami -t] *** 2025-10-13 19:33:47.778285 | controller | Monday 13 October 2025 19:33:47 +0000 (0:00:00.025) 0:01:34.692 ******** 2025-10-13 19:33:47.778297 | controller | changed: [localhost] 2025-10-13 19:33:47.816307 | controller | 2025-10-13 19:33:47.816350 | controller | TASK [openshift_login : Set new OpenShift token cifmw_openshift_login_token={{ 2025-10-13 19:33:47.816362 | controller | (not cifmw_openshift_login_new_token_out.skipped | default(false)) | 2025-10-13 19:33:47.816370 | controller | ternary(cifmw_openshift_login_new_token_out.stdout, cifmw_openshift_login_whoami_out.stdout) 2025-10-13 19:33:47.816378 | controller | }}, cacheable=True] *** 2025-10-13 19:33:47.816386 | controller | Monday 13 October 2025 19:33:47 +0000 (0:00:00.306) 0:01:34.999 ******** 2025-10-13 19:33:47.816429 | controller | ok: [localhost] 2025-10-13 19:33:48.141142 | controller | 2025-10-13 19:33:48.141184 | controller | TASK [openshift_login : Fetch OpenShift API URL _raw_params=oc whoami --show-server=true] *** 2025-10-13 19:33:48.141192 | controller | Monday 13 October 2025 19:33:47 +0000 (0:00:00.038) 0:01:35.037 ******** 2025-10-13 19:33:48.141204 | controller | changed: [localhost] 2025-10-13 19:33:48.461409 | controller | 2025-10-13 19:33:48.461469 | controller | TASK [openshift_login : Fetch OpenShift kubeconfig context _raw_params=oc whoami -c] *** 2025-10-13 19:33:48.461477 | controller | Monday 13 October 2025 19:33:48 +0000 (0:00:00.324) 0:01:35.362 ******** 2025-10-13 19:33:48.461489 | controller | changed: [localhost] 2025-10-13 19:33:48.770527 | controller | 2025-10-13 19:33:48.770591 | controller | TASK [openshift_login : Fetch OpenShift current user _raw_params=oc whoami] **** 2025-10-13 19:33:48.770599 | controller | Monday 13 October 2025 19:33:48 +0000 (0:00:00.320) 0:01:35.682 ******** 2025-10-13 19:33:48.770612 | controller | changed: [localhost] 2025-10-13 19:33:48.815152 | controller | 2025-10-13 19:33:48.815193 | controller | TASK [openshift_login : Set OpenShift user, context and API facts cifmw_openshift_login_api={{ cifmw_openshift_login_api_out.stdout }}, cifmw_openshift_login_context={{ cifmw_openshift_login_context_out.stdout }}, cifmw_openshift_login_user={{ _oauth_user }}, cifmw_openshift_kubeconfig={{ cifmw_openshift_login_kubeconfig }}, cifmw_openshift_api={{ cifmw_openshift_login_api_out.stdout }}, cifmw_openshift_context={{ cifmw_openshift_login_context_out.stdout }}, cifmw_openshift_user={{ _oauth_user }}, cifmw_openshift_token={{ cifmw_openshift_login_token | default(omit) }}, cifmw_install_yamls_environment={{ ( cifmw_install_yamls_environment | 2025-10-13 19:33:48.815202 | controller | combine({'KUBECONFIG': cifmw_openshift_login_kubeconfig}) 2025-10-13 19:33:48.815209 | controller | ) if cifmw_install_yamls_environment is defined else omit 2025-10-13 19:33:48.815216 | controller | }}, cacheable=True] *** 2025-10-13 19:33:48.815222 | controller | Monday 13 October 2025 19:33:48 +0000 (0:00:00.309) 0:01:35.991 ******** 2025-10-13 19:33:48.815235 | controller | ok: [localhost] 2025-10-13 19:33:49.229590 | controller | 2025-10-13 19:33:49.229641 | controller | TASK [openshift_login : Create the openshift_login parameters file dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/openshift-login-params.yml, content={{ cifmw_openshift_login_params_content | from_yaml | to_nice_yaml }}, mode=0600] *** 2025-10-13 19:33:49.229649 | controller | Monday 13 October 2025 19:33:48 +0000 (0:00:00.044) 0:01:36.035 ******** 2025-10-13 19:33:49.229661 | controller | changed: [localhost] 2025-10-13 19:33:49.542509 | controller | 2025-10-13 19:33:49.542547 | controller | TASK [openshift_login : Read the install yamls parameters file path={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/install-yamls-params.yml] *** 2025-10-13 19:33:49.542555 | controller | Monday 13 October 2025 19:33:49 +0000 (0:00:00.414) 0:01:36.450 ******** 2025-10-13 19:33:49.542567 | controller | ok: [localhost] 2025-10-13 19:33:50.020727 | controller | 2025-10-13 19:33:50.020777 | controller | TASK [openshift_login : Append the KUBECONFIG to the install yamls parameters content={{ 2025-10-13 19:33:50.020792 | controller | cifmw_openshift_login_install_yamls_artifacts_slurp['content'] | b64decode | from_yaml | 2025-10-13 19:33:50.020804 | controller | combine( 2025-10-13 19:33:50.020814 | controller | { 2025-10-13 19:33:50.020824 | controller | 'cifmw_install_yamls_environment': { 2025-10-13 19:33:50.020835 | controller | 'KUBECONFIG': cifmw_openshift_login_kubeconfig 2025-10-13 19:33:50.020846 | controller | } 2025-10-13 19:33:50.020856 | controller | }, recursive=true) | to_nice_yaml 2025-10-13 19:33:50.020867 | controller | }}, dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/install-yamls-params.yml, mode=0600] *** 2025-10-13 19:33:50.020886 | controller | Monday 13 October 2025 19:33:49 +0000 (0:00:00.312) 0:01:36.763 ******** 2025-10-13 19:33:50.020905 | controller | changed: [localhost] 2025-10-13 19:33:50.233073 | controller | 2025-10-13 19:33:50.233134 | controller | TASK [openshift_setup : Ensure output directory exists path={{ cifmw_openshift_setup_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:33:50.233151 | controller | Monday 13 October 2025 19:33:50 +0000 (0:00:00.477) 0:01:37.241 ******** 2025-10-13 19:33:50.233174 | controller | ok: [localhost] 2025-10-13 19:33:50.273128 | controller | 2025-10-13 19:33:50.273208 | controller | TASK [openshift_setup : Fetch namespaces to create cifmw_openshift_setup_namespaces={{ 2025-10-13 19:33:50.273224 | controller | (( 2025-10-13 19:33:50.273238 | controller | ([cifmw_install_yamls_defaults['NAMESPACE']] + 2025-10-13 19:33:50.273257 | controller | ([cifmw_install_yamls_defaults['OPERATOR_NAMESPACE']] if 'OPERATOR_NAMESPACE' is in cifmw_install_yamls_defaults else []) 2025-10-13 19:33:50.273271 | controller | ) if cifmw_install_yamls_defaults is defined else [] 2025-10-13 19:33:50.273284 | controller | ) + cifmw_openshift_setup_create_namespaces) | unique 2025-10-13 19:33:50.273297 | controller | }}] *** 2025-10-13 19:33:50.273311 | controller | Monday 13 October 2025 19:33:50 +0000 (0:00:00.212) 0:01:37.453 ******** 2025-10-13 19:33:50.273335 | controller | ok: [localhost] 2025-10-13 19:33:51.980805 | controller | 2025-10-13 19:33:51.980850 | controller | TASK [openshift_setup : Create required namespaces kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit) }}, name={{ item }}, kind=Namespace, state=present] *** 2025-10-13 19:33:51.980861 | controller | Monday 13 October 2025 19:33:50 +0000 (0:00:00.040) 0:01:37.494 ******** 2025-10-13 19:33:51.980877 | controller | changed: [localhost] => (item=openstack) 2025-10-13 19:33:52.008442 | controller | changed: [localhost] => (item=openstack-operators) 2025-10-13 19:33:52.008491 | controller | 2025-10-13 19:33:52.008502 | controller | TASK [openshift_setup : Get internal OpenShift registry route kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Route, name=default-route, namespace=openshift-image-registry] *** 2025-10-13 19:33:52.008511 | controller | Monday 13 October 2025 19:33:51 +0000 (0:00:01.707) 0:01:39.201 ******** 2025-10-13 19:33:52.008527 | controller | skipping: [localhost] 2025-10-13 19:33:52.040584 | controller | 2025-10-13 19:33:52.040631 | controller | TASK [openshift_setup : Allow anonymous image-pulls in CRC registry for targeted namespaces state=present, kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, definition={'kind': 'RoleBinding', 'apiVersion': 'rbac.authorization.k8s.io/v1', 'metadata': {'name': 'system:image-puller', 'namespace': '{{ item }}'}, 'subjects': [{'kind': 'User', 'name': 'system:anonymous'}, {'kind': 'User', 'name': 'system:unauthenticated'}], 'roleRef': {'kind': 'ClusterRole', 'name': 'system:image-puller'}}] *** 2025-10-13 19:33:52.040644 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.027) 0:01:39.229 ******** 2025-10-13 19:33:52.040660 | controller | skipping: [localhost] => (item=openstack) 2025-10-13 19:33:52.071010 | controller | skipping: [localhost] => (item=openstack-operators) 2025-10-13 19:33:52.071051 | controller | skipping: [localhost] 2025-10-13 19:33:52.071061 | controller | 2025-10-13 19:33:52.071071 | controller | TASK [openshift_setup : Wait for the image registry to be ready kind=Deployment, name=image-registry, namespace=openshift-image-registry, kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, wait=True, wait_sleep=10, wait_timeout=600, wait_condition={'type': 'Available', 'status': 'True'}] *** 2025-10-13 19:33:52.071080 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.032) 0:01:39.261 ******** 2025-10-13 19:33:52.071095 | controller | skipping: [localhost] 2025-10-13 19:33:52.099356 | controller | 2025-10-13 19:33:52.099420 | controller | TASK [openshift_setup : Login into OpenShift internal registry output_dir={{ cifmw_openshift_setup_basedir }}/artifacts, script=podman login -u {{ cifmw_openshift_user }} -p {{ cifmw_openshift_token }} {%- if cifmw_openshift_setup_skip_internal_registry_tls_verify|bool %} --tls-verify=false {%- endif %} {{ cifmw_openshift_setup_registry_default_route.resources[0].spec.host }}] *** 2025-10-13 19:33:52.099436 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.030) 0:01:39.291 ******** 2025-10-13 19:33:52.099449 | controller | skipping: [localhost] 2025-10-13 19:33:52.132011 | controller | 2025-10-13 19:33:52.132046 | controller | TASK [Ensure we have custom CA installed on host role=install_ca] ************** 2025-10-13 19:33:52.132054 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.028) 0:01:39.320 ******** 2025-10-13 19:33:52.132065 | controller | skipping: [localhost] 2025-10-13 19:33:52.165772 | controller | 2025-10-13 19:33:52.165821 | controller | TASK [openshift_setup : Update ca bundle _raw_params=update-ca-trust extract] *** 2025-10-13 19:33:52.165831 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.032) 0:01:39.353 ******** 2025-10-13 19:33:52.165846 | controller | skipping: [localhost] 2025-10-13 19:33:52.191867 | controller | 2025-10-13 19:33:52.191907 | controller | TASK [openshift_setup : Slurp CAs file src={{ cifmw_openshift_setup_ca_bundle_path }}] *** 2025-10-13 19:33:52.191915 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.033) 0:01:39.386 ******** 2025-10-13 19:33:52.191927 | controller | skipping: [localhost] 2025-10-13 19:33:52.220894 | controller | 2025-10-13 19:33:52.220933 | controller | TASK [openshift_setup : Create config map with registry CAs kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, definition={'apiVersion': 'v1', 'kind': 'ConfigMap', 'metadata': {'namespace': 'openshift-config', 'name': 'registry-cas'}, 'data': '{{ _config_map_data | items2dict }}'}] *** 2025-10-13 19:33:52.220941 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.026) 0:01:39.412 ******** 2025-10-13 19:33:52.220953 | controller | skipping: [localhost] 2025-10-13 19:33:52.252238 | controller | 2025-10-13 19:33:52.252276 | controller | TASK [openshift_setup : Install Red Hat CA for pulling images from internal registry kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, merge_type=merge, definition={'apiVersion': 'config.openshift.io/v1', 'kind': 'Image', 'metadata': {'name': 'cluster'}, 'spec': {'additionalTrustedCA': {'name': 'registry-cas'}}}] *** 2025-10-13 19:33:52.252287 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.029) 0:01:39.441 ******** 2025-10-13 19:33:52.252298 | controller | skipping: [localhost] 2025-10-13 19:33:52.278609 | controller | 2025-10-13 19:33:52.278637 | controller | TASK [openshift_setup : Add insecure registry kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, merge_type=merge, definition={'apiVersion': 'config.openshift.io/v1', 'kind': 'Image', 'metadata': {'name': 'cluster'}, 'spec': {'registrySources': {'insecureRegistries': ['{{ cifmw_update_containers_registry }}'], 'allowedRegistries': '{{ all_registries }}'}}}] *** 2025-10-13 19:33:52.278646 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.031) 0:01:39.473 ******** 2025-10-13 19:33:52.278656 | controller | skipping: [localhost] 2025-10-13 19:33:52.307138 | controller | 2025-10-13 19:33:52.307168 | controller | TASK [openshift_setup : Create a ICSP with repository digest mirrors kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, definition={'apiVersion': 'operator.openshift.io/v1alpha1', 'kind': 'ImageContentSourcePolicy', 'metadata': {'name': 'registry-digest-mirrors'}, 'spec': {'repositoryDigestMirrors': '{{ cifmw_openshift_setup_digest_mirrors }}'}}] *** 2025-10-13 19:33:52.307177 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.026) 0:01:39.499 ******** 2025-10-13 19:33:52.307187 | controller | skipping: [localhost] 2025-10-13 19:33:52.339824 | controller | 2025-10-13 19:33:52.339870 | controller | TASK [openshift_setup : Metal3 tweaks _raw_params=metal3_config.yml] *********** 2025-10-13 19:33:52.339884 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.028) 0:01:39.528 ******** 2025-10-13 19:33:52.339897 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/openshift_setup/tasks/metal3_config.yml for localhost 2025-10-13 19:33:52.361849 | controller | 2025-10-13 19:33:52.361889 | controller | TASK [openshift_setup : Fetch Metal3 configuration name _raw_params=oc get Provisioning -o name] *** 2025-10-13 19:33:52.361897 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.032) 0:01:39.560 ******** 2025-10-13 19:33:52.361910 | controller | skipping: [localhost] 2025-10-13 19:33:52.386074 | controller | 2025-10-13 19:33:52.386123 | controller | TASK [openshift_setup : Apply the patch to Metal3 Provisioning _raw_params=oc patch {{ _cifmw_openshift_setup_provisioning_name.stdout }} --type='json' -p='[{"op": "replace", "path": "/spec/watchAllNamespaces", "value": true}]'] *** 2025-10-13 19:33:52.386131 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.021) 0:01:39.582 ******** 2025-10-13 19:33:52.386143 | controller | skipping: [localhost] 2025-10-13 19:33:53.356152 | controller | 2025-10-13 19:33:53.356191 | controller | TASK [openshift_setup : Gather network.operator info kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, api_version=operator.openshift.io/v1, kind=Network, name=cluster] *** 2025-10-13 19:33:53.356199 | controller | Monday 13 October 2025 19:33:52 +0000 (0:00:00.024) 0:01:39.607 ******** 2025-10-13 19:33:53.356212 | controller | ok: [localhost] 2025-10-13 19:33:54.291715 | controller | 2025-10-13 19:33:54.291782 | controller | TASK [openshift_setup : Patch network operator api_version=operator.openshift.io/v1, kubeconfig={{ cifmw_openshift_kubeconfig }}, kind=Network, name=cluster, persist_config=True, patch=[{'path': '/spec/defaultNetwork/ovnKubernetesConfig/gatewayConfig/routingViaHost', 'value': True, 'op': 'replace'}, {'path': '/spec/defaultNetwork/ovnKubernetesConfig/gatewayConfig/ipForwarding', 'value': 'Global', 'op': 'replace'}]] *** 2025-10-13 19:33:54.291803 | controller | Monday 13 October 2025 19:33:53 +0000 (0:00:00.969) 0:01:40.576 ******** 2025-10-13 19:33:54.291827 | controller | changed: [localhost] 2025-10-13 19:33:55.059817 | controller | 2025-10-13 19:33:55.059881 | controller | TASK [openshift_setup : Patch samples registry configuration kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, api_version=samples.operator.openshift.io/v1, kind=Config, name=cluster, patch=[{'op': 'replace', 'path': '/spec/samplesRegistry', 'value': 'registry.redhat.io'}]] *** 2025-10-13 19:33:55.059897 | controller | Monday 13 October 2025 19:33:54 +0000 (0:00:00.934) 0:01:41.512 ******** 2025-10-13 19:33:55.059921 | controller | changed: [localhost] 2025-10-13 19:33:55.089218 | controller | 2025-10-13 19:33:55.089266 | controller | TASK [openshift_setup : Delete the pods from openshift-marketplace namespace kind=Pod, state=absent, delete_all=True, kubeconfig={{ cifmw_openshift_kubeconfig }}, namespace=openshift-marketplace] *** 2025-10-13 19:33:55.089277 | controller | Monday 13 October 2025 19:33:55 +0000 (0:00:00.767) 0:01:42.279 ******** 2025-10-13 19:33:55.089294 | controller | skipping: [localhost] 2025-10-13 19:33:55.126300 | controller | 2025-10-13 19:33:55.126349 | controller | TASK [openshift_setup : Wait for openshift-marketplace pods to be running _raw_params=oc wait pod --all --for=condition=Ready -n openshift-marketplace --timeout=1m] *** 2025-10-13 19:33:55.126361 | controller | Monday 13 October 2025 19:33:55 +0000 (0:00:00.029) 0:01:42.309 ******** 2025-10-13 19:33:55.126378 | controller | skipping: [localhost] 2025-10-13 19:33:55.199205 | controller | 2025-10-13 19:33:55.199243 | controller | TASK [Attach default network to CRC name=install_yamls_makes, tasks_from=make_crc_attach_default_interface] *** 2025-10-13 19:33:55.199252 | controller | Monday 13 October 2025 19:33:55 +0000 (0:00:00.036) 0:01:42.346 ******** 2025-10-13 19:33:55.199263 | controller | 2025-10-13 19:33:55.242857 | controller | TASK [install_yamls_makes : Debug make_crc_attach_default_interface_env var=make_crc_attach_default_interface_env] *** 2025-10-13 19:33:55.242903 | controller | Monday 13 October 2025 19:33:55 +0000 (0:00:00.073) 0:01:42.420 ******** 2025-10-13 19:33:55.242917 | controller | skipping: [localhost] 2025-10-13 19:33:55.275715 | controller | 2025-10-13 19:33:55.275764 | controller | TASK [install_yamls_makes : Debug make_crc_attach_default_interface_params var=make_crc_attach_default_interface_params] *** 2025-10-13 19:33:55.275775 | controller | Monday 13 October 2025 19:33:55 +0000 (0:00:00.043) 0:01:42.463 ******** 2025-10-13 19:33:55.275791 | controller | skipping: [localhost] 2025-10-13 19:34:00.458078 | controller | 2025-10-13 19:34:00.458154 | controller | TASK [install_yamls_makes : Run crc_attach_default_interface output_dir={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts, chdir=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/devsetup, script=make crc_attach_default_interface, dry_run={{ make_crc_attach_default_interface_dryrun|default(false)|bool }}, extra_args={{ dict((make_crc_attach_default_interface_env|default({})), **(make_crc_attach_default_interface_params|default({}))) }}] *** 2025-10-13 19:34:00.458167 | controller | Monday 13 October 2025 19:33:55 +0000 (0:00:00.032) 0:01:42.496 ******** 2025-10-13 19:34:00.458182 | controller | [WARNING]: conditional statements should not include jinja2 templating 2025-10-13 19:34:00.478464 | controller | delimiters such as {{ }} or {% %}. Found: {{ 2025-10-13 19:34:00.478516 | controller | make_crc_attach_default_interface_until | default(true) }} 2025-10-13 19:34:00.478538 | controller | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_002_run_crc_attach_default.log 2025-10-13 19:34:00.559008 | controller | changed: [localhost] 2025-10-13 19:34:00.559057 | controller | 2025-10-13 19:34:00.559068 | controller | TASK [run_hook : Assert parameters are valid quiet=True, that=['_list_hooks is not string', '_list_hooks is not mapping', '_list_hooks is iterable', '(hooks | default([])) is not string', '(hooks | default([])) is not mapping', '(hooks | default([])) is iterable']] *** 2025-10-13 19:34:00.559078 | controller | Monday 13 October 2025 19:34:00 +0000 (0:00:05.202) 0:01:47.699 ******** 2025-10-13 19:34:00.559095 | controller | ok: [localhost] 2025-10-13 19:34:00.672919 | controller | 2025-10-13 19:34:00.672959 | controller | TASK [run_hook : Assert single hooks are all mappings quiet=True, that=['_not_mapping_hooks | length == 0'], msg=All single hooks must be a list of mappings or a mapping.] *** 2025-10-13 19:34:00.672967 | controller | Monday 13 October 2025 19:34:00 +0000 (0:00:00.080) 0:01:47.779 ******** 2025-10-13 19:34:00.672979 | controller | ok: [localhost] 2025-10-13 19:34:00.838971 | controller | 2025-10-13 19:34:00.839030 | controller | TASK [run_hook : Loop on hooks for pre_kuttl _raw_params={{ hook.type }}.yml] *** 2025-10-13 19:34:00.839040 | controller | Monday 13 October 2025 19:34:00 +0000 (0:00:00.114) 0:01:47.893 ******** 2025-10-13 19:34:00.839057 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/run_hook/tasks/playbook.yml for localhost => (item={'name': 'Fetch crc facts and save them as parameters for kuttl jobs', 'type': 'playbook', 'inventory': '/home/zuul/ci-framework-data/artifacts/zuul_inventory.yml', 'source': 'kuttl_openstack_prep.yml'}) 2025-10-13 19:34:00.894646 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/run_hook/tasks/playbook.yml for localhost => (item={'name': 'Fetch crc facts and save them as parameters for kuttl jobs', 'type': 'playbook', 'inventory': '/home/zuul/ci-framework-data/artifacts/zuul_inventory.yml', 'source': 'kuttl_openstack_prep.yml'}) 2025-10-13 19:34:00.894691 | controller | 2025-10-13 19:34:00.894703 | controller | TASK [run_hook : Set playbook path for Fetch crc facts and save them as parameters for kuttl jobs cifmw_basedir={{ _bdir }}, hook_name={{ _hook_name }}, playbook_path={{ _play | realpath }}, log_path={{ _bdir }}/logs/{{ step }}_{{ _hook_name }}.log, extra_vars=-e operator_namespace={{ _operator_namespace }} -e namespace={{ _namespace}} {%- if hook.extra_vars is defined and hook.extra_vars|length > 0 -%} {% for key,value in hook.extra_vars.items() -%} {%- if key == 'file' %} -e "@{{ value }}" {%- else %} -e "{{ key }}={{ value }}" {%- endif %} {%- endfor %} {%- endif %}] *** 2025-10-13 19:34:00.894721 | controller | Monday 13 October 2025 19:34:00 +0000 (0:00:00.165) 0:01:48.059 ******** 2025-10-13 19:34:00.894738 | controller | ok: [localhost] 2025-10-13 19:34:01.093167 | controller | 2025-10-13 19:34:01.093203 | controller | TASK [run_hook : Get file stat path={{ playbook_path }}] *********************** 2025-10-13 19:34:01.093211 | controller | Monday 13 October 2025 19:34:00 +0000 (0:00:00.055) 0:01:48.115 ******** 2025-10-13 19:34:01.093223 | controller | ok: [localhost] 2025-10-13 19:34:01.116530 | controller | 2025-10-13 19:34:01.116563 | controller | TASK [run_hook : Fail if playbook doesn't exist msg=Playbook {{ playbook_path }} doesn't seem to exist.] *** 2025-10-13 19:34:01.116570 | controller | Monday 13 October 2025 19:34:01 +0000 (0:00:00.198) 0:01:48.314 ******** 2025-10-13 19:34:01.116582 | controller | skipping: [localhost] 2025-10-13 19:34:01.299250 | controller | 2025-10-13 19:34:01.299295 | controller | TASK [run_hook : Get parameters files paths={{ 2025-10-13 19:34:01.299305 | controller | (cifmw_basedir, 'artifacts/parameters') | path_join 2025-10-13 19:34:01.299314 | controller | }}, file_type=file, patterns=*.yml] *** 2025-10-13 19:34:01.299321 | controller | Monday 13 October 2025 19:34:01 +0000 (0:00:00.023) 0:01:48.337 ******** 2025-10-13 19:34:01.299335 | controller | ok: [localhost] 2025-10-13 19:34:01.324369 | controller | 2025-10-13 19:34:01.324431 | controller | TASK [run_hook : Add parameters artifacts as extra variables extra_vars={{ extra_vars }} {% for file in cifmw_run_hook_parameters_files.files %} -e "@{{ file.path }}" {%- endfor %}] *** 2025-10-13 19:34:01.324440 | controller | Monday 13 October 2025 19:34:01 +0000 (0:00:00.182) 0:01:48.520 ******** 2025-10-13 19:34:01.324452 | controller | ok: [localhost] 2025-10-13 19:34:01.509795 | controller | 2025-10-13 19:34:01.509846 | controller | TASK [run_hook : Ensure log directory exists path={{ log_path | dirname }}, state=directory, mode=0755] *** 2025-10-13 19:34:01.509855 | controller | Monday 13 October 2025 19:34:01 +0000 (0:00:00.025) 0:01:48.545 ******** 2025-10-13 19:34:01.509868 | controller | ok: [localhost] 2025-10-13 19:34:01.703747 | controller | 2025-10-13 19:34:01.703806 | controller | TASK [run_hook : Ensure artifacts directory exists path={{ cifmw_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:34:01.703823 | controller | Monday 13 October 2025 19:34:01 +0000 (0:00:00.185) 0:01:48.730 ******** 2025-10-13 19:34:01.703845 | controller | ok: [localhost] 2025-10-13 19:34:03.446332 | controller | 2025-10-13 19:34:03.446375 | controller | TASK [run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:03.446383 | controller | Monday 13 October 2025 19:34:01 +0000 (0:00:00.193) 0:01:48.924 ******** 2025-10-13 19:34:03.446419 | controller | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_003_run_hook_without_retry_fetch.log 2025-10-13 19:34:03.472887 | controller | changed: [localhost] 2025-10-13 19:34:03.472926 | controller | 2025-10-13 19:34:03.472933 | controller | TASK [run_hook : Run hook with retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:03.472940 | controller | Monday 13 October 2025 19:34:03 +0000 (0:00:01.743) 0:01:50.667 ******** 2025-10-13 19:34:03.472952 | controller | skipping: [localhost] 2025-10-13 19:34:03.658149 | controller | 2025-10-13 19:34:03.658188 | controller | TASK [run_hook : Check if we have a file path={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:03.658196 | controller | Monday 13 October 2025 19:34:03 +0000 (0:00:00.026) 0:01:50.693 ******** 2025-10-13 19:34:03.658208 | controller | ok: [localhost] 2025-10-13 19:34:03.680765 | controller | 2025-10-13 19:34:03.680811 | controller | TASK [run_hook : Load generated content in main playbook file={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:03.680819 | controller | Monday 13 October 2025 19:34:03 +0000 (0:00:00.185) 0:01:50.879 ******** 2025-10-13 19:34:03.680831 | controller | skipping: [localhost] 2025-10-13 19:34:03.733906 | controller | 2025-10-13 19:34:03.733947 | controller | TASK [run_hook : Set playbook path for Fetch crc facts and save them as parameters for kuttl jobs cifmw_basedir={{ _bdir }}, hook_name={{ _hook_name }}, playbook_path={{ _play | realpath }}, log_path={{ _bdir }}/logs/{{ step }}_{{ _hook_name }}.log, extra_vars=-e operator_namespace={{ _operator_namespace }} -e namespace={{ _namespace}} {%- if hook.extra_vars is defined and hook.extra_vars|length > 0 -%} {% for key,value in hook.extra_vars.items() -%} {%- if key == 'file' %} -e "@{{ value }}" {%- else %} -e "{{ key }}={{ value }}" {%- endif %} {%- endfor %} {%- endif %}] *** 2025-10-13 19:34:03.733962 | controller | Monday 13 October 2025 19:34:03 +0000 (0:00:00.022) 0:01:50.901 ******** 2025-10-13 19:34:03.733974 | controller | ok: [localhost] 2025-10-13 19:34:03.942862 | controller | 2025-10-13 19:34:03.942906 | controller | TASK [run_hook : Get file stat path={{ playbook_path }}] *********************** 2025-10-13 19:34:03.942917 | controller | Monday 13 October 2025 19:34:03 +0000 (0:00:00.053) 0:01:50.954 ******** 2025-10-13 19:34:03.942933 | controller | ok: [localhost] 2025-10-13 19:34:03.965507 | controller | 2025-10-13 19:34:03.965545 | controller | TASK [run_hook : Fail if playbook doesn't exist msg=Playbook {{ playbook_path }} doesn't seem to exist.] *** 2025-10-13 19:34:03.965553 | controller | Monday 13 October 2025 19:34:03 +0000 (0:00:00.208) 0:01:51.163 ******** 2025-10-13 19:34:03.965565 | controller | skipping: [localhost] 2025-10-13 19:34:04.143713 | controller | 2025-10-13 19:34:04.143754 | controller | TASK [run_hook : Get parameters files paths={{ 2025-10-13 19:34:04.143763 | controller | (cifmw_basedir, 'artifacts/parameters') | path_join 2025-10-13 19:34:04.143769 | controller | }}, file_type=file, patterns=*.yml] *** 2025-10-13 19:34:04.143775 | controller | Monday 13 October 2025 19:34:03 +0000 (0:00:00.022) 0:01:51.186 ******** 2025-10-13 19:34:04.143787 | controller | ok: [localhost] 2025-10-13 19:34:04.168948 | controller | 2025-10-13 19:34:04.168985 | controller | TASK [run_hook : Add parameters artifacts as extra variables extra_vars={{ extra_vars }} {% for file in cifmw_run_hook_parameters_files.files %} -e "@{{ file.path }}" {%- endfor %}] *** 2025-10-13 19:34:04.168993 | controller | Monday 13 October 2025 19:34:04 +0000 (0:00:00.178) 0:01:51.364 ******** 2025-10-13 19:34:04.169006 | controller | ok: [localhost] 2025-10-13 19:34:04.352651 | controller | 2025-10-13 19:34:04.352695 | controller | TASK [run_hook : Ensure log directory exists path={{ log_path | dirname }}, state=directory, mode=0755] *** 2025-10-13 19:34:04.352707 | controller | Monday 13 October 2025 19:34:04 +0000 (0:00:00.025) 0:01:51.390 ******** 2025-10-13 19:34:04.352724 | controller | ok: [localhost] 2025-10-13 19:34:04.542217 | controller | 2025-10-13 19:34:04.542256 | controller | TASK [run_hook : Ensure artifacts directory exists path={{ cifmw_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:34:04.542265 | controller | Monday 13 October 2025 19:34:04 +0000 (0:00:00.183) 0:01:51.573 ******** 2025-10-13 19:34:04.542277 | controller | ok: [localhost] 2025-10-13 19:34:06.310242 | controller | 2025-10-13 19:34:06.310321 | controller | TASK [run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:06.310338 | controller | Monday 13 October 2025 19:34:04 +0000 (0:00:00.189) 0:01:51.763 ******** 2025-10-13 19:34:06.310361 | controller | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_004_run_hook_without_retry_fetch.log 2025-10-13 19:34:06.340474 | controller | changed: [localhost] 2025-10-13 19:34:06.340516 | controller | 2025-10-13 19:34:06.340527 | controller | TASK [run_hook : Run hook with retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:06.340537 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:01.767) 0:01:53.530 ******** 2025-10-13 19:34:06.340552 | controller | skipping: [localhost] 2025-10-13 19:34:06.516450 | controller | 2025-10-13 19:34:06.516492 | controller | TASK [run_hook : Check if we have a file path={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:06.516502 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.030) 0:01:53.561 ******** 2025-10-13 19:34:06.516517 | controller | ok: [localhost] 2025-10-13 19:34:06.548868 | controller | 2025-10-13 19:34:06.548903 | controller | TASK [run_hook : Load generated content in main playbook file={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:06.548911 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.175) 0:01:53.737 ******** 2025-10-13 19:34:06.548922 | controller | skipping: [localhost] 2025-10-13 19:34:06.628771 | controller | 2025-10-13 19:34:06.628806 | controller | TASK [Run kuttl tests _raw_params=run-kuttl-tests.yml] ************************* 2025-10-13 19:34:06.628819 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.032) 0:01:53.769 ******** 2025-10-13 19:34:06.628830 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=openstack) 2025-10-13 19:34:06.687558 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=barbican) 2025-10-13 19:34:06.687593 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=keystone) 2025-10-13 19:34:06.687601 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=horizon) 2025-10-13 19:34:06.687607 | controller | 2025-10-13 19:34:06.687613 | controller | TASK [Load parameters dir={{ cifmw_basedir }}/artifacts/parameters] ************ 2025-10-13 19:34:06.687619 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.079) 0:01:53.849 ******** 2025-10-13 19:34:06.687630 | controller | ok: [localhost] 2025-10-13 19:34:06.719561 | controller | 2025-10-13 19:34:06.719595 | controller | TASK [Use the locally built operators if any _local_operators_indexes={{ _local_operators_indexes|default({}) | combine({ item.key.split('-')[0]|upper+'_IMG': cifmw_operator_build_output['operators'][item.key].image_catalog}) }}] *** 2025-10-13 19:34:06.719603 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.058) 0:01:53.908 ******** 2025-10-13 19:34:06.719617 | controller | skipping: [localhost] 2025-10-13 19:34:06.750766 | controller | 2025-10-13 19:34:06.750800 | controller | TASK [Set environment vars for kuttl test cifmw_kuttl_tests_env={{ 2025-10-13 19:34:06.750808 | controller | _local_operators_indexes | default({}) | 2025-10-13 19:34:06.750814 | controller | combine(cifmw_install_yamls_environment) | 2025-10-13 19:34:06.750820 | controller | combine(cifmw_kuttl_tests_env_vars | default({})) | 2025-10-13 19:34:06.750826 | controller | combine(cifmw_kuttl_openstack_prep_vars | default({})) | 2025-10-13 19:34:06.750832 | controller | combine({'PATH': cifmw_path}) 2025-10-13 19:34:06.750838 | controller | }}] *** 2025-10-13 19:34:06.750844 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.031) 0:01:53.940 ******** 2025-10-13 19:34:06.750855 | controller | ok: [localhost] 2025-10-13 19:34:06.790245 | controller | 2025-10-13 19:34:06.790293 | controller | TASK [Clean storage beforehand name=ci_local_storage, tasks_from=cleanup.yml] *** 2025-10-13 19:34:06.790301 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.031) 0:01:53.971 ******** 2025-10-13 19:34:06.790311 | controller | 2025-10-13 19:34:07.529435 | controller | TASK [ci_local_storage : Get all pvs kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=PersistentVolume, label_selectors=['provisioned-by={{ cifmw_cls_storage_provisioner }}']] *** 2025-10-13 19:34:07.529468 | controller | Monday 13 October 2025 19:34:06 +0000 (0:00:00.039) 0:01:54.011 ******** 2025-10-13 19:34:07.529480 | controller | ok: [localhost] 2025-10-13 19:34:07.571502 | controller | 2025-10-13 19:34:07.571544 | controller | TASK [ci_local_storage : Export PVs as facts cifmw_cls_pvs={{ _pv_info.resources | 2025-10-13 19:34:07.571554 | controller | selectattr("metadata.name", "defined") | 2025-10-13 19:34:07.571563 | controller | map(attribute="metadata.name") 2025-10-13 19:34:07.571571 | controller | }}] *** 2025-10-13 19:34:07.571579 | controller | Monday 13 October 2025 19:34:07 +0000 (0:00:00.739) 0:01:54.750 ******** 2025-10-13 19:34:07.571593 | controller | ok: [localhost] 2025-10-13 19:34:07.596219 | controller | 2025-10-13 19:34:07.596251 | controller | TASK [ci_local_storage : Delete all pvs kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=PersistentVolume, state=absent, api_version=v1, namespace={{ cifmw_cls_namespace }}, name={{ item }}] *** 2025-10-13 19:34:07.596259 | controller | Monday 13 October 2025 19:34:07 +0000 (0:00:00.041) 0:01:54.792 ******** 2025-10-13 19:34:07.596270 | controller | skipping: [localhost] 2025-10-13 19:34:08.381936 | controller | 2025-10-13 19:34:08.381968 | controller | TASK [ci_local_storage : Get k8s nodes kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Node] *** 2025-10-13 19:34:08.381982 | controller | Monday 13 October 2025 19:34:07 +0000 (0:00:00.024) 0:01:54.817 ******** 2025-10-13 19:34:08.381993 | controller | ok: [localhost] 2025-10-13 19:34:10.007440 | controller | 2025-10-13 19:34:10.007473 | controller | TASK [ci_local_storage : Fetch hostnames for all hosts _raw_params=hostname] *** 2025-10-13 19:34:10.007480 | controller | Monday 13 October 2025 19:34:08 +0000 (0:00:00.785) 0:01:55.602 ******** 2025-10-13 19:34:10.007491 | controller | [WARNING]: Platform linux on host localhost is using the discovered Python 2025-10-13 19:34:10.014838 | controller | interpreter at /usr/bin/python3.9, but future installation of another Python 2025-10-13 19:34:10.014860 | controller | interpreter could change the meaning of that path. See 2025-10-13 19:34:10.014867 | controller | https://docs.ansible.com/ansible- 2025-10-13 19:34:10.014873 | controller | core/2.15/reference_appendices/interpreter_discovery.html for more information. 2025-10-13 19:34:10.014883 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=crc) 2025-10-13 19:34:10.058099 | controller | changed: [localhost -> controller(38.102.83.182)] => (item=controller) 2025-10-13 19:34:10.058138 | controller | changed: [localhost] => (item=localhost) 2025-10-13 19:34:10.058147 | controller | 2025-10-13 19:34:10.058153 | controller | TASK [ci_local_storage : Set the hosts k8s ansible hosts cifmw_ci_local_storage_k8s_hosts={{ 2025-10-13 19:34:10.058161 | controller | _host_map | 2025-10-13 19:34:10.058167 | controller | selectattr("key", "in", k8s_nodes_hostnames) | 2025-10-13 19:34:10.058173 | controller | map(attribute="value") | 2025-10-13 19:34:10.058179 | controller | list 2025-10-13 19:34:10.058184 | controller | }}, cifmw_ci_local_storage_k8s_hostnames={{ k8s_nodes_hostnames }}] *** 2025-10-13 19:34:10.058190 | controller | Monday 13 October 2025 19:34:10 +0000 (0:00:01.632) 0:01:57.235 ******** 2025-10-13 19:34:10.058200 | controller | ok: [localhost] 2025-10-13 19:34:10.092986 | controller | 2025-10-13 19:34:10.093026 | controller | TASK [ci_local_storage : Delete directories on worker node _raw_params=worker_node_dirs.yml] *** 2025-10-13 19:34:10.093036 | controller | Monday 13 October 2025 19:34:10 +0000 (0:00:00.042) 0:01:57.278 ******** 2025-10-13 19:34:10.093050 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_local_storage/tasks/worker_node_dirs.yml for localhost => (item=crc) 2025-10-13 19:34:15.877925 | controller | 2025-10-13 19:34:15.877993 | controller | TASK [ci_local_storage : Perform action in the PV directory path={{ 2025-10-13 19:34:15.878000 | controller | [ 2025-10-13 19:34:15.878006 | controller | cifmw_cls_local_storage_name, 2025-10-13 19:34:15.878013 | controller | 'pv'+ ("%02d" | format(item | int)) 2025-10-13 19:34:15.878025 | controller | ] | path_join 2025-10-13 19:34:15.878033 | controller | }}, state={{ 2025-10-13 19:34:15.878040 | controller | 'directory' if cifmw_cls_action == 'create' else 'absent' 2025-10-13 19:34:15.878048 | controller | }}, mode=0775] *** 2025-10-13 19:34:15.878055 | controller | Monday 13 October 2025 19:34:10 +0000 (0:00:00.035) 0:01:57.314 ******** 2025-10-13 19:34:15.878071 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=1) 2025-10-13 19:34:26.650153 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=2) 2025-10-13 19:34:26.650189 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=3) 2025-10-13 19:34:26.650196 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=4) 2025-10-13 19:34:26.650202 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=5) 2025-10-13 19:34:26.650208 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=6) 2025-10-13 19:34:26.650214 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=7) 2025-10-13 19:34:26.650220 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=8) 2025-10-13 19:34:26.650225 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=9) 2025-10-13 19:34:26.650231 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=10) 2025-10-13 19:34:26.650237 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=11) 2025-10-13 19:34:26.650243 | controller | ok: [localhost -> crc(38.102.83.181)] => (item=12) 2025-10-13 19:34:26.650249 | controller | 2025-10-13 19:34:26.650256 | controller | TASK [ci_local_storage : Remove the cifmw_cls_namespace namespace state=absent, kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Namespace, name={{ cifmw_cls_namespace }}, wait=True, wait_timeout=300] *** 2025-10-13 19:34:26.650268 | controller | Monday 13 October 2025 19:34:15 +0000 (0:00:05.784) 0:02:03.098 ******** 2025-10-13 19:34:26.650279 | controller | changed: [localhost] 2025-10-13 19:34:26.705628 | controller | 2025-10-13 19:34:26.705667 | controller | TASK [Create storage name=ci_local_storage] ************************************ 2025-10-13 19:34:26.705675 | controller | Monday 13 October 2025 19:34:26 +0000 (0:00:10.773) 0:02:13.871 ******** 2025-10-13 19:34:26.705685 | controller | 2025-10-13 19:34:26.909246 | controller | TASK [ci_local_storage : Create role needed directories path={{ cifmw_cls_manifests_dir }}, state=directory, mode=0755] *** 2025-10-13 19:34:26.909286 | controller | Monday 13 October 2025 19:34:26 +0000 (0:00:00.055) 0:02:13.926 ******** 2025-10-13 19:34:26.909300 | controller | changed: [localhost] 2025-10-13 19:34:27.644417 | controller | 2025-10-13 19:34:27.644460 | controller | TASK [ci_local_storage : Create the cifmw_cls_namespace namespace" kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit) }}, name={{ cifmw_cls_namespace }}, kind=Namespace, state=present] *** 2025-10-13 19:34:27.644470 | controller | Monday 13 October 2025 19:34:26 +0000 (0:00:00.203) 0:02:14.130 ******** 2025-10-13 19:34:27.644481 | controller | changed: [localhost] 2025-10-13 19:34:28.064760 | controller | 2025-10-13 19:34:28.064811 | controller | TASK [ci_local_storage : Save storage manifests as artifacts dest={{ cifmw_cls_manifests_dir }}/storage-class.yaml, content={{ cifmw_cls_storage_manifest | to_nice_yaml }}, mode=0644] *** 2025-10-13 19:34:28.064825 | controller | Monday 13 October 2025 19:34:27 +0000 (0:00:00.735) 0:02:14.865 ******** 2025-10-13 19:34:28.064844 | controller | changed: [localhost] 2025-10-13 19:34:28.841797 | controller | 2025-10-13 19:34:28.841853 | controller | TASK [ci_local_storage : Get k8s nodes kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Node] *** 2025-10-13 19:34:28.841869 | controller | Monday 13 October 2025 19:34:28 +0000 (0:00:00.419) 0:02:15.285 ******** 2025-10-13 19:34:28.841891 | controller | ok: [localhost] 2025-10-13 19:34:29.832181 | controller | 2025-10-13 19:34:29.832227 | controller | TASK [ci_local_storage : Fetch hostnames for all hosts _raw_params=hostname] *** 2025-10-13 19:34:29.832234 | controller | Monday 13 October 2025 19:34:28 +0000 (0:00:00.776) 0:02:16.061 ******** 2025-10-13 19:34:29.832247 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=crc) 2025-10-13 19:34:29.874288 | controller | changed: [localhost -> controller(38.102.83.182)] => (item=controller) 2025-10-13 19:34:29.874331 | controller | changed: [localhost] => (item=localhost) 2025-10-13 19:34:29.874341 | controller | 2025-10-13 19:34:29.874349 | controller | TASK [ci_local_storage : Set the hosts k8s ansible hosts cifmw_ci_local_storage_k8s_hosts={{ 2025-10-13 19:34:29.874357 | controller | _host_map | 2025-10-13 19:34:29.874365 | controller | selectattr("key", "in", k8s_nodes_hostnames) | 2025-10-13 19:34:29.874373 | controller | map(attribute="value") | 2025-10-13 19:34:29.874380 | controller | list 2025-10-13 19:34:29.874388 | controller | }}, cifmw_ci_local_storage_k8s_hostnames={{ k8s_nodes_hostnames }}] *** 2025-10-13 19:34:29.874450 | controller | Monday 13 October 2025 19:34:29 +0000 (0:00:00.991) 0:02:17.053 ******** 2025-10-13 19:34:29.874468 | controller | ok: [localhost] 2025-10-13 19:34:30.568892 | controller | 2025-10-13 19:34:30.568930 | controller | TASK [ci_local_storage : Apply the storage class manifests kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit) }}, context={{ cifmw_openshift_context | default(omit) }}, state=present, src={{ cifmw_cls_manifests_dir }}/storage-class.yaml] *** 2025-10-13 19:34:30.568939 | controller | Monday 13 October 2025 19:34:29 +0000 (0:00:00.041) 0:02:17.095 ******** 2025-10-13 19:34:30.568950 | controller | changed: [localhost] 2025-10-13 19:34:30.603691 | controller | 2025-10-13 19:34:30.603728 | controller | TASK [ci_local_storage : Create directories on worker node _raw_params=worker_node_dirs.yml] *** 2025-10-13 19:34:30.603742 | controller | Monday 13 October 2025 19:34:30 +0000 (0:00:00.694) 0:02:17.789 ******** 2025-10-13 19:34:30.603753 | controller | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_local_storage/tasks/worker_node_dirs.yml for localhost => (item=crc) 2025-10-13 19:34:36.376146 | controller | 2025-10-13 19:34:36.376181 | controller | TASK [ci_local_storage : Perform action in the PV directory path={{ 2025-10-13 19:34:36.376189 | controller | [ 2025-10-13 19:34:36.376195 | controller | cifmw_cls_local_storage_name, 2025-10-13 19:34:36.376202 | controller | 'pv'+ ("%02d" | format(item | int)) 2025-10-13 19:34:36.376208 | controller | ] | path_join 2025-10-13 19:34:36.376214 | controller | }}, state={{ 2025-10-13 19:34:36.376220 | controller | 'directory' if cifmw_cls_action == 'create' else 'absent' 2025-10-13 19:34:36.376226 | controller | }}, mode=0775] *** 2025-10-13 19:34:36.376232 | controller | Monday 13 October 2025 19:34:30 +0000 (0:00:00.034) 0:02:17.824 ******** 2025-10-13 19:34:36.376242 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=1) 2025-10-13 19:34:36.800079 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=2) 2025-10-13 19:34:36.800125 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=3) 2025-10-13 19:34:36.800135 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=4) 2025-10-13 19:34:36.800147 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=5) 2025-10-13 19:34:36.800155 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=6) 2025-10-13 19:34:36.800164 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=7) 2025-10-13 19:34:36.800172 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=8) 2025-10-13 19:34:36.800180 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=9) 2025-10-13 19:34:36.800189 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=10) 2025-10-13 19:34:36.800197 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=11) 2025-10-13 19:34:36.800205 | controller | changed: [localhost -> crc(38.102.83.181)] => (item=12) 2025-10-13 19:34:36.800213 | controller | 2025-10-13 19:34:36.800222 | controller | TASK [ci_local_storage : Generate pv related storage manifest file src=storage.yaml.j2, dest={{ cifmw_cls_manifests_dir }}/storage.yaml, mode=0644] *** 2025-10-13 19:34:36.800231 | controller | Monday 13 October 2025 19:34:36 +0000 (0:00:05.772) 0:02:23.597 ******** 2025-10-13 19:34:36.800246 | controller | changed: [localhost] 2025-10-13 19:34:37.668291 | controller | 2025-10-13 19:34:37.668332 | controller | TASK [ci_local_storage : Apply pv related storage manifest file kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit) }}, context={{ cifmw_openshift_context | default(omit) }}, state=present, src={{ cifmw_cls_manifests_dir }}/storage.yaml] *** 2025-10-13 19:34:37.668344 | controller | Monday 13 October 2025 19:34:36 +0000 (0:00:00.423) 0:02:24.020 ******** 2025-10-13 19:34:37.668364 | controller | changed: [localhost] 2025-10-13 19:34:38.453339 | controller | 2025-10-13 19:34:38.453414 | controller | TASK [Get resource status before openstack_kuttl run _raw_params={{ item }} >> {{ cifmw_artifacts_basedir }}/logs/cmd_before_{{ operator }}_kuttl.log 2025-10-13 19:34:38.453425 | controller | ] *** 2025-10-13 19:34:38.453431 | controller | Monday 13 October 2025 19:34:37 +0000 (0:00:00.868) 0:02:24.889 ******** 2025-10-13 19:34:38.453448 | controller | changed: [localhost] => (item=oc get pv) 2025-10-13 19:34:38.481631 | controller | changed: [localhost] => (item=oc get all) 2025-10-13 19:34:38.481672 | controller | 2025-10-13 19:34:38.481680 | controller | TASK [Set make_openstack_kuttl_env vars make_{{ operator }}_kuttl_env={{ cifmw_kuttl_tests_env }}] *** 2025-10-13 19:34:38.481687 | controller | Monday 13 October 2025 19:34:38 +0000 (0:00:00.785) 0:02:25.674 ******** 2025-10-13 19:34:38.481698 | controller | ok: [localhost] 2025-10-13 19:34:38.542142 | controller | 2025-10-13 19:34:38.542197 | controller | TASK [Run make_openstack_kuttl name=install_yamls_makes, tasks_from=make_{{ operator }}_kuttl.yml, apply={'ignore_errors': True}] *** 2025-10-13 19:34:38.542205 | controller | Monday 13 October 2025 19:34:38 +0000 (0:00:00.027) 0:02:25.702 ******** 2025-10-13 19:34:38.542248 | controller | 2025-10-13 19:34:38.571157 | controller | TASK [install_yamls_makes : Debug make_openstack_kuttl_env var=make_openstack_kuttl_env] *** 2025-10-13 19:34:38.571214 | controller | Monday 13 October 2025 19:34:38 +0000 (0:00:00.060) 0:02:25.763 ******** 2025-10-13 19:34:38.571229 | controller | ok: [localhost] => 2025-10-13 19:34:38.596235 | controller | make_openstack_kuttl_env: 2025-10-13 19:34:38.596292 | controller | BMO_SETUP: false 2025-10-13 19:34:38.596301 | controller | CHECKOUT_FROM_OPENSTACK_REF: 'true' 2025-10-13 19:34:38.596309 | controller | KUBECONFIG: /home/zuul/.crc/machines/crc/kubeconfig 2025-10-13 19:34:38.596317 | controller | NETWORK_MTU: 1500 2025-10-13 19:34:38.596325 | controller | NNCP_DNS_SERVER: 192.168.122.10 2025-10-13 19:34:38.596332 | controller | NNCP_INTERFACE: ens7 2025-10-13 19:34:38.596339 | controller | OPENSTACK_K8S_BRANCH: main 2025-10-13 19:34:38.596347 | controller | OUT: /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 19:34:38.596354 | controller | OUTPUT_DIR: /home/zuul/ci-framework-data/artifacts/edpm 2025-10-13 19:34:38.596362 | controller | PATH: /home/zuul/.crc/bin:/home/zuul/.crc/bin/oc:/home/zuul/bin:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2025-10-13 19:34:38.596370 | controller | PV_NUM: 20 2025-10-13 19:34:38.596378 | controller | 2025-10-13 19:34:38.596384 | controller | TASK [install_yamls_makes : Debug make_openstack_kuttl_params var=make_openstack_kuttl_params] *** 2025-10-13 19:34:38.596390 | controller | Monday 13 October 2025 19:34:38 +0000 (0:00:00.029) 0:02:25.792 ******** 2025-10-13 19:34:38.596440 | controller | skipping: [localhost] 2025-10-13 20:41:19.912072 | controller | 2025-10-13 20:41:19.913638 | controller | TASK [install_yamls_makes : Run openstack_kuttl output_dir={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts, chdir=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls, script=make openstack_kuttl, dry_run={{ make_openstack_kuttl_dryrun|default(false)|bool }}, extra_args={{ dict((make_openstack_kuttl_env|default({})), **(make_openstack_kuttl_params|default({}))) }}] *** 2025-10-13 20:41:19.913660 | controller | Monday 13 October 2025 19:34:38 +0000 (0:00:00.025) 0:02:25.817 ******** 2025-10-13 20:41:19.913677 | controller | [WARNING]: conditional statements should not include jinja2 templating 2025-10-13 20:41:20.150426 | controller | delimiters such as {{ }} or {% %}. Found: {{ make_openstack_kuttl_until | 2025-10-13 20:41:20.150500 | controller | default(true) }} 2025-10-13 20:41:20.150524 | controller | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_005_run_openstack.log 2025-10-13 20:41:20.150537 | controller | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: NoneType: None 2025-10-13 20:41:20.150546 | controller | task path: /home/zuul/ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_kuttl.yml:10 2025-10-13 20:41:20.150553 | controller | fatal: [localhost]: FAILED! => 2025-10-13 20:41:20.150559 | controller | attempts: 1 2025-10-13 20:41:20.150565 | controller | changed: true 2025-10-13 20:41:20.150571 | controller | msg: non-zero return code 2025-10-13 20:41:20.150577 | controller | rc: 2 2025-10-13 20:41:20.150583 | controller | stderr: '' 2025-10-13 20:41:20.150589 | controller | stderr_lines: [] 2025-10-13 20:41:20.150595 | controller | stdout: "~/src/github.com/openstack-k8s-operators/install_yamls ~/ci-framework-data/artifacts\nerror: 2025-10-13 20:41:20.150601 | controller | the server doesn't have a resource type \"openstackversion\"\nbash scripts/gen-namespace.sh\n+ 2025-10-13 20:41:20.150608 | controller | '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z openstack-kuttl-tests 2025-10-13 20:41:20.150614 | controller | ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests\n+ 2025-10-13 20:41:20.150620 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests 2025-10-13 20:41:20.150626 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests\n+ 2025-10-13 20:41:20.150631 | controller | cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/namespace.yaml\nnamespace/openstack-kuttl-tests 2025-10-13 20:41:20.150638 | controller | created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.150644 | controller | openstack-kuttl-tests); do sleep 1; done\"\nNAME DISPLAY NAME 2025-10-13 20:41:20.150665 | controller | \ STATUS\nopenstack-kuttl-tests Active\noc project openstack-kuttl-tests\nNow 2025-10-13 20:41:20.150671 | controller | using project \"openstack-kuttl-tests\" on server \"https://api.crc.testing:6443\".\nbash 2025-10-13 20:41:20.150677 | controller | scripts/gen-input-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ 2025-10-13 20:41:20.150683 | controller | '[' -z openstack-kuttl-tests ']'\n+ '[' -z osp-secret ']'\n+ '[' -z 12345678 ']'\n+ 2025-10-13 20:41:20.150688 | controller | '[' -z 1234567842 ']'\n+ '[' -z 767c3ed056cbaa3b9dfedb8c6f825bf0 ']'\n+ '[' -z sEFmdFjDUqRM2VemYslV5yGNWjokioJXsg8Nrlc3drU= 2025-10-13 20:41:20.150694 | controller | ']'\n+ '[' -z COX8bmlKAWn56XCGMrKQJj7dgHNAOl6f ']'\n+ '[' -z openstack ']'\n+ '[' 2025-10-13 20:41:20.150700 | controller | -z libvirt-secret ']'\n+ DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input\n+ 2025-10-13 20:41:20.150706 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.150711 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input\n+ 2025-10-13 20:41:20.150717 | controller | pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input\n~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.150724 | controller | ~/src/github.com/openstack-k8s-operators/install_yamls\n+ cat\noc get secret/osp-secret 2025-10-13 20:41:20.150729 | controller | || oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.150735 | controller | | oc apply -f -\nError from server (NotFound): secrets \"osp-secret\" not found\nsecret/libvirt-secret 2025-10-13 20:41:20.150741 | controller | created\nsecret/octavia-ca-passphrase created\nsecret/osp-secret created\noc kustomize 2025-10-13 20:41:20.150746 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr 2025-10-13 20:41:20.150752 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.150758 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr' 2025-10-13 20:41:20.150763 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila: 2025-10-13 20:41:20.150769 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator 2025-10-13 20:41:20.150775 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr\noc 2025-10-13 20:41:20.150780 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.150786 | controller | database if exists manila;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.150792 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr 2025-10-13 20:41:20.150798 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.150803 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr' 2025-10-13 20:41:20.150809 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat: 2025-10-13 20:41:20.150823 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator 2025-10-13 20:41:20.150831 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr\noc 2025-10-13 20:41:20.150839 | controller | kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr 2025-10-13 20:41:20.150846 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.150851 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr' 2025-10-13 20:41:20.150861 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon: 2025-10-13 20:41:20.150866 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator 2025-10-13 20:41:20.150872 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr\noc 2025-10-13 20:41:20.150878 | controller | kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr 2025-10-13 20:41:20.150883 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.150889 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr' 2025-10-13 20:41:20.150895 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova: 2025-10-13 20:41:20.150900 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/nova-operator 2025-10-13 20:41:20.150908 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr\noc 2025-10-13 20:41:20.150914 | controller | rsh openstack-galera-0 mysql -u root --password=12345678 -ss -e \"show databases 2025-10-13 20:41:20.150919 | controller | like 'nova_%';\" | xargs -I '{}' oc rsh openstack-galera-0 mysql -u root --password=12345678 2025-10-13 20:41:20.150925 | controller | -ss -e \"flush tables; drop database if exists {};\"\nError from server (NotFound): 2025-10-13 20:41:20.150931 | controller | pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr 2025-10-13 20:41:20.150937 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.150942 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr' 2025-10-13 20:41:20.150948 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis: 2025-10-13 20:41:20.150954 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator-redis 2025-10-13 20:41:20.150959 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr\noc 2025-10-13 20:41:20.150965 | controller | kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr 2025-10-13 20:41:20.150971 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.150976 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr' 2025-10-13 20:41:20.150982 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia: 2025-10-13 20:41:20.150989 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator 2025-10-13 20:41:20.150995 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr\noc 2025-10-13 20:41:20.151000 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151006 | controller | database if exists octavia;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151012 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr 2025-10-13 20:41:20.151018 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151023 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr' 2025-10-13 20:41:20.151029 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate: 2025-10-13 20:41:20.151037 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator 2025-10-13 20:41:20.151043 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr\noc 2025-10-13 20:41:20.151049 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151054 | controller | database if exists designate;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151067 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr 2025-10-13 20:41:20.151075 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151083 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr' 2025-10-13 20:41:20.151090 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron: 2025-10-13 20:41:20.151095 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator 2025-10-13 20:41:20.151101 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr\noc 2025-10-13 20:41:20.151107 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151112 | controller | database if exists neutron;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151118 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr 2025-10-13 20:41:20.151124 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151130 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr' 2025-10-13 20:41:20.151135 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn: 2025-10-13 20:41:20.151141 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator 2025-10-13 20:41:20.151147 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr\noc 2025-10-13 20:41:20.151152 | controller | kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr 2025-10-13 20:41:20.151158 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151164 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr' 2025-10-13 20:41:20.151169 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic: 2025-10-13 20:41:20.151175 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator 2025-10-13 20:41:20.151180 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr\noc 2025-10-13 20:41:20.151186 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151192 | controller | database if exists ironic;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151197 | controller | not found\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush 2025-10-13 20:41:20.151203 | controller | tables; drop database if exists ironic_inspector;\" || true\nError from server (NotFound): 2025-10-13 20:41:20.151209 | controller | pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr 2025-10-13 20:41:20.151214 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151220 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr' 2025-10-13 20:41:20.151229 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder: 2025-10-13 20:41:20.151234 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator 2025-10-13 20:41:20.151240 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr\noc 2025-10-13 20:41:20.151246 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151251 | controller | database if exists cinder;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151257 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr 2025-10-13 20:41:20.151263 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151269 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr' 2025-10-13 20:41:20.151274 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance: 2025-10-13 20:41:20.151280 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator 2025-10-13 20:41:20.151285 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr\noc 2025-10-13 20:41:20.151291 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151305 | controller | database if exists glance;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151314 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr 2025-10-13 20:41:20.151321 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151328 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr' 2025-10-13 20:41:20.151334 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement: 2025-10-13 20:41:20.151339 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator 2025-10-13 20:41:20.151345 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr\noc 2025-10-13 20:41:20.151351 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151356 | controller | database if exists placement;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151364 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr 2025-10-13 20:41:20.151369 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151375 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr' 2025-10-13 20:41:20.151381 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift: 2025-10-13 20:41:20.151386 | controller | no such file or directory\nNo resources found\nrm -Rf -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator 2025-10-13 20:41:20.151395 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr\noc 2025-10-13 20:41:20.151420 | controller | kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr 2025-10-13 20:41:20.151432 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151440 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr' 2025-10-13 20:41:20.151451 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican: 2025-10-13 20:41:20.151459 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator 2025-10-13 20:41:20.151465 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr\noc 2025-10-13 20:41:20.151471 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151476 | controller | database if exists barbican;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151482 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr 2025-10-13 20:41:20.151488 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151494 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr' 2025-10-13 20:41:20.151499 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone: 2025-10-13 20:41:20.151505 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator 2025-10-13 20:41:20.151511 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr\noc 2025-10-13 20:41:20.151516 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151522 | controller | database if exists keystone;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151528 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr 2025-10-13 20:41:20.151533 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151539 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr' 2025-10-13 20:41:20.151545 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb: 2025-10-13 20:41:20.151550 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator 2025-10-13 20:41:20.151556 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr\noc 2025-10-13 20:41:20.151562 | controller | kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr 2025-10-13 20:41:20.151570 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151584 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr' 2025-10-13 20:41:20.151593 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry: 2025-10-13 20:41:20.151600 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator 2025-10-13 20:41:20.151608 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr\nrm 2025-10-13 20:41:20.151615 | controller | -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ceilometer-operator 2025-10-13 20:41:20.151623 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr\noc 2025-10-13 20:41:20.151629 | controller | rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop 2025-10-13 20:41:20.151635 | controller | database if exists aodh;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" 2025-10-13 20:41:20.151641 | controller | not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr 2025-10-13 20:41:20.151646 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.151656 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr' 2025-10-13 20:41:20.151662 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: 2025-10-13 20:41:20.151667 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator 2025-10-13 20:41:20.151673 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr\nif 2025-10-13 20:41:20.151679 | controller | oc get RabbitmqCluster; then oc delete --ignore-not-found=true RabbitmqCluster --all; 2025-10-13 20:41:20.151685 | controller | fi\nerror: the server doesn't have a resource type \"RabbitmqCluster\"\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/rabbitmq-operator 2025-10-13 20:41:20.151690 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/rabbitmq/cr\nbash 2025-10-13 20:41:20.151696 | controller | scripts/validate-marketplace.sh\n+ '[' -z 500s ']'\n+ OPERATOR_NAMESPACE=openshift-marketplace\n++ 2025-10-13 20:41:20.151702 | controller | oc get pods --no-headers -n openshift-marketplace\n++ grep -viE 'running|completed'\n+ 2025-10-13 20:41:20.151707 | controller | not_running_pods=\n+ '[' -z '' ']'\n+ echo 'All openshift-marketplace pods seems 2025-10-13 20:41:20.151713 | controller | to me fine'\nAll openshift-marketplace pods seems to me fine\n+ OPERATORS='openshift-cert-manager-operator 2025-10-13 20:41:20.151719 | controller | kubernetes-nmstate-operator metallb-operator'\n+ for operator in $OPERATORS\n+ n=0\n+ 2025-10-13 20:41:20.151724 | controller | retries=20\n+ true\n+ grep openshift-cert-manager-operator\n+ oc get packagemanifests 2025-10-13 20:41:20.151732 | controller | -n openshift-marketplace\nopenshift-cert-manager-operator Red 2025-10-13 20:41:20.151738 | controller | Hat Operators 232d\n+ '[' 0 -eq 0 ']'\n+ break\n+ for operator in $OPERATORS\n+ 2025-10-13 20:41:20.151743 | controller | n=0\n+ retries=20\n+ true\n+ oc get packagemanifests -n openshift-marketplace\n+ 2025-10-13 20:41:20.151749 | controller | grep kubernetes-nmstate-operator\nkubernetes-nmstate-operator Red 2025-10-13 20:41:20.151755 | controller | Hat Operators 232d\n+ '[' 0 -eq 0 ']'\n+ break\n+ for operator in $OPERATORS\n+ 2025-10-13 20:41:20.151761 | controller | n=0\n+ retries=20\n+ true\n+ grep metallb-operator\n+ oc get packagemanifests -n 2025-10-13 20:41:20.151766 | controller | openshift-marketplace\nmetallb-operator Red 2025-10-13 20:41:20.151772 | controller | Hat Operators 232d\n+ '[' 0 -eq 0 ']'\n+ break\nbash scripts/gen-namespace.sh\n+ 2025-10-13 20:41:20.151777 | controller | '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z openshift-nmstate 2025-10-13 20:41:20.151783 | controller | ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate\n+ 2025-10-13 20:41:20.151789 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate ']'\n+ 2025-10-13 20:41:20.151794 | controller | mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate\n+ cat\noc 2025-10-13 20:41:20.151800 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/namespace.yaml\nnamespace/openshift-nmstate 2025-10-13 20:41:20.151806 | controller | created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.151811 | controller | openshift-nmstate); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\nopenshift-nmstate 2025-10-13 20:41:20.151817 | controller | \ Active\nbash scripts/gen-olm-nmstate.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.151823 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.151836 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\n+ 2025-10-13 20:41:20.151848 | controller | '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.151856 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.151862 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\n+ 2025-10-13 20:41:20.151868 | controller | echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\nOPERATOR_DIR 2025-10-13 20:41:20.151874 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\n+ 2025-10-13 20:41:20.151880 | controller | echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\nDEPLOY_DIR 2025-10-13 20:41:20.151885 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\n+ 2025-10-13 20:41:20.151891 | controller | cat\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\noperatorgroup.operators.coreos.com/openshift-nmstate-tn6k8 2025-10-13 20:41:20.151899 | controller | created\nsubscription.operators.coreos.com/kubernetes-nmstate-operator created\ntimeout 2025-10-13 20:41:20.151905 | controller | 500s bash -c \"while ! (oc get deployments/nmstate-operator -n openshift-nmstate); 2025-10-13 20:41:20.151911 | controller | do sleep 10; done\"\nError from server (NotFound): deployments.apps \"nmstate-operator\" 2025-10-13 20:41:20.151916 | controller | not found\nError from server (NotFound): deployments.apps \"nmstate-operator\" not 2025-10-13 20:41:20.151922 | controller | found\nNAME READY UP-TO-DATE AVAILABLE AGE\nnmstate-operator 2025-10-13 20:41:20.151928 | controller | \ 1/1 1 1 7s\noc wait deployments/nmstate-operator -n 2025-10-13 20:41:20.151933 | controller | openshift-nmstate --for condition=Available --timeout=500s\ndeployment.apps/nmstate-operator 2025-10-13 20:41:20.151939 | controller | condition met\ntimeout 500s bash -c \"while ! (oc wait pod -n openshift-apiserver 2025-10-13 20:41:20.151945 | controller | -l apiserver=true --for condition=Ready); do sleep 10; done\"\npod/apiserver-76f77b778f-h75w4 2025-10-13 20:41:20.151950 | controller | condition met\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\nnmstate.nmstate.io/nmstate 2025-10-13 20:41:20.151956 | controller | created\ntimeout 500s bash -c \"while ! (oc get pod --no-headers=true -l component=kubernetes-nmstate-handler 2025-10-13 20:41:20.151962 | controller | -n openshift-nmstate| grep nmstate-handler); do sleep 10; done\"\nNo resources found 2025-10-13 20:41:20.151967 | controller | in openshift-nmstate namespace.\nnmstate-handler-bdw24 0/1 Running 0 10s\noc 2025-10-13 20:41:20.151973 | controller | wait pod -n openshift-nmstate -l component=kubernetes-nmstate-handler --for condition=Ready 2025-10-13 20:41:20.151979 | controller | --timeout=500s\npod/nmstate-handler-bdw24 condition met\ntimeout 500s bash -c \"while 2025-10-13 20:41:20.151984 | controller | ! (oc get deployments/nmstate-webhook -n openshift-nmstate); do sleep 10; done\"\nNAME 2025-10-13 20:41:20.151990 | controller | \ READY UP-TO-DATE AVAILABLE AGE\nnmstate-webhook 0/1 1 2025-10-13 20:41:20.151996 | controller | \ 0 11s\noc wait deployments/nmstate-webhook -n openshift-nmstate 2025-10-13 20:41:20.152002 | controller | --for condition=Available --timeout=500s\ndeployment.apps/nmstate-webhook condition 2025-10-13 20:41:20.152007 | controller | met\nWORKERS='crc' \\\nbash scripts/gen-nncp.sh\n+ check_var_set DEPLOY_DIR\n+ [[ 2025-10-13 20:41:20.152013 | controller | ! -v DEPLOY_DIR ]]\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr 2025-10-13 20:41:20.152019 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr\n+ 2025-10-13 20:41:20.152024 | controller | check_var_set WORKERS\n+ [[ ! -v WORKERS ]]\n+ check_var_set INTERFACE\n+ [[ ! -v 2025-10-13 20:41:20.152030 | controller | INTERFACE ]]\n+ check_var_set BRIDGE_NAME\n+ [[ ! -v BRIDGE_NAME ]]\n+ check_var_set 2025-10-13 20:41:20.152039 | controller | INTERFACE_MTU\n+ [[ ! -v INTERFACE_MTU ]]\n+ check_var_set VLAN_START\n+ [[ ! -v 2025-10-13 20:41:20.152044 | controller | VLAN_START ]]\n+ check_var_set VLAN_STEP\n+ [[ ! -v VLAN_STEP ]]\n+ check_var_set 2025-10-13 20:41:20.152050 | controller | VLAN_STEP\n+ [[ ! -v VLAN_STEP ]]\n+ check_var_set INTERNALAPI_PREFIX\n+ [[ ! -v 2025-10-13 20:41:20.152056 | controller | INTERNALAPI_PREFIX ]]\n+ check_var_set STORAGE_PREFIX\n+ [[ ! -v STORAGE_PREFIX 2025-10-13 20:41:20.152062 | controller | ]]\n+ check_var_set STORAGEMGMT_PREFIX\n+ [[ ! -v STORAGEMGMT_PREFIX ]]\n+ check_var_set 2025-10-13 20:41:20.152067 | controller | TENANT_PREFIX\n+ [[ ! -v TENANT_PREFIX ]]\n+ check_var_set DESIGNATE_PREFIX\n+ [[ 2025-10-13 20:41:20.152073 | controller | ! -v DESIGNATE_PREFIX ]]\n+ check_var_set DESIGNATE_EXT_PREFIX\n+ [[ ! -v DESIGNATE_EXT_PREFIX 2025-10-13 20:41:20.152079 | controller | ]]\n+ '[' -n '' ']'\n+ echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr\nDEPLOY_DIR 2025-10-13 20:41:20.152091 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr\n+ 2025-10-13 20:41:20.152099 | controller | echo WORKERS crc\nWORKERS crc\n+ echo INTERFACE ens7\nINTERFACE ens7\n+ echo BRIDGE_NAME 2025-10-13 20:41:20.152107 | controller | ospbr\nBRIDGE_NAME ospbr\n+ echo INTERFACE_BGP_1\nINTERFACE_BGP_1\n+ echo INTERFACE_BGP_2\nINTERFACE_BGP_2\n+ 2025-10-13 20:41:20.152114 | controller | echo INTERFACE_MTU 1500\nINTERFACE_MTU 1500\n+ echo VLAN_START 20\nVLAN_START 20\n+ 2025-10-13 20:41:20.152119 | controller | echo VLAN_STEP 1\nVLAN_STEP 1\n+ echo STORAGE_MACVLAN\nSTORAGE_MACVLAN\n+ '[' -n 2025-10-13 20:41:20.152125 | controller | true ']'\n+ echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122\nCTLPLANE_IP_ADDRESS_PREFIX 2025-10-13 20:41:20.152131 | controller | 192.168.122\n+ echo CTLPLANE_IP_ADDRESS_SUFFIX 10\nCTLPLANE_IP_ADDRESS_SUFFIX 10\n+ 2025-10-13 20:41:20.152136 | controller | '[' -n '' ']'\n+ '[' -n '' ']'\n+ IP_ADDRESS_SUFFIX=5\n+ IPV6_ADDRESS_SUFFIX=5\n+ 2025-10-13 20:41:20.152142 | controller | rm --force '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/*_nncp.yaml'\n+ 2025-10-13 20:41:20.152148 | controller | internalapi_vlan_id=20\n+ storage_vlan_id=21\n+ tenant_vlan_id=22\n+ storagemgmt_vlan_id=23\n+ 2025-10-13 20:41:20.152154 | controller | octavia_vlan_id=24\n+ designate_vlan_id=25\n+ designate_ext_vlan_id=26\n+ for WORKER 2025-10-13 20:41:20.152159 | controller | in ${WORKERS}\n+ cat\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n 2025-10-13 20:41:20.152165 | controller | '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' 2025-10-13 20:41:20.152171 | controller | -n '' ']'\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' 2025-10-13 20:41:20.152176 | controller | ']'\n+ cat\n+ cat\n+ '[' -n '' ']'\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ 2025-10-13 20:41:20.152182 | controller | cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n true 2025-10-13 20:41:20.152187 | controller | ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' 2025-10-13 20:41:20.152193 | controller | -n '' ']'\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ 2025-10-13 20:41:20.152199 | controller | '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ IP_ADDRESS_SUFFIX=6\n+ 2025-10-13 20:41:20.152205 | controller | IPV6_ADDRESS_SUFFIX=6\n+ CTLPLANE_IP_ADDRESS_SUFFIX=11\n+ CTLPLANE_IPV6_ADDRESS_SUFFIX=1\noc 2025-10-13 20:41:20.152211 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/\nnodenetworkconfigurationpolicy.nmstate.io/ens7-crc 2025-10-13 20:41:20.152217 | controller | created\ntimeout 240s bash -c \"while ! (oc wait nncp -l osp/interface=ens7 --for 2025-10-13 20:41:20.152222 | controller | jsonpath='{.status.conditions[0].reason}'=SuccessfullyConfigured); do sleep 10; 2025-10-13 20:41:20.152228 | controller | done\"\nnodenetworkconfigurationpolicy.nmstate.io/ens7-crc condition met\nif test 2025-10-13 20:41:20.152234 | controller | -n \"192.168.122.10\"; then oc patch dns.operator/default --type merge -p '{\"spec\":{\"upstreamResolvers\":{\"policy\":\"Sequential\",\"upstreams\":[{\"type\":\"Network\",\"address\":\"'192.168.122.10'\",\"port\":53},{\"type\":\"SystemResolvConf\"}]}}}'; 2025-10-13 20:41:20.152245 | controller | fi\ndns.operator.openshift.io/default patched\ntimeout 240s bash -c \"while ! (oc 2025-10-13 20:41:20.152250 | controller | wait dns.operator/default --for condition=available); do sleep 10; done\"\ndns.operator.openshift.io/default 2025-10-13 20:41:20.152256 | controller | condition met\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.152262 | controller | ']'\n+ '[' -z metallb-system ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/metallb-system\n+ 2025-10-13 20:41:20.152268 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system ']'\n+ 2025-10-13 20:41:20.152273 | controller | mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system\n+ cat\noc 2025-10-13 20:41:20.152279 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/namespace.yaml\nnamespace/metallb-system 2025-10-13 20:41:20.152285 | controller | created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.152290 | controller | metallb-system); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\nmetallb-system 2025-10-13 20:41:20.152296 | controller | \ Active\nbash scripts/gen-olm-metallb.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.152302 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.152307 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\n+ 2025-10-13 20:41:20.152313 | controller | '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.152319 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.152326 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\n+ 2025-10-13 20:41:20.152339 | controller | echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\nOPERATOR_DIR 2025-10-13 20:41:20.152346 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\n+ 2025-10-13 20:41:20.152354 | controller | echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\nDEPLOY_DIR 2025-10-13 20:41:20.152363 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\n+ echo 2025-10-13 20:41:20.152370 | controller | INTERFACE\nINTERFACE\n+ cat\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\noperatorgroup.operators.coreos.com/metallb-operator 2025-10-13 20:41:20.152376 | controller | created\nsubscription.operators.coreos.com/metallb-operator-sub created\ntimeout 2025-10-13 20:41:20.152381 | controller | 500s bash -c \"while ! (oc get pod --no-headers=true -l control-plane=controller-manager 2025-10-13 20:41:20.152387 | controller | -n metallb-system| grep metallb-operator-controller); do sleep 10; done\"\nNo resources 2025-10-13 20:41:20.152396 | controller | found in metallb-system namespace.\nNo resources found in metallb-system namespace.\nmetallb-operator-controller-manager-b7789ff7f-4dz47 2025-10-13 20:41:20.152417 | controller | \ 0/1 ContainerCreating 0 3s\noc wait pod -n metallb-system --for condition=Ready 2025-10-13 20:41:20.152428 | controller | -l control-plane=controller-manager --timeout=500s\npod/metallb-operator-controller-manager-b7789ff7f-4dz47 2025-10-13 20:41:20.152435 | controller | condition met\ntimeout 500s bash -c \"while ! (oc get pod --no-headers=true -l component=webhook-server 2025-10-13 20:41:20.152442 | controller | -n metallb-system| grep metallb-operator-webhook); do sleep 10; done\"\nmetallb-operator-webhook-server-86869d57c5-28vf7 2025-10-13 20:41:20.152449 | controller | \ 1/1 Running 0 41s\noc wait pod -n metallb-system --for condition=Ready 2025-10-13 20:41:20.152459 | controller | -l component=webhook-server --timeout=500s\npod/metallb-operator-webhook-server-86869d57c5-28vf7 2025-10-13 20:41:20.152466 | controller | condition met\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/deploy_operator.yaml\nmetallb.metallb.io/metallb 2025-10-13 20:41:20.152474 | controller | created\ntimeout 500s bash -c \"while ! (oc get pod --no-headers=true -l component=speaker 2025-10-13 20:41:20.152481 | controller | -n metallb-system | grep speaker); do sleep 10; done\"\nNo resources found in metallb-system 2025-10-13 20:41:20.152488 | controller | namespace.\nspeaker-lqgwl 1/2 Running 0 10s\noc wait pod -n metallb-system 2025-10-13 20:41:20.152494 | controller | -l component=speaker --for condition=Ready --timeout=500s\npod/speaker-lqgwl condition 2025-10-13 20:41:20.152499 | controller | met\nmake operator_namespace\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nerror: 2025-10-13 20:41:20.152505 | controller | the server doesn't have a resource type \"openstackversion\"\nbash scripts/gen-namespace.sh\n+ 2025-10-13 20:41:20.152511 | controller | '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z cert-manager-operator 2025-10-13 20:41:20.152517 | controller | ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator\n+ 2025-10-13 20:41:20.152522 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator 2025-10-13 20:41:20.152528 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator\n+ 2025-10-13 20:41:20.152534 | controller | cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/namespace.yaml\nnamespace/cert-manager-operator 2025-10-13 20:41:20.152539 | controller | created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.152545 | controller | cert-manager-operator); do sleep 1; done\"\nNAME DISPLAY NAME 2025-10-13 20:41:20.152551 | controller | \ STATUS\ncert-manager-operator Active\noc project cert-manager-operator\nNow 2025-10-13 20:41:20.152557 | controller | using project \"cert-manager-operator\" on server \"https://api.crc.testing:6443\".\nmake[1]: 2025-10-13 20:41:20.152562 | controller | Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.152568 | controller | scripts/gen-olm-cert-manager.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.152574 | controller | ']'\n+ '[' -z cert-manager-operator ']'\n+ '[' -z stable-v1 ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.152579 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\n+ 2025-10-13 20:41:20.152587 | controller | echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\nOPERATOR_DIR 2025-10-13 20:41:20.152593 | controller | /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\n+ 2025-10-13 20:41:20.152599 | controller | echo OPERATOR_NAMESPACE cert-manager-operator\nOPERATOR_NAMESPACE cert-manager-operator\n+ 2025-10-13 20:41:20.152613 | controller | echo CHANNEL stable-v1\nCHANNEL stable-v1\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\noperatorgroup.operators.coreos.com/cert-manager-operator-bccwx 2025-10-13 20:41:20.152622 | controller | created\nsubscription.operators.coreos.com/openshift-cert-manager-operator created\nwhile 2025-10-13 20:41:20.152629 | controller | ! (oc get pod --no-headers=true -l name=cert-manager-operator -n cert-manager-operator| 2025-10-13 20:41:20.152637 | controller | grep \"cert-manager-operator\"); do sleep 10; done\nNo resources found in cert-manager-operator 2025-10-13 20:41:20.152644 | controller | namespace.\nNo resources found in cert-manager-operator namespace.\ncert-manager-operator-controller-manager-57cd46d6d-t9wrm 2025-10-13 20:41:20.152657 | controller | \ 0/1 ContainerCreating 0 6s\noc wait pod -n cert-manager-operator --for 2025-10-13 20:41:20.152663 | controller | condition=Ready -l name=cert-manager-operator --timeout=300s\npod/cert-manager-operator-controller-manager-57cd46d6d-t9wrm 2025-10-13 20:41:20.152668 | controller | condition met\nwhile ! (oc get pod --no-headers=true -l app=cainjector -n cert-manager 2025-10-13 20:41:20.152674 | controller | | grep \"cert-manager-cainjector\"); do sleep 10; done\nNo resources found in cert-manager 2025-10-13 20:41:20.152680 | controller | namespace.\ncert-manager-cainjector-7d9f95dbf-866gz 1/1 Running 0 4s\noc 2025-10-13 20:41:20.152686 | controller | wait pod -n cert-manager -l app=cainjector --for condition=Ready --timeout=300s\npod/cert-manager-cainjector-7d9f95dbf-866gz 2025-10-13 20:41:20.152691 | controller | condition met\nwhile ! (oc get pod --no-headers=true -l app=webhook -n cert-manager 2025-10-13 20:41:20.152697 | controller | | grep \"cert-manager-webhook\"); do sleep 10; done\ncert-manager-webhook-d969966f-qjpx9 2025-10-13 20:41:20.152703 | controller | \ 0/1 Running 0 8s\noc wait pod -n cert-manager -l app=webhook --for condition=Ready 2025-10-13 20:41:20.152708 | controller | --timeout=300s\npod/cert-manager-webhook-d969966f-qjpx9 condition met\nwhile ! (oc 2025-10-13 20:41:20.152714 | controller | get pod --no-headers=true -l app=cert-manager -n cert-manager | grep \"cert-manager\"); 2025-10-13 20:41:20.152720 | controller | do sleep 10; done\nNo resources found in cert-manager namespace.\ncert-manager-7d4cc89fcb-452pc 2025-10-13 20:41:20.152725 | controller | \ 1/1 Running 0 2s\noc wait pod -n cert-manager -l app=cert-manager --for 2025-10-13 20:41:20.152731 | controller | condition=Ready --timeout=300s\npod/cert-manager-7d4cc89fcb-452pc condition met\nbash 2025-10-13 20:41:20.152737 | controller | scripts/gen-netatt.sh\n+ check_var_set DEPLOY_DIR\n+ [[ ! -v DEPLOY_DIR ]]\n+ '[' 2025-10-13 20:41:20.152742 | controller | '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr 2025-10-13 20:41:20.152748 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr\n+ 2025-10-13 20:41:20.152754 | controller | check_var_set INTERFACE\n+ [[ ! -v INTERFACE ]]\n+ check_var_set BRIDGE_NAME\n+ 2025-10-13 20:41:20.152759 | controller | [[ ! -v BRIDGE_NAME ]]\n+ check_var_set VLAN_START\n+ [[ ! -v VLAN_START ]]\n+ check_var_set 2025-10-13 20:41:20.152765 | controller | VLAN_STEP\n+ [[ ! -v VLAN_STEP ]]\n+ '[' -z true ']'\n+ '[' -n true ']'\n+ '[' -n 2025-10-13 20:41:20.152771 | controller | '' ']'\n+ '[' -n true ']'\n+ check_var_set INTERNALAPI_PREFIX\n+ [[ ! -v INTERNALAPI_PREFIX 2025-10-13 20:41:20.152776 | controller | ]]\n+ check_var_set STORAGE_PREFIX\n+ [[ ! -v STORAGE_PREFIX ]]\n+ check_var_set 2025-10-13 20:41:20.152782 | controller | STORAGEMGMT_PREFIX\n+ [[ ! -v STORAGEMGMT_PREFIX ]]\n+ check_var_set TENANT_PREFIX\n+ 2025-10-13 20:41:20.152788 | controller | [[ ! -v TENANT_PREFIX ]]\n+ check_var_set DESIGNATE_PREFIX\n+ [[ ! -v DESIGNATE_PREFIX 2025-10-13 20:41:20.152793 | controller | ]]\n+ check_var_set DESIGNATE_EXT_PREFIX\n+ [[ ! -v DESIGNATE_EXT_PREFIX ]]\n+ echo 2025-10-13 20:41:20.152799 | controller | DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr\nDEPLOY_DIR 2025-10-13 20:41:20.152804 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr\n+ 2025-10-13 20:41:20.152810 | controller | echo INTERFACE ens7\nINTERFACE ens7\n+ echo VLAN_START 20\nVLAN_START 20\n+ echo 2025-10-13 20:41:20.152816 | controller | VLAN_STEP 1\nVLAN_STEP 1\n+ '[' -n true ']'\n+ echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122\nCTLPLANE_IP_ADDRESS_PREFIX 2025-10-13 20:41:20.152821 | controller | 192.168.122\n+ echo CTLPLANE_IP_ADDRESS_SUFFIX 10\nCTLPLANE_IP_ADDRESS_SUFFIX 10\n+ 2025-10-13 20:41:20.152829 | controller | echo 'INTERNALAPI_PREFIX 172.17.0'\nINTERNALAPI_PREFIX 172.17.0\n+ echo 'STORAGE_PREFIX 2025-10-13 20:41:20.152835 | controller | 172.18.0'\nSTORAGE_PREFIX 172.18.0\n+ echo 'STORAGEMGMT_PREFIX 172.20.0'\nSTORAGEMGMT_PREFIX 2025-10-13 20:41:20.152843 | controller | 172.20.0\n+ echo 'TENANT_PREFIX 172.19.0'\nTENANT_PREFIX 172.19.0\n+ echo 'DESIGNATE_PREFIX 2025-10-13 20:41:20.152849 | controller | 172.28.0'\nDESIGNATE_PREFIX 172.28.0\n+ echo 'DESIGNATE_PREFIX 172.50.0'\nDESIGNATE_PREFIX 2025-10-13 20:41:20.152854 | controller | 172.50.0\n+ '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ '[' 2025-10-13 20:41:20.152867 | controller | -n true ']'\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ '[' 2025-10-13 20:41:20.152875 | controller | -n true ']'\n+ cat\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ 2025-10-13 20:41:20.152883 | controller | '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ cat\n+ '[' -n '' ']'\n+ '[' -n '' ']'\noc 2025-10-13 20:41:20.152890 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/\nnetworkattachmentdefinition.k8s.cni.cncf.io/ctlplane 2025-10-13 20:41:20.152896 | controller | created\nnetworkattachmentdefinition.k8s.cni.cncf.io/datacentre created\nnetworkattachmentdefinition.k8s.cni.cncf.io/designate 2025-10-13 20:41:20.152902 | controller | created\nnetworkattachmentdefinition.k8s.cni.cncf.io/designateext created\nnetworkattachmentdefinition.k8s.cni.cncf.io/internalapi 2025-10-13 20:41:20.152908 | controller | created\nnetworkattachmentdefinition.k8s.cni.cncf.io/octavia created\nnetworkattachmentdefinition.k8s.cni.cncf.io/storage 2025-10-13 20:41:20.152914 | controller | created\nnetworkattachmentdefinition.k8s.cni.cncf.io/storagemgmt created\nnetworkattachmentdefinition.k8s.cni.cncf.io/tenant 2025-10-13 20:41:20.152919 | controller | created\noc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml\nerror: 2025-10-13 20:41:20.152925 | controller | the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml\" 2025-10-13 20:41:20.152931 | controller | does not exist\nmake: [Makefile:2546: metallb_config_cleanup] Error 1 (ignored)\noc 2025-10-13 20:41:20.152937 | controller | delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml\nerror: 2025-10-13 20:41:20.152943 | controller | the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml\" 2025-10-13 20:41:20.152948 | controller | does not exist\nmake: [Makefile:2547: metallb_config_cleanup] Error 1 (ignored)\noc 2025-10-13 20:41:20.152954 | controller | delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml\nerror: 2025-10-13 20:41:20.152960 | controller | the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml\" 2025-10-13 20:41:20.152966 | controller | does not exist\nmake: [Makefile:2548: metallb_config_cleanup] Error 1 (ignored)\noc 2025-10-13 20:41:20.152971 | controller | delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml\nerror: 2025-10-13 20:41:20.152977 | controller | the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml\" 2025-10-13 20:41:20.152983 | controller | does not exist\nmake: [Makefile:2549: metallb_config_cleanup] Error 1 (ignored)\noc 2025-10-13 20:41:20.152989 | controller | delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml\nerror: 2025-10-13 20:41:20.152996 | controller | the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml\" 2025-10-13 20:41:20.153002 | controller | does not exist\nmake: [Makefile:2550: metallb_config_cleanup] Error 1 (ignored)\nrm 2025-10-13 20:41:20.153008 | controller | -Rf /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml 2025-10-13 20:41:20.153013 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml 2025-10-13 20:41:20.153019 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml 2025-10-13 20:41:20.153028 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml 2025-10-13 20:41:20.153034 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml\nbash 2025-10-13 20:41:20.153039 | controller | scripts/gen-metallb-config.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.153045 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.153051 | controller | ']'\n+ '[' -z ens7 ']'\n+ '[' -z ospbr ']'\n+ '[' -z 64999 ']'\n+ '[' -z 64999 ']'\n+ 2025-10-13 20:41:20.153057 | controller | '[' -z 100.65.4.1 ']'\n+ '[' -z 100.64.4.1 ']'\n+ '[' -z 172.30.4.2 ']'\n+ '[' -z 2025-10-13 20:41:20.153062 | controller | true ']'\n+ echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\nDEPLOY_DIR 2025-10-13 20:41:20.153068 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\n+ echo 2025-10-13 20:41:20.153074 | controller | INTERFACE ens7\nINTERFACE ens7\n+ echo CTLPLANE_METALLB_POOL 192.168.122.80-192.168.122.90\nCTLPLANE_METALLB_POOL 2025-10-13 20:41:20.153080 | controller | 192.168.122.80-192.168.122.90\n+ echo CTLPLANE_METALLB_IPV6_POOL fd00:aaaa::80-fd00:aaaa::90\nCTLPLANE_METALLB_IPV6_POOL 2025-10-13 20:41:20.153086 | controller | fd00:aaaa::80-fd00:aaaa::90\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ 2025-10-13 20:41:20.153098 | controller | cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ 2025-10-13 20:41:20.153107 | controller | '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n 2025-10-13 20:41:20.153114 | controller | true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml\nipaddresspool.metallb.io/ctlplane 2025-10-13 20:41:20.153122 | controller | created\nipaddresspool.metallb.io/internalapi created\nipaddresspool.metallb.io/storage 2025-10-13 20:41:20.153127 | controller | created\nipaddresspool.metallb.io/tenant created\nipaddresspool.metallb.io/designateext 2025-10-13 20:41:20.153133 | controller | created\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml\nl2advertisement.metallb.io/ctlplane 2025-10-13 20:41:20.153139 | controller | created\nl2advertisement.metallb.io/internalapi created\nl2advertisement.metallb.io/storage 2025-10-13 20:41:20.153145 | controller | created\nl2advertisement.metallb.io/tenant created\nl2advertisement.metallb.io/designateext 2025-10-13 20:41:20.153150 | controller | created\nbash scripts/gen-olm.sh\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack 2025-10-13 20:41:20.153156 | controller | ']'\n+ '[' -z quay.io/openstack-k8s-operators/openstack-operator-index:latest ']'\n+ 2025-10-13 20:41:20.153162 | controller | '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.153167 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.153173 | controller | ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\n+ 2025-10-13 20:41:20.153179 | controller | OPERATOR_CHANNEL=alpha\n+ OPERATOR_SOURCE=openstack-operator-index\n+ OPERATOR_SOURCE_NAMESPACE=openstack-operators\n+ 2025-10-13 20:41:20.153184 | controller | echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\nOPERATOR_DIR 2025-10-13 20:41:20.153190 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\n+ 2025-10-13 20:41:20.153196 | controller | echo OPERATOR_CHANNEL alpha\nOPERATOR_CHANNEL alpha\n+ echo OPERATOR_SOURCE openstack-operator-index\nOPERATOR_SOURCE 2025-10-13 20:41:20.153201 | controller | openstack-operator-index\n+ echo OPERATOR_SOURCE_NAMESPACE openstack-operators\nOPERATOR_SOURCE_NAMESPACE 2025-10-13 20:41:20.153207 | controller | openstack-operators\n+ cat\n+ cat\n+ cat\nbash scripts/gen-namespace.sh\n+ '[' -z 2025-10-13 20:41:20.153224 | controller | /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z openstack-operators 2025-10-13 20:41:20.153230 | controller | ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-operators\n+ 2025-10-13 20:41:20.153235 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators 2025-10-13 20:41:20.153241 | controller | ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/namespace.yaml\nWarning: 2025-10-13 20:41:20.153247 | controller | resource namespaces/openstack-operators is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.153252 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.153258 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.153264 | controller | annotation will be patched automatically.\nnamespace/openstack-operators configured\ntimeout 2025-10-13 20:41:20.153269 | controller | 500s bash -c \"while ! (oc get project.v1.project.openshift.io openstack-operators); 2025-10-13 20:41:20.153275 | controller | do sleep 1; done\"\nNAME DISPLAY NAME STATUS\nopenstack-operators 2025-10-13 20:41:20.153280 | controller | \ Active\noc project openstack-operators\nNow using project \"openstack-operators\" 2025-10-13 20:41:20.153286 | controller | on server \"https://api.crc.testing:6443\".\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\ncatalogsource.operators.coreos.com/openstack-operator-index 2025-10-13 20:41:20.153292 | controller | created\noperatorgroup.operators.coreos.com/openstack created\nsubscription.operators.coreos.com/openstack-operator 2025-10-13 20:41:20.153297 | controller | created\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr 2025-10-13 20:41:20.153305 | controller | | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a 2025-10-13 20:41:20.153310 | controller | valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr' 2025-10-13 20:41:20.153316 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: 2025-10-13 20:41:20.153322 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator 2025-10-13 20:41:20.153327 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr\noc 2025-10-13 20:41:20.153340 | controller | kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.153348 | controller | | oc delete --ignore-not-found=true -f - || true\nerror: must build at directory: 2025-10-13 20:41:20.153356 | controller | not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr' 2025-10-13 20:41:20.153363 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack: 2025-10-13 20:41:20.153369 | controller | no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator 2025-10-13 20:41:20.153375 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\nmkdir 2025-10-13 20:41:20.153380 | controller | -p /home/zuul/ci-framework-data/artifacts/manifests/operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.153386 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\nbash 2025-10-13 20:41:20.153395 | controller | -c \"test -d /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator 2025-10-13 20:41:20.153447 | controller | || CHECKOUT_FROM_OPENSTACK_REF=false scripts/clone-operator-repo.sh\"\nCloning repo: 2025-10-13 20:41:20.153461 | controller | git clone -b main https://github.com/openstack-k8s-operators/openstack-operator.git 2025-10-13 20:41:20.153468 | controller | openstack-operator\nCloning into 'openstack-operator'...\ncp /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml 2025-10-13 20:41:20.153479 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\nbash 2025-10-13 20:41:20.153486 | controller | scripts/gen-service-kustomize.sh\n+++ dirname scripts/gen-service-kustomize.sh\n++ 2025-10-13 20:41:20.153492 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.153498 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/common.sh 2025-10-13 20:41:20.153504 | controller | --source-only\n++ set -e\n+ '[' -z openstack-kuttl-tests ']'\n+ '[' -z OpenStackControlPlane 2025-10-13 20:41:20.153512 | controller | ']'\n+ '[' -z osp-secret ']'\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.153518 | controller | ']'\n+ '[' -n '' ']'\n+ REPLACEMENTS=\n+ IMAGE=unused\n+ IMAGE_PATH=containerImage\n+ 2025-10-13 20:41:20.153523 | controller | STORAGE_REQUEST=10G\n+ INTERFACE_MTU=1500\n+ VLAN_START=20\n+ VLAN_STEP=1\n+ '[' 2025-10-13 20:41:20.153529 | controller | '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.153535 | controller | ']'\n+ pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\n~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.153541 | controller | ~/src/github.com/openstack-k8s-operators/install_yamls\n+ cat\n+ [[ OpenStackControlPlane 2025-10-13 20:41:20.153546 | controller | == \\O\\p\\e\\n\\S\\t\\a\\c\\k\\C\\o\\n\\t\\r\\o\\l\\P\\l\\a\\n\\e ]]\n+ [[ '' != 2025-10-13 20:41:20.153552 | controller | '' ]]\n+ IFS=,\n+ read -ra IMAGES\n+ IFS=,\n+ read -ra IMAGE_PATHS\n+ '[' 1 '!=' 2025-10-13 20:41:20.153558 | controller | 1 ']'\n+ (( i=0 ))\n+ (( i < 1 ))\n+ SPEC_PATH=containerImage\n+ SPEC_VALUE=unused\n+ 2025-10-13 20:41:20.153563 | controller | '[' unused '!=' unused ']'\n+ (( i++ ))\n+ (( i < 1 ))\n+ '[' -n '' ']'\n+ '[' OpenStackControlPlane 2025-10-13 20:41:20.153569 | controller | == OpenStackControlPlane ']'\n+ cat\n+ '[' OpenStackControlPlane == Galera ']'\n+ 2025-10-13 20:41:20.153575 | controller | '[' OpenStackControlPlane == NetConfig ']'\n+ '[' -n '' ']'\n+ [[ OpenStackControlPlane 2025-10-13 20:41:20.153580 | controller | == \\O\\p\\e\\n\\S\\t\\a\\c\\k\\C\\o\\n\\t\\r\\o\\l\\P\\l\\a\\n\\e ]]\n+ [[ true 2025-10-13 20:41:20.153586 | controller | == \\t\\r\\u\\e ]]\n+ cat\n+ [[ OpenStackControlPlane == \\O\\p\\e\\n\\S\\t\\a\\c\\k\\C\\o\\n\\t\\r\\o\\l\\P\\l\\a\\n\\e 2025-10-13 20:41:20.153592 | controller | ]]\n+ '[' -z true ']'\n+ '[' -n '' ']'\n+ '[' -z true ']'\n+ '[' -n true ']'\n+ 2025-10-13 20:41:20.153598 | controller | '[' -n '' ']'\n+ '[' -n '' ']'\n+ kustomization_add_resources\n+ echo merge config 2025-10-13 20:41:20.153603 | controller | dir\nmerge config dir\n++ find . -type f -name '*.yaml'\n++ grep -v kustomization\n+ 2025-10-13 20:41:20.153609 | controller | yamls=./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml\n+ for 2025-10-13 20:41:20.153615 | controller | y in ${yamls[@]}\n+ kustomize edit add resource ./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml\n+ 2025-10-13 20:41:20.153620 | controller | popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n# Wait until OLM installs 2025-10-13 20:41:20.153626 | controller | openstack CRDs\ntimeout 500s bash -c \"while ! (oc get crd openstacks.operator.openstack.org); 2025-10-13 20:41:20.153640 | controller | do sleep 1; done\"\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153649 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153656 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153664 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153675 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153683 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153689 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153694 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153700 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153706 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153712 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153718 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153723 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153729 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153735 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153741 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153746 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153752 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153758 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153763 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153769 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153775 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153780 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153788 | controller | \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io 2025-10-13 20:41:20.153793 | controller | \"openstacks.operator.openstack.org\" not found\nNAME CREATED 2025-10-13 20:41:20.153799 | controller | AT\nopenstacks.operator.openstack.org 2025-10-13T19:38:15Z\nmake openstack_init\nmake[1]: 2025-10-13 20:41:20.153806 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nerror: 2025-10-13 20:41:20.153812 | controller | the server doesn't have a resource type \"openstackversion\"\n# call make_openstack 2025-10-13 20:41:20.153818 | controller | if it isn't already\nbash -c '(oc get subscription -n openstack-operators openstack-operator 2025-10-13 20:41:20.153823 | controller | || make openstack) || true'\nNAME PACKAGE SOURCE CHANNEL\nopenstack-operator 2025-10-13 20:41:20.153832 | controller | \ openstack-operator openstack-operator-index alpha\ntimeout 500s bash -c 'until 2025-10-13 20:41:20.153838 | controller | $(oc get csv -l operators.coreos.com/openstack-operator.openstack-operators -n openstack-operators 2025-10-13 20:41:20.153843 | controller | | grep -q Succeeded); do sleep 1; done'\nNo resources found in openstack-operators 2025-10-13 20:41:20.153856 | controller | namespace.\nbash -c 'test -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml 2025-10-13 20:41:20.153864 | controller | || make openstack_repo'\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml\nopenstack.operator.openstack.org/openstack 2025-10-13 20:41:20.153872 | controller | created\n# FIXME: Ugly hack to prevent OpenStack Baremetal operator from crashing 2025-10-13 20:41:20.153879 | controller | when BMO is not installed\nif ! echo \"\" | grep -q \"baremetalhosts.metal3.io\"; 2025-10-13 20:41:20.153886 | controller | then \\\n\tcurl -o /tmp/bmh_crd.yaml --retry-all-errors --retry 5 --retry-delay 2025-10-13 20:41:20.153894 | controller | 10 https://raw.githubusercontent.com/metal3-io/baremetal-operator/refs/heads/main/config/base/crds/bases/metal3.io_baremetalhosts.yaml; 2025-10-13 20:41:20.153901 | controller | \\\n\toc apply -f /tmp/bmh_crd.yaml; \\\n\trm -f /tmp/bmh_crd.yaml; \\\nfi\n % 2025-10-13 20:41:20.153908 | controller | Total % Received % Xferd Average Speed Time Time Time Current\n Dload 2025-10-13 20:41:20.153915 | controller | \ Upload Total Spent Left Speed\n\r 0 0 0 0 0 0 0 2025-10-13 20:41:20.153921 | controller | \ 0 --:--:-- --:--:-- --:--:-- 0\r100 61353 100 61353 0 0 624k 2025-10-13 20:41:20.153927 | controller | \ 0 --:--:-- --:--:-- --:--:-- 624k\ncustomresourcedefinition.apiextensions.k8s.io/baremetalhosts.metal3.io 2025-10-13 20:41:20.153933 | controller | created\noc wait openstack/openstack -n openstack-operators --for condition=Ready 2025-10-13 20:41:20.153940 | controller | --timeout=500s\nopenstack.operator.openstack.org/openstack condition met\ntimeout 2025-10-13 20:41:20.153946 | controller | 500s bash -c \"while ! (oc get services -n openstack-operators | grep -E '^(openstack|openstack-baremetal|infra)-operator-webhook-service' 2025-10-13 20:41:20.153951 | controller | | wc -l | grep -q -e 3); do sleep 5; done\"\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake 2025-10-13 20:41:20.153957 | controller | wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.153963 | controller | scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ 2025-10-13 20:41:20.153968 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.153974 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq 2025-10-13 20:41:20.153980 | controller | ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.153986 | controller | ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until 2025-10-13 20:41:20.153991 | controller | [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ 2025-10-13 20:41:20.153997 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster 2025-10-13 20:41:20.154003 | controller | ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators 2025-10-13 20:41:20.154008 | controller | deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ 2025-10-13 20:41:20.154014 | controller | REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ 2025-10-13 20:41:20.154020 | controller | exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake 2025-10-13 20:41:20.154028 | controller | wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.154034 | controller | scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ 2025-10-13 20:41:20.154041 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.154047 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq 2025-10-13 20:41:20.154053 | controller | ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.154058 | controller | ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until 2025-10-13 20:41:20.154064 | controller | [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ 2025-10-13 20:41:20.154069 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster 2025-10-13 20:41:20.154075 | controller | ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators 2025-10-13 20:41:20.154081 | controller | deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ 2025-10-13 20:41:20.154087 | controller | REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ 2025-10-13 20:41:20.154099 | controller | exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake 2025-10-13 20:41:20.154107 | controller | wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.154115 | controller | scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ 2025-10-13 20:41:20.154122 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.154128 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq 2025-10-13 20:41:20.154133 | controller | ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.154139 | controller | ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until 2025-10-13 20:41:20.154145 | controller | [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ 2025-10-13 20:41:20.154151 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster 2025-10-13 20:41:20.154156 | controller | ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators 2025-10-13 20:41:20.154162 | controller | deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ 2025-10-13 20:41:20.154168 | controller | REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ 2025-10-13 20:41:20.154173 | controller | exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake 2025-10-13 20:41:20.154179 | controller | wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.154185 | controller | scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ 2025-10-13 20:41:20.154190 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.154196 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq 2025-10-13 20:41:20.154202 | controller | ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.154210 | controller | ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until 2025-10-13 20:41:20.154216 | controller | [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ 2025-10-13 20:41:20.154222 | controller | '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster 2025-10-13 20:41:20.154227 | controller | ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators 2025-10-13 20:41:20.154233 | controller | deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ 2025-10-13 20:41:20.154239 | controller | REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ 2025-10-13 20:41:20.154244 | controller | exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake 2025-10-13 20:41:20.154250 | controller | openstack_kuttl_run\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nset 2025-10-13 20:41:20.154256 | controller | -e; \\\nfor test_dir in ctlplane-basic-deployment ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.154261 | controller | ctlplane-collapsed ctlplane-galera-3replicas ctlplane-galera-basic ctlplane-nodeselectors 2025-10-13 20:41:20.154267 | controller | ctlplane-tls-cert-rotation ctlplane-tls-custom-issuers ctlplane-tls-custom-route 2025-10-13 20:41:20.154273 | controller | dataplane-create-test dataplane-deploy-global-service-test dataplane-deploy-multiple-secrets 2025-10-13 20:41:20.154279 | controller | dataplane-deploy-no-nodes-test dataplane-deploy-tls-test dataplane-extramounts dataplane-multinode-nodeset-create-test 2025-10-13 20:41:20.154284 | controller | dataplane-service-config dataplane-service-custom-image dataplane-service-failure; 2025-10-13 20:41:20.154290 | controller | do \\\n oc delete osctlplane --all --namespace openstack-kuttl-tests; \\\n\tmake 2025-10-13 20:41:20.154296 | controller | crc_storage_cleanup_with_retries; \\\n\tmake crc_storage_with_retries; \\\n\tkubectl-kuttl 2025-10-13 20:41:20.154301 | controller | test --config /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/kuttl-test.yaml 2025-10-13 20:41:20.154307 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.154313 | controller | --test ${test_dir}; \\\ndone\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.154318 | controller | scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.154333 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.154341 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.154348 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ mkdir 2025-10-13 20:41:20.154355 | controller | -p /home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ cat\noc apply 2025-10-13 20:41:20.154361 | controller | -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.154367 | controller | created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.154372 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.154378 | controller | \ Active\noc project crc-storage\nNow using project \"crc-storage\" 2025-10-13 20:41:20.154384 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ 2025-10-13 20:41:20.154389 | controller | oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ 2025-10-13 20:41:20.154414 | controller | grep Bound\nNo resources found\n++ oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.154431 | controller | --no-headers\n++ awk '{print $1}'\nNo resources found\nif oc get sc \"local-storage\"; 2025-10-13 20:41:20.154439 | controller | then oc delete sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY 2025-10-13 20:41:20.154446 | controller | \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner 2025-10-13 20:41:20.154454 | controller | \ Delete WaitForFirstConsumer true 5m7s\nstorageclass.storage.k8s.io 2025-10-13 20:41:20.154459 | controller | \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ 2025-10-13 20:41:20.154465 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.154471 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.154477 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage created\n++ 2025-10-13 20:41:20.154482 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage created\n++ cat\n++ oc apply -f 2025-10-13 20:41:20.154488 | controller | -\nrole.rbac.authorization.k8s.io/crc-storage-role created\n++ cat\n++ oc apply 2025-10-13 20:41:20.154494 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding created\n+ PV_NUM=20\n+ 2025-10-13 20:41:20.154499 | controller | TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' 2025-10-13 20:41:20.154505 | controller | -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node 2025-10-13 20:41:20.154511 | controller | in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.154516 | controller | crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage 2025-10-13 20:41:20.154522 | controller | job crc-storage-crc --ignore-not-found\n++ cat\n++ oc apply -f -\nWarning: would 2025-10-13 20:41:20.154528 | controller | violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must 2025-10-13 20:41:20.154534 | controller | not set securityContext.privileged=true), allowPrivilegeEscalation != false (container 2025-10-13 20:41:20.154539 | controller | \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.154545 | controller | capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.154551 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.154556 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.154562 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.154568 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.154591 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory 2025-10-13 20:41:20.154597 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.154603 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: 2025-10-13 20:41:20.154608 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.154614 | controller | scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.154620 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.154625 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.154640 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.154648 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.154660 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.154668 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.154676 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.154682 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname 2025-10-13 20:41:20.154688 | controller | scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.154694 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.154700 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.154705 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.154711 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.154717 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.154722 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase 2025-10-13 20:41:20.154728 | controller | | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template 2025-10-13 20:41:20.154734 | controller | '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ 2025-10-13 20:41:20.154741 | controller | NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.154749 | controller | crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage 2025-10-13 20:41:20.154755 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.154762 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.154769 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.154777 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.154784 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.154791 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.154799 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.154806 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.154812 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.154819 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ 2025-10-13 20:41:20.154826 | controller | OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' 2025-10-13 20:41:20.154833 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ mkdir 2025-10-13 20:41:20.154845 | controller | -p /home/zuul/ci-framework-data/artifacts/manifests/crc\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ 2025-10-13 20:41:20.154851 | controller | oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ sed -e 's|node/||'\n++ 2025-10-13 20:41:20.154858 | controller | tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ 2025-10-13 20:41:20.154866 | controller | seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.154877 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.154885 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.154892 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.154899 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.154907 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.154912 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.154918 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.154923 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.154929 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.154944 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.154952 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.154959 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.154967 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.154974 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.154981 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.154988 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply 2025-10-13 20:41:20.154994 | controller | -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage 2025-10-13 20:41:20.154999 | controller | created\nWarning: resource persistentvolumes/local-storage01-crc is missing the 2025-10-13 20:41:20.155005 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155011 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155017 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage01-crc 2025-10-13 20:41:20.155022 | controller | configured\nWarning: resource persistentvolumes/local-storage02-crc is missing the 2025-10-13 20:41:20.155028 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155034 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155040 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage02-crc 2025-10-13 20:41:20.155045 | controller | configured\nWarning: resource persistentvolumes/local-storage03-crc is missing the 2025-10-13 20:41:20.155051 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155057 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155062 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage03-crc 2025-10-13 20:41:20.155068 | controller | configured\nWarning: resource persistentvolumes/local-storage04-crc is missing the 2025-10-13 20:41:20.155074 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155079 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155085 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage04-crc 2025-10-13 20:41:20.155095 | controller | configured\nWarning: resource persistentvolumes/local-storage05-crc is missing the 2025-10-13 20:41:20.155104 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155109 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155115 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage05-crc 2025-10-13 20:41:20.155121 | controller | configured\nWarning: resource persistentvolumes/local-storage06-crc is missing the 2025-10-13 20:41:20.155126 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155132 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155138 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage06-crc 2025-10-13 20:41:20.155144 | controller | configured\nWarning: resource persistentvolumes/local-storage07-crc is missing the 2025-10-13 20:41:20.155149 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155155 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155161 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage07-crc 2025-10-13 20:41:20.155166 | controller | configured\nWarning: resource persistentvolumes/local-storage08-crc is missing the 2025-10-13 20:41:20.155172 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155181 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155187 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage08-crc 2025-10-13 20:41:20.155192 | controller | configured\nWarning: resource persistentvolumes/local-storage09-crc is missing the 2025-10-13 20:41:20.155198 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155211 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155219 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage09-crc 2025-10-13 20:41:20.155227 | controller | configured\nWarning: resource persistentvolumes/local-storage10-crc is missing the 2025-10-13 20:41:20.155233 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155239 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155245 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage10-crc 2025-10-13 20:41:20.155251 | controller | configured\nWarning: resource persistentvolumes/local-storage11-crc is missing the 2025-10-13 20:41:20.155256 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155262 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155268 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage11-crc 2025-10-13 20:41:20.155273 | controller | configured\nWarning: resource persistentvolumes/local-storage12-crc is missing the 2025-10-13 20:41:20.155279 | controller | kubectl.kubernetes.io/last-applied-configuration annotation which is required by 2025-10-13 20:41:20.155285 | controller | oc apply. oc apply should only be used on resources created declaratively by either 2025-10-13 20:41:20.155290 | controller | oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage12-crc 2025-10-13 20:41:20.155299 | controller | configured\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc 2025-10-13 20:41:20.155305 | controller | created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc 2025-10-13 20:41:20.155311 | controller | created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc 2025-10-13 20:41:20.155316 | controller | created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc 2025-10-13 20:41:20.155322 | controller | created\npersistentvolumeclaim/ansible-ee-logs created\nmake[3]: Leaving directory 2025-10-13 20:41:20.155328 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.155333 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 2025-10-13 20:41:20.155339 | controller | 19:39:52 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.155345 | controller | ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running 2025-10-13 20:41:20.155350 | controller | tests using configured kubeconfig.\n harness.go:278: Successful connection to 2025-10-13 20:41:20.155356 | controller | cluster at: https://api.crc.testing:6443\n logger.go:42: 19:39:52 | | running 2025-10-13 20:41:20.155362 | controller | command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n 2025-10-13 20:41:20.155367 | controller | \ logger.go:42: 19:39:52 | | netconfig.network.openstack.org/netconfig created\n 2025-10-13 20:41:20.155373 | controller | \ logger.go:42: 19:39:52 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.155384 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n 2025-10-13 20:41:20.155390 | controller | \ logger.go:42: 19:39:52 | | dnsmasq.network.openstack.org/dnsmasq created\n 2025-10-13 20:41:20.155417 | controller | \ logger.go:42: 19:39:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.155430 | controller | ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n 2025-10-13 20:41:20.155438 | controller | \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.155445 | controller | \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.155451 | controller | \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.155461 | controller | \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply 2025-10-13 20:41:20.155466 | controller | -f -\n ]\n logger.go:42: 19:39:53 | | Generating public/private rsa key 2025-10-13 20:41:20.155472 | controller | pair.\n logger.go:42: 19:39:53 | | Your identification has been saved in ansibleee-ssh-key-id_rsa\n 2025-10-13 20:41:20.155478 | controller | \ logger.go:42: 19:39:53 | | Your public key has been saved in ansibleee-ssh-key-id_rsa.pub\n 2025-10-13 20:41:20.155491 | controller | \ logger.go:42: 19:39:53 | | The key fingerprint is:\n logger.go:42: 19:39:53 2025-10-13 20:41:20.155500 | controller | | | SHA256:VCJuwoD6YMCqjIbrmfxGP1cc3DBS1brr9CZYa6fIhnQ zuul@controller\n logger.go:42: 2025-10-13 20:41:20.155508 | controller | 19:39:53 | | The key's randomart image is:\n logger.go:42: 19:39:53 | | +---[RSA 2025-10-13 20:41:20.155515 | controller | 4096]----+\n logger.go:42: 19:39:53 | | |... . o.o.. |\n logger.go:42: 2025-10-13 20:41:20.155522 | controller | 19:39:53 | | |o. o . o = . |\n logger.go:42: 19:39:53 | | |+ o o + + 2025-10-13 20:41:20.155530 | controller | . |\n logger.go:42: 19:39:53 | | |+. o . o o |\n logger.go:42: 19:39:53 2025-10-13 20:41:20.155543 | controller | | | |*o S . . |\n logger.go:42: 19:39:53 | | |+o.. . E o |\n 2025-10-13 20:41:20.155549 | controller | \ logger.go:42: 19:39:53 | | |... . . + o.o |\n logger.go:42: 19:39:53 2025-10-13 20:41:20.155555 | controller | | | |o o. o o.oo=.o |\n logger.go:42: 19:39:53 | | |.=o. o .ooo=. |\n 2025-10-13 20:41:20.155560 | controller | \ logger.go:42: 19:39:53 | | +----[SHA256]-----+\n logger.go:42: 19:39:53 2025-10-13 20:41:20.155566 | controller | | | secret/dataplane-ansible-ssh-private-key-secret created\n harness.go:363: 2025-10-13 20:41:20.155572 | controller | running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds 2025-10-13 20:41:20.155578 | controller | for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.155583 | controller | has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-basic-deployment\n=== 2025-10-13 20:41:20.155589 | controller | PAUSE kuttl/harness/ctlplane-basic-deployment\n=== RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== 2025-10-13 20:41:20.155595 | controller | PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== CONT kuttl/harness/ctlplane-basic-deployment\n 2025-10-13 20:41:20.155600 | controller | \ logger.go:42: 19:39:53 | ctlplane-basic-deployment | Skipping creation of user-supplied 2025-10-13 20:41:20.155606 | controller | namespace: openstack-kuttl-tests\n logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack 2025-10-13 20:41:20.155612 | controller | | starting test step 1-deploy-openstack\n logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack 2025-10-13 20:41:20.155618 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.155623 | controller | | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack 2025-10-13 20:41:20.155629 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.155635 | controller | for production! For production use at least 5G!\n logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack 2025-10-13 20:41:20.155640 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.155646 | controller | for production! For production use at least 5G!\n logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack 2025-10-13 20:41:20.155652 | controller | | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 2025-10-13 20:41:20.155657 | controller | 19:44:54 | ctlplane-basic-deployment/1-deploy-openstack | test step completed 1-deploy-openstack\n 2025-10-13 20:41:20.155663 | controller | \ logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret 2025-10-13 20:41:20.155669 | controller | | starting test step 2-deploy-custom-cacert-secret\n logger.go:42: 19:44:54 | 2025-10-13 20:41:20.155674 | controller | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | running command: [sh -c 2025-10-13 20:41:20.155680 | controller | oc apply -n $NAMESPACE -f ../../common/custom-ca.yaml\n ]\n logger.go:42: 2025-10-13 20:41:20.155686 | controller | 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | secret/ca-custom-kuttl 2025-10-13 20:41:20.155691 | controller | created\n logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret 2025-10-13 20:41:20.155697 | controller | | test step completed 2-deploy-custom-cacert-secret\n logger.go:42: 19:44:54 2025-10-13 20:41:20.155706 | controller | | ctlplane-basic-deployment/3-deploy-custom-cacert | starting test step 3-deploy-custom-cacert\n 2025-10-13 20:41:20.155712 | controller | \ logger.go:42: 19:44:54 | ctlplane-basic-deployment/3-deploy-custom-cacert | 2025-10-13 20:41:20.155717 | controller | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_ca | 2025-10-13 20:41:20.155723 | controller | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert 2025-10-13 20:41:20.155732 | controller | | openstackcontrolplane.core.openstack.org/openstack configured\n logger.go:42: 2025-10-13 20:41:20.155738 | controller | 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert | test step completed 2025-10-13 20:41:20.155744 | controller | 3-deploy-custom-cacert\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- 2025-10-13 20:41:20.155749 | controller | | starting test step 4-\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- 2025-10-13 20:41:20.155764 | controller | | running command: [sh -c echo \"Checking ca-custom-kuttl.pem is present in combined-ca-bundle...\"\n 2025-10-13 20:41:20.155773 | controller | \ CUSTOM_CERT_CONTENT=$(oc get secret ca-custom-kuttl -n $NAMESPACE -o jsonpath=\"{.data['ca-custom-kuttl\\.pem']}\" 2025-10-13 20:41:20.155780 | controller | | base64 --decode | tr -d '\\n')\n TLS_BUNDLE_CONTENT=$(oc get secret combined-ca-bundle 2025-10-13 20:41:20.155787 | controller | -n $NAMESPACE -o jsonpath=\"{.data['tls-ca-bundle\\.pem']}\" | base64 --decode | 2025-10-13 20:41:20.155793 | controller | tr -d '\\n')\n if [[ \"$TLS_BUNDLE_CONTENT\" == *\"$CUSTOM_CERT_CONTENT\"* 2025-10-13 20:41:20.155799 | controller | ]]; then\n echo \"OK\"\n exit 0\n else\n echo 2025-10-13 20:41:20.155804 | controller | \"Not present\"\n exit 1\n fi\n ]\n logger.go:42: 19:44:59 2025-10-13 20:41:20.155810 | controller | | ctlplane-basic-deployment/4- | Checking ca-custom-kuttl.pem is present in combined-ca-bundle...\n 2025-10-13 20:41:20.155816 | controller | \ logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | OK\n logger.go:42: 2025-10-13 20:41:20.155821 | controller | 19:44:59 | ctlplane-basic-deployment/4- | test step completed 4-\n logger.go:42: 2025-10-13 20:41:20.155827 | controller | 19:44:59 | ctlplane-basic-deployment/5-cleanup | starting test step 5-cleanup\n 2025-10-13 20:41:20.155833 | controller | \ logger.go:42: 19:45:01 | ctlplane-basic-deployment/5-cleanup | running command: 2025-10-13 20:41:20.155838 | controller | [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n srv-swift-storage-0\n 2025-10-13 20:41:20.155844 | controller | \ oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n 2025-10-13 20:41:20.155849 | controller | \ oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret 2025-10-13 20:41:20.155855 | controller | -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155861 | controller | | secret \"combined-ca-bundle\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155866 | controller | | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155875 | controller | | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155881 | controller | | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155887 | controller | | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 19:45:02 | 2025-10-13 20:41:20.155892 | controller | ctlplane-basic-deployment/5-cleanup | secret \"cert-cinder-internal-svc\" deleted\n 2025-10-13 20:41:20.155898 | controller | \ logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-cinder-public-route\" 2025-10-13 20:41:20.155903 | controller | deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret 2025-10-13 20:41:20.155909 | controller | \"cert-cinder-public-svc\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155915 | controller | | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 19:45:03 2025-10-13 20:41:20.155920 | controller | | ctlplane-basic-deployment/5-cleanup | secret \"cert-galera-openstack-svc\" deleted\n 2025-10-13 20:41:20.155926 | controller | \ logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-glance-default-internal-svc\" 2025-10-13 20:41:20.155935 | controller | deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret 2025-10-13 20:41:20.155941 | controller | \"cert-glance-default-public-route\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155947 | controller | | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 19:45:03 2025-10-13 20:41:20.155953 | controller | | ctlplane-basic-deployment/5-cleanup | secret \"cert-keystone-internal-svc\" deleted\n 2025-10-13 20:41:20.155961 | controller | \ logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-keystone-public-route\" 2025-10-13 20:41:20.155966 | controller | deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret 2025-10-13 20:41:20.155973 | controller | \"cert-keystone-public-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155980 | controller | | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155986 | controller | | secret \"cert-memcached-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155992 | controller | | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.155997 | controller | | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156003 | controller | | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156015 | controller | | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156023 | controller | | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156031 | controller | | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 2025-10-13 20:41:20.156038 | controller | 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" 2025-10-13 20:41:20.156043 | controller | deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret 2025-10-13 20:41:20.156049 | controller | \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156055 | controller | | secret \"cert-nova-public-route\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156060 | controller | | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156066 | controller | | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156072 | controller | | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156077 | controller | | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156083 | controller | | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156089 | controller | | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156094 | controller | | secret \"cert-placement-public-route\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156100 | controller | | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156105 | controller | | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156111 | controller | | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156120 | controller | | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156125 | controller | | secret \"cert-swift-public-route\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156131 | controller | | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156137 | controller | | secret \"rootca-internal\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156142 | controller | | secret \"rootca-libvirt\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156148 | controller | | secret \"rootca-ovn\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156154 | controller | | secret \"rootca-public\" deleted\n logger.go:42: 19:45:42 | ctlplane-basic-deployment/5-cleanup 2025-10-13 20:41:20.156159 | controller | | test step completed 5-cleanup\n logger.go:42: 19:45:42 | ctlplane-basic-deployment 2025-10-13 20:41:20.156165 | controller | | skipping kubernetes event logging\n=== CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n 2025-10-13 20:41:20.156170 | controller | \ logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings | Skipping 2025-10-13 20:41:20.156179 | controller | creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 19:45:42 2025-10-13 20:41:20.156185 | controller | | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | starting test 2025-10-13 20:41:20.156190 | controller | step 1-create-nic-mappings\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.156196 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml\n 2025-10-13 20:41:20.156202 | controller | \ ]\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.156207 | controller | | networkattachmentdefinition.k8s.cni.cncf.io/datacentre configured\n logger.go:42: 2025-10-13 20:41:20.156213 | controller | 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | test 2025-10-13 20:41:20.156219 | controller | step completed 1-create-nic-mappings\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.156224 | controller | | starting test step 2-deploy-openstack\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.156230 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.156242 | controller | | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.156251 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.156258 | controller | for production! For production use at least 5G!\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.156265 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.156271 | controller | for production! For production use at least 5G!\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.156277 | controller | | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 2025-10-13 20:41:20.156282 | controller | 19:50:07 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | test 2025-10-13 20:41:20.156288 | controller | step completed 2-deploy-openstack\n logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.156294 | controller | | starting test step 3-add-ovn-nic-mappings\n logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.156299 | controller | | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack 2025-10-13 20:41:20.156319 | controller | --type='json' -p='[{\n \"op\": \"replace\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n 2025-10-13 20:41:20.156324 | controller | \ \"value\":{\"datacentre\":\"ospbr\"}\n }]'\n ]\n logger.go:42: 2025-10-13 20:41:20.156330 | controller | 19:50:08 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.156336 | controller | patched\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.156341 | controller | | test step completed 3-add-ovn-nic-mappings\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156347 | controller | | starting test step 4-remove-ovn-nic-mappings\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156353 | controller | | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack 2025-10-13 20:41:20.156358 | controller | --type='json' -p='[{\n \"op\": \"remove\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n 2025-10-13 20:41:20.156364 | controller | \ }]'\n ]\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156370 | controller | | openstackcontrolplane.core.openstack.org/openstack patched\n logger.go:42: 2025-10-13 20:41:20.156375 | controller | 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156381 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156387 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156396 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156418 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156429 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156437 | controller | \ exit 1\n ]\n logger.go:42: 19:50:16 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156442 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156448 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156454 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156459 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156465 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156471 | controller | \ exit 1\n ]\n logger.go:42: 19:50:17 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156476 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156482 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156487 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156493 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156499 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156512 | controller | \ exit 1\n ]\n logger.go:42: 19:50:18 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156520 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156532 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156540 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156547 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156554 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156560 | controller | \ exit 1\n ]\n logger.go:42: 19:50:20 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156565 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156571 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156577 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156582 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156588 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156594 | controller | \ exit 1\n ]\n logger.go:42: 19:50:21 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156599 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156605 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156611 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156616 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156622 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156628 | controller | \ exit 1\n ]\n logger.go:42: 19:50:22 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156633 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156639 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156645 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156650 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156659 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156667 | controller | \ exit 1\n ]\n logger.go:42: 19:50:24 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156673 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156679 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156684 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156690 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156696 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156702 | controller | \ exit 1\n ]\n logger.go:42: 19:50:25 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156707 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156713 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156719 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156725 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156736 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156741 | controller | \ exit 1\n ]\n logger.go:42: 19:50:27 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156747 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156753 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156759 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156764 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156770 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156783 | controller | \ exit 1\n ]\n logger.go:42: 19:50:28 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156791 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156799 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156806 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156812 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156818 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156824 | controller | \ exit 1\n ]\n logger.go:42: 19:50:29 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156830 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156839 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156845 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156851 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156857 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156862 | controller | \ exit 1\n ]\n logger.go:42: 19:50:31 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156868 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156874 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156880 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156885 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156891 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156897 | controller | \ exit 1\n ]\n logger.go:42: 19:50:32 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156903 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156908 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156914 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156920 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156926 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156931 | controller | \ exit 1\n ]\n logger.go:42: 19:50:33 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156940 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156946 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156951 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156960 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.156966 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.156971 | controller | \ exit 1\n ]\n logger.go:42: 19:50:35 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.156977 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.156983 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.156989 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.156994 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157000 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157006 | controller | \ exit 1\n ]\n logger.go:42: 19:50:36 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157012 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157017 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157023 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157029 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157035 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157048 | controller | \ exit 1\n ]\n logger.go:42: 19:50:37 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157056 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157064 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157071 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157077 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157083 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157088 | controller | \ exit 1\n ]\n logger.go:42: 19:50:39 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157094 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157100 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157106 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157111 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157117 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157123 | controller | \ exit 1\n ]\n logger.go:42: 19:50:40 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157128 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157134 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157140 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157149 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157155 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157160 | controller | \ exit 1\n ]\n logger.go:42: 19:50:41 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157166 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157172 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157178 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157183 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157189 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157195 | controller | \ exit 1\n ]\n logger.go:42: 19:50:43 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157201 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157206 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157212 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157218 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157223 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157229 | controller | \ exit 1\n ]\n logger.go:42: 19:50:44 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157235 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157240 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157249 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157255 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157260 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157266 | controller | \ exit 1\n ]\n logger.go:42: 19:50:45 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157272 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157277 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157283 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157289 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157295 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157504 | controller | \ exit 1\n ]\n logger.go:42: 19:50:47 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157518 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157526 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157534 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157540 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157546 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157555 | controller | \ exit 1\n ]\n logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157561 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.157567 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.157572 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.157578 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.157584 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.157589 | controller | \ exit 1\n ]\n logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.157595 | controller | | test step completed 4-remove-ovn-nic-mappings\n logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157601 | controller | | starting test step 5-cleanup\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157607 | controller | | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n 2025-10-13 20:41:20.157612 | controller | \ srv-swift-storage-0\n oc delete secret --ignore-not-found=true combined-ca-bundle 2025-10-13 20:41:20.157618 | controller | -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n oc 2025-10-13 20:41:20.157624 | controller | delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 19:50:49 | 2025-10-13 20:41:20.157629 | controller | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"combined-ca-bundle\" 2025-10-13 20:41:20.157635 | controller | deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157641 | controller | | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157647 | controller | | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157652 | controller | | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157658 | controller | | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 19:50:49 | 2025-10-13 20:41:20.157664 | controller | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-internal-svc\" 2025-10-13 20:41:20.157669 | controller | deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157675 | controller | | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157681 | controller | | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157686 | controller | | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 19:50:49 2025-10-13 20:41:20.157692 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-galera-openstack-svc\" 2025-10-13 20:41:20.157698 | controller | deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157704 | controller | | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 19:50:50 2025-10-13 20:41:20.157709 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-public-route\" 2025-10-13 20:41:20.157715 | controller | deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157721 | controller | | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 19:50:50 2025-10-13 20:41:20.157729 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-internal-svc\" 2025-10-13 20:41:20.157738 | controller | deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157744 | controller | | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157752 | controller | | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157766 | controller | | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157774 | controller | | secret \"cert-memcached-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157781 | controller | | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157789 | controller | | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157795 | controller | | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157801 | controller | | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157807 | controller | | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157812 | controller | | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 2025-10-13 20:41:20.157818 | controller | 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" 2025-10-13 20:41:20.157824 | controller | deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157829 | controller | | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 19:50:50 2025-10-13 20:41:20.157835 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-public-route\" 2025-10-13 20:41:20.157841 | controller | deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157846 | controller | | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157852 | controller | | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157858 | controller | | secret \"cert-ovncontroller-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157863 | controller | | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157869 | controller | | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157875 | controller | | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157880 | controller | | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157886 | controller | | secret \"cert-placement-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157892 | controller | | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157897 | controller | | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157903 | controller | | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157912 | controller | | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157918 | controller | | secret \"cert-swift-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157924 | controller | | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157930 | controller | | secret \"rootca-internal\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157935 | controller | | secret \"rootca-libvirt\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157941 | controller | | secret \"rootca-ovn\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157947 | controller | | secret \"rootca-public\" deleted\n logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.157952 | controller | | test step completed 5-cleanup\n logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.157958 | controller | | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests 2025-10-13 20:41:20.157970 | controller | finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: 2025-10-13 20:41:20.157978 | controller | \"\"\n--- PASS: kuttl (689.89s)\n --- PASS: kuttl/harness (0.00s)\n --- 2025-10-13 20:41:20.157986 | controller | PASS: kuttl/harness/ctlplane-basic-deployment (348.38s)\n --- PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.157993 | controller | (340.23s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.158001 | controller | scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.158007 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.158012 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.158021 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.158027 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.158033 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.158038 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.158044 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.158050 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ 2025-10-13 20:41:20.158056 | controller | oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ 2025-10-13 20:41:20.158061 | controller | grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.158067 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.158073 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.158081 | controller | cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.158087 | controller | pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" 2025-10-13 20:41:20.158092 | controller | deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.158101 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.158107 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ cut -d / -f 2\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n+ 2025-10-13 20:41:20.158112 | controller | NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.158118 | controller | pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.158124 | controller | \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.158129 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.158135 | controller | openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ 2025-10-13 20:41:20.158141 | controller | echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 2\n+ 2025-10-13 20:41:20.158146 | controller | NAME=mysql-db-openstack-cell1-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.158152 | controller | --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" 2025-10-13 20:41:20.158158 | controller | deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.158163 | controller | | grep Bound | awk '{print $6}'`\n++ cut -d / -f 1\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n+ 2025-10-13 20:41:20.158169 | controller | NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.158175 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.158181 | controller | pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.158186 | controller | \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.158192 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.158198 | controller | openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ 2025-10-13 20:41:20.158203 | controller | echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ 2025-10-13 20:41:20.158209 | controller | oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.158221 | controller | \"mysql-db-openstack-galera-0\" deleted\n++ awk '{print $1}'\n++ oc get pv --selector 2025-10-13 20:41:20.158230 | controller | provisioned-by=crc-devsetup --no-headers\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158237 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume 2025-10-13 20:41:20.158244 | controller | \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158250 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume 2025-10-13 20:41:20.158256 | controller | \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158261 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume 2025-10-13 20:41:20.158267 | controller | \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158273 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume 2025-10-13 20:41:20.158278 | controller | \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158284 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume 2025-10-13 20:41:20.158290 | controller | \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158299 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume 2025-10-13 20:41:20.158305 | controller | \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158310 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume 2025-10-13 20:41:20.158316 | controller | \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158322 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume 2025-10-13 20:41:20.158327 | controller | \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158333 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume 2025-10-13 20:41:20.158339 | controller | \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158345 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume 2025-10-13 20:41:20.158350 | controller | \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158356 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume 2025-10-13 20:41:20.158362 | controller | \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158367 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume 2025-10-13 20:41:20.158373 | controller | \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158379 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume 2025-10-13 20:41:20.158384 | controller | \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158399 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume 2025-10-13 20:41:20.158430 | controller | \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158438 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume 2025-10-13 20:41:20.158445 | controller | \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158451 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume 2025-10-13 20:41:20.158457 | controller | \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158462 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume 2025-10-13 20:41:20.158468 | controller | \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158474 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume 2025-10-13 20:41:20.158479 | controller | \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158485 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume 2025-10-13 20:41:20.158491 | controller | \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.158496 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume 2025-10-13 20:41:20.158502 | controller | \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete 2025-10-13 20:41:20.158516 | controller | sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY 2025-10-13 20:41:20.158524 | controller | \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner 2025-10-13 20:41:20.158532 | controller | \ Delete WaitForFirstConsumer true 11m\nstorageclass.storage.k8s.io 2025-10-13 20:41:20.158545 | controller | \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ 2025-10-13 20:41:20.158552 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.158559 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.158567 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.158573 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.158579 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.158584 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.158590 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' 2025-10-13 20:41:20.158596 | controller | -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node 2025-10-13 20:41:20.158601 | controller | in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.158607 | controller | crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage 2025-10-13 20:41:20.158613 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.158618 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.158624 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.158630 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.158635 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.158641 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.158647 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.158652 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.158658 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.158664 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory 2025-10-13 20:41:20.158669 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.158675 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: 2025-10-13 20:41:20.158681 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.158686 | controller | scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.158692 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.158698 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.158703 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.158709 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.158715 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.158720 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.158726 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.158734 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname 2025-10-13 20:41:20.158739 | controller | scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.158745 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.158751 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.158757 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.158762 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.158776 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.158784 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase 2025-10-13 20:41:20.158792 | controller | | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template 2025-10-13 20:41:20.158799 | controller | '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ 2025-10-13 20:41:20.158807 | controller | NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.158817 | controller | crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage 2025-10-13 20:41:20.158823 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.158828 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.158834 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.158840 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.158845 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.158851 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.158857 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.158862 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.158868 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.158874 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ 2025-10-13 20:41:20.158879 | controller | OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' 2025-10-13 20:41:20.158885 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ 2025-10-13 20:41:20.158891 | controller | STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ 2025-10-13 20:41:20.158896 | controller | head -c-1\n++ tr '\\n' ' '\n++ sed -e 's|node/||'\n+ NODE_NAMES=crc\n+ '[' -z crc 2025-10-13 20:41:20.158902 | controller | ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.158908 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.158913 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.158919 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.158925 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.158930 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.158939 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.158945 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.158952 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.158959 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.158965 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.158972 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.158978 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.158984 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.158990 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.158995 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.159001 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.159007 | controller | -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage 2025-10-13 20:41:20.159012 | controller | created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc 2025-10-13 20:41:20.159020 | controller | created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc 2025-10-13 20:41:20.159026 | controller | created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc 2025-10-13 20:41:20.159032 | controller | created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc 2025-10-13 20:41:20.159037 | controller | created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc 2025-10-13 20:41:20.159051 | controller | created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc 2025-10-13 20:41:20.159059 | controller | created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc 2025-10-13 20:41:20.159067 | controller | created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc 2025-10-13 20:41:20.159074 | controller | created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc 2025-10-13 20:41:20.159082 | controller | created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc 2025-10-13 20:41:20.159088 | controller | created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory 2025-10-13 20:41:20.159094 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.159100 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 2025-10-13 20:41:20.159105 | controller | 19:51:44 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.159111 | controller | ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running 2025-10-13 20:41:20.159117 | controller | tests using configured kubeconfig.\n harness.go:278: Successful connection to 2025-10-13 20:41:20.159122 | controller | cluster at: https://api.crc.testing:6443\n logger.go:42: 19:51:44 | | running 2025-10-13 20:41:20.159128 | controller | command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n 2025-10-13 20:41:20.159137 | controller | \ logger.go:42: 19:51:44 | | netconfig.network.openstack.org/netconfig configured\n 2025-10-13 20:41:20.159143 | controller | \ logger.go:42: 19:51:44 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.159151 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n 2025-10-13 20:41:20.159157 | controller | \ logger.go:42: 19:51:45 | | dnsmasq.network.openstack.org/dnsmasq configured\n 2025-10-13 20:41:20.159163 | controller | \ logger.go:42: 19:51:45 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.159168 | controller | ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n 2025-10-13 20:41:20.159174 | controller | \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.159180 | controller | \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.159185 | controller | \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.159191 | controller | \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply 2025-10-13 20:41:20.159197 | controller | -f -\n ]\n logger.go:42: 19:51:45 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.159202 | controller | configured\n harness.go:363: running tests\n harness.go:75: going to run test 2025-10-13 20:41:20.159208 | controller | suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: 2025-10-13 20:41:20.159214 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.159219 | controller | has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== 2025-10-13 20:41:20.159225 | controller | PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n 2025-10-13 20:41:20.159231 | controller | \ logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings | Skipping 2025-10-13 20:41:20.159236 | controller | creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 19:51:45 2025-10-13 20:41:20.159242 | controller | | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | starting test 2025-10-13 20:41:20.159248 | controller | step 1-create-nic-mappings\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.159253 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml\n 2025-10-13 20:41:20.159259 | controller | \ ]\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.159265 | controller | | networkattachmentdefinition.k8s.cni.cncf.io/datacentre unchanged\n logger.go:42: 2025-10-13 20:41:20.159270 | controller | 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | test 2025-10-13 20:41:20.159276 | controller | step completed 1-create-nic-mappings\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.159289 | controller | | starting test step 2-deploy-openstack\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.159297 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.159305 | controller | | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.159313 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.159320 | controller | for production! For production use at least 5G!\n logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.159326 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.159332 | controller | for production! For production use at least 5G!\n logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.159340 | controller | | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 2025-10-13 20:41:20.159346 | controller | 19:55:57 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | test 2025-10-13 20:41:20.159352 | controller | step completed 2-deploy-openstack\n logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.159358 | controller | | starting test step 3-add-ovn-nic-mappings\n logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.159363 | controller | | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack 2025-10-13 20:41:20.159369 | controller | --type='json' -p='[{\n \"op\": \"replace\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n 2025-10-13 20:41:20.159375 | controller | \ \"value\":{\"datacentre\":\"ospbr\"}\n }]'\n ]\n logger.go:42: 2025-10-13 20:41:20.159380 | controller | 19:55:58 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.159386 | controller | patched\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.159395 | controller | | test step completed 3-add-ovn-nic-mappings\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159417 | controller | | starting test step 4-remove-ovn-nic-mappings\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159429 | controller | | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack 2025-10-13 20:41:20.159436 | controller | --type='json' -p='[{\n \"op\": \"remove\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n 2025-10-13 20:41:20.159443 | controller | \ }]'\n ]\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159449 | controller | | openstackcontrolplane.core.openstack.org/openstack patched\n logger.go:42: 2025-10-13 20:41:20.159455 | controller | 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159460 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.159466 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.159471 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.159477 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.159483 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.159488 | controller | \ exit 1\n ]\n logger.go:42: 19:56:04 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159494 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.159500 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.159505 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.159511 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.159517 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.159522 | controller | \ exit 1\n ]\n logger.go:42: 19:56:06 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159528 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.159534 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n 2025-10-13 20:41:20.159546 | controller | \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.159551 | controller | --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count 2025-10-13 20:41:20.159565 | controller | -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n 2025-10-13 20:41:20.159573 | controller | \ exit 1\n ]\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159581 | controller | | Unable to connect to the server: dial tcp: lookup api.crc.testing on 199.204.44.24:53: 2025-10-13 20:41:20.159589 | controller | no such host\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.159596 | controller | | test step completed 4-remove-ovn-nic-mappings\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159603 | controller | | starting test step 5-cleanup\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159611 | controller | | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n 2025-10-13 20:41:20.159618 | controller | \ srv-swift-storage-0\n oc delete secret --ignore-not-found=true combined-ca-bundle 2025-10-13 20:41:20.159624 | controller | -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n oc 2025-10-13 20:41:20.159630 | controller | delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 19:56:12 | 2025-10-13 20:41:20.159635 | controller | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"combined-ca-bundle\" 2025-10-13 20:41:20.159641 | controller | deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159647 | controller | | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159652 | controller | | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159661 | controller | | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159667 | controller | | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 19:56:12 | 2025-10-13 20:41:20.159672 | controller | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-internal-svc\" 2025-10-13 20:41:20.159678 | controller | deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159684 | controller | | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159689 | controller | | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159695 | controller | | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 19:56:12 2025-10-13 20:41:20.159701 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-galera-openstack-svc\" 2025-10-13 20:41:20.159706 | controller | deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159712 | controller | | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 19:56:12 2025-10-13 20:41:20.159718 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-public-route\" 2025-10-13 20:41:20.159724 | controller | deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159729 | controller | | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 19:56:12 2025-10-13 20:41:20.159737 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-internal-svc\" 2025-10-13 20:41:20.159746 | controller | deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159751 | controller | | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159757 | controller | | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159763 | controller | | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159768 | controller | | secret \"cert-memcached-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159774 | controller | | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159780 | controller | | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159786 | controller | | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159799 | controller | | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159807 | controller | | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159815 | controller | | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 2025-10-13 20:41:20.159822 | controller | 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" 2025-10-13 20:41:20.159830 | controller | deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159836 | controller | | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 19:56:12 2025-10-13 20:41:20.159842 | controller | | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-public-route\" 2025-10-13 20:41:20.159847 | controller | deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159853 | controller | | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159859 | controller | | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159870 | controller | | secret \"cert-ovncontroller-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159876 | controller | | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159882 | controller | | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159887 | controller | | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159893 | controller | | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159899 | controller | | secret \"cert-placement-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159904 | controller | | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159910 | controller | | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159916 | controller | | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159924 | controller | | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159933 | controller | | secret \"cert-swift-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159938 | controller | | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159944 | controller | | secret \"rootca-internal\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159950 | controller | | secret \"rootca-libvirt\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159958 | controller | | secret \"rootca-ovn\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159963 | controller | | secret \"rootca-public\" deleted\n logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.159969 | controller | | test step completed 5-cleanup\n logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.159975 | controller | | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests 2025-10-13 20:41:20.159980 | controller | finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: 2025-10-13 20:41:20.159986 | controller | \"\"\n--- PASS: kuttl (301.64s)\n --- PASS: kuttl/harness (0.00s)\n --- 2025-10-13 20:41:20.159992 | controller | PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings (300.23s)\nPASS\nNo 2025-10-13 20:41:20.159997 | controller | resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.160003 | controller | scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.160009 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.160015 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.160028 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.160036 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.160044 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.160051 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.160059 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.160065 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ 2025-10-13 20:41:20.160071 | controller | oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ 2025-10-13 20:41:20.160076 | controller | grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.160082 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.160088 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.160093 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.160099 | controller | pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.160105 | controller | \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.160111 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.160120 | controller | openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ 2025-10-13 20:41:20.160126 | controller | echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ 2025-10-13 20:41:20.160132 | controller | oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.160137 | controller | \"mysql-db-openstack-galera-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160143 | controller | --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ 2025-10-13 20:41:20.160149 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ 2025-10-13 20:41:20.160155 | controller | cut -d / -f 2\n+ NAME=mysql-db-openstack-cell1-galera-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.160160 | controller | pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.160166 | controller | \"mysql-db-openstack-cell1-galera-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.160172 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.160180 | controller | openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ 2025-10-13 20:41:20.160186 | controller | NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.160192 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.160198 | controller | pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.160203 | controller | \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.160209 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.160215 | controller | openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ 2025-10-13 20:41:20.160221 | controller | echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ 2025-10-13 20:41:20.160226 | controller | oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.160232 | controller | \"swift-swift-storage-0\" deleted\n++ oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160238 | controller | --no-headers\n++ awk '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160244 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume 2025-10-13 20:41:20.160250 | controller | \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160255 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume 2025-10-13 20:41:20.160261 | controller | \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160267 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume 2025-10-13 20:41:20.160272 | controller | \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160286 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume 2025-10-13 20:41:20.160294 | controller | \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160302 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume 2025-10-13 20:41:20.160309 | controller | \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160317 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume 2025-10-13 20:41:20.160326 | controller | \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160332 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume 2025-10-13 20:41:20.160338 | controller | \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160344 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume 2025-10-13 20:41:20.160350 | controller | \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160355 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume 2025-10-13 20:41:20.160361 | controller | \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160367 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume 2025-10-13 20:41:20.160373 | controller | \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160378 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume 2025-10-13 20:41:20.160387 | controller | \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160396 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume 2025-10-13 20:41:20.160416 | controller | \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160424 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume 2025-10-13 20:41:20.160431 | controller | \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160436 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume 2025-10-13 20:41:20.160442 | controller | \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160448 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume 2025-10-13 20:41:20.160454 | controller | \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160459 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume 2025-10-13 20:41:20.160465 | controller | \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160471 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume 2025-10-13 20:41:20.160477 | controller | \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160482 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume 2025-10-13 20:41:20.160488 | controller | \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160494 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume 2025-10-13 20:41:20.160499 | controller | \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.160505 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume 2025-10-13 20:41:20.160511 | controller | \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete 2025-10-13 20:41:20.160517 | controller | sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY 2025-10-13 20:41:20.160522 | controller | \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner 2025-10-13 20:41:20.160528 | controller | \ Delete WaitForFirstConsumer true 5m11s\nstorageclass.storage.k8s.io 2025-10-13 20:41:20.160537 | controller | \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ 2025-10-13 20:41:20.160543 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.160548 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.160554 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.160560 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.160573 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.160581 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.160589 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' 2025-10-13 20:41:20.160596 | controller | -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node 2025-10-13 20:41:20.160604 | controller | in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.160614 | controller | crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage 2025-10-13 20:41:20.160620 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.160626 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.160631 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.160637 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.160643 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.160648 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.160654 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.160660 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.160665 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.160671 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory 2025-10-13 20:41:20.160677 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.160682 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: 2025-10-13 20:41:20.160688 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.160694 | controller | scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.160699 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.160705 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.160711 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.160716 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.160722 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.160728 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.160733 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.160742 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname 2025-10-13 20:41:20.160748 | controller | scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.160754 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.160759 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.160765 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.160771 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.160776 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.160782 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase 2025-10-13 20:41:20.160787 | controller | | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template 2025-10-13 20:41:20.160793 | controller | '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ 2025-10-13 20:41:20.160799 | controller | NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.160804 | controller | crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage 2025-10-13 20:41:20.160810 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.160816 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.160829 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.160837 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.160844 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.160852 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.160860 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.160866 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.160872 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.160881 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ 2025-10-13 20:41:20.160886 | controller | OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' 2025-10-13 20:41:20.160892 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ 2025-10-13 20:41:20.160898 | controller | STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ 2025-10-13 20:41:20.160903 | controller | head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc 2025-10-13 20:41:20.160909 | controller | ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.160915 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.160920 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.160926 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.160932 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.160940 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.160945 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.160954 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.160960 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.160965 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.160971 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.160977 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.160982 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.160988 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.160994 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.160999 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.161005 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.161011 | controller | -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage 2025-10-13 20:41:20.161016 | controller | created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc 2025-10-13 20:41:20.161022 | controller | created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc 2025-10-13 20:41:20.161028 | controller | created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc 2025-10-13 20:41:20.161033 | controller | created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc 2025-10-13 20:41:20.161039 | controller | created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc 2025-10-13 20:41:20.161045 | controller | created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc 2025-10-13 20:41:20.161050 | controller | created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc 2025-10-13 20:41:20.161056 | controller | created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc 2025-10-13 20:41:20.161062 | controller | created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc 2025-10-13 20:41:20.161068 | controller | created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc 2025-10-13 20:41:20.161073 | controller | created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory 2025-10-13 20:41:20.161079 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.161085 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 2025-10-13 20:41:20.161097 | controller | 19:57:08 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.161105 | controller | ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running 2025-10-13 20:41:20.161113 | controller | tests using configured kubeconfig.\n harness.go:278: Successful connection to 2025-10-13 20:41:20.161121 | controller | cluster at: https://api.crc.testing:6443\n logger.go:42: 19:57:08 | | running 2025-10-13 20:41:20.161129 | controller | command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n 2025-10-13 20:41:20.161135 | controller | \ logger.go:42: 19:57:08 | | netconfig.network.openstack.org/netconfig configured\n 2025-10-13 20:41:20.161141 | controller | \ logger.go:42: 19:57:08 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.161150 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n 2025-10-13 20:41:20.161156 | controller | \ logger.go:42: 19:57:09 | | dnsmasq.network.openstack.org/dnsmasq configured\n 2025-10-13 20:41:20.161161 | controller | \ logger.go:42: 19:57:09 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.161167 | controller | ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n 2025-10-13 20:41:20.161173 | controller | \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.161179 | controller | \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.161185 | controller | \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.161190 | controller | \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply 2025-10-13 20:41:20.161196 | controller | -f -\n ]\n logger.go:42: 19:57:09 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.161202 | controller | configured\n harness.go:363: running tests\n harness.go:75: going to run test 2025-10-13 20:41:20.161207 | controller | suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: 2025-10-13 20:41:20.161213 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.161219 | controller | has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-collapsed\n=== 2025-10-13 20:41:20.161225 | controller | PAUSE kuttl/harness/ctlplane-collapsed\n=== CONT kuttl/harness/ctlplane-collapsed\n 2025-10-13 20:41:20.161230 | controller | \ logger.go:42: 19:57:09 | ctlplane-collapsed | Skipping creation of user-supplied 2025-10-13 20:41:20.161236 | controller | namespace: openstack-kuttl-tests\n logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps 2025-10-13 20:41:20.161242 | controller | | starting test step 0-deps\n logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps 2025-10-13 20:41:20.161426 | controller | | running command: [sh -c oc apply -f ../../common/rhobs.yaml\n until oc 2025-10-13 20:41:20.161436 | controller | api-resources | grep -q rhobs; do sleep 1; done\n ]\n logger.go:42: 19:57:09 2025-10-13 20:41:20.161442 | controller | | ctlplane-collapsed/0-deps | subscription.operators.coreos.com/cluster-observability-operator 2025-10-13 20:41:20.161448 | controller | created\n logger.go:42: 19:57:25 | ctlplane-collapsed/0-deps | test step completed 2025-10-13 20:41:20.161454 | controller | 0-deps\n logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.161459 | controller | | starting test step 1-deploy-openstack-collapsed-cell\n logger.go:42: 19:57:25 2025-10-13 20:41:20.161465 | controller | | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | running command: [sh -c 2025-10-13 20:41:20.161471 | controller | oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_collapsed_cell.yaml\n 2025-10-13 20:41:20.161477 | controller | \ ]\n logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.161483 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.161507 | controller | for production! For production use at least 5G!\n logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.161514 | controller | | openstackcontrolplane.core.openstack.org/openstack-collapsed-cell created\n logger.go:42: 2025-10-13 20:41:20.161522 | controller | 20:01:51 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | test step completed 2025-10-13 20:41:20.161529 | controller | 1-deploy-openstack-collapsed-cell\n logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup 2025-10-13 20:41:20.161534 | controller | | starting test step 2-cleanup\n logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup 2025-10-13 20:41:20.161544 | controller | | running command: [sh -c oc delete secret --ignore-not-found=true combined-ca-bundle 2025-10-13 20:41:20.161558 | controller | -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n oc 2025-10-13 20:41:20.161566 | controller | delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 20:01:51 | 2025-10-13 20:41:20.161574 | controller | ctlplane-collapsed/2-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 2025-10-13 20:41:20.161582 | controller | 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-barbican-internal-svc\" 2025-10-13 20:41:20.161590 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-barbican-public-route\" 2025-10-13 20:41:20.161598 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-barbican-public-svc\" 2025-10-13 20:41:20.161604 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ceilometer-internal-svc\" 2025-10-13 20:41:20.161610 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-cinder-internal-svc\" 2025-10-13 20:41:20.161615 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-cinder-public-route\" 2025-10-13 20:41:20.161621 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-cinder-public-svc\" 2025-10-13 20:41:20.161627 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-galera-openstack-svc\" 2025-10-13 20:41:20.161633 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-glance-default-internal-svc\" 2025-10-13 20:41:20.161638 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-glance-default-public-route\" 2025-10-13 20:41:20.161644 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-glance-default-public-svc\" 2025-10-13 20:41:20.161650 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-keystone-internal-svc\" 2025-10-13 20:41:20.161656 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-keystone-public-route\" 2025-10-13 20:41:20.161661 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-keystone-public-svc\" 2025-10-13 20:41:20.161667 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-kube-state-metrics-svc\" 2025-10-13 20:41:20.161673 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-memcached-svc\" 2025-10-13 20:41:20.161682 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-metric-storage-prometheus-svc\" 2025-10-13 20:41:20.161688 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-internal-svc\" 2025-10-13 20:41:20.161694 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-ovndbs\" 2025-10-13 20:41:20.161700 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-public-route\" 2025-10-13 20:41:20.161707 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-public-svc\" 2025-10-13 20:41:20.161713 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-internal-svc\" 2025-10-13 20:41:20.161719 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" 2025-10-13 20:41:20.161725 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" 2025-10-13 20:41:20.161730 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" 2025-10-13 20:41:20.161736 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-public-route\" 2025-10-13 20:41:20.161745 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-public-svc\" 2025-10-13 20:41:20.161750 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovn-metrics\" 2025-10-13 20:41:20.161756 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" 2025-10-13 20:41:20.161762 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" 2025-10-13 20:41:20.161768 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovnnorthd-ovndbs\" 2025-10-13 20:41:20.161773 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-placement-internal-svc\" 2025-10-13 20:41:20.161779 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-placement-public-route\" 2025-10-13 20:41:20.161785 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-placement-public-svc\" 2025-10-13 20:41:20.161798 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-rabbitmq-svc\" 2025-10-13 20:41:20.161806 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-swift-internal-svc\" 2025-10-13 20:41:20.161814 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-swift-public-route\" 2025-10-13 20:41:20.161822 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-swift-public-svc\" 2025-10-13 20:41:20.161829 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-watcher-internal-svc\" 2025-10-13 20:41:20.161835 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-watcher-public-route\" 2025-10-13 20:41:20.161841 | controller | deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-watcher-public-svc\" 2025-10-13 20:41:20.161847 | controller | deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-internal\" 2025-10-13 20:41:20.161853 | controller | deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-libvirt\" 2025-10-13 20:41:20.161858 | controller | deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-ovn\" 2025-10-13 20:41:20.161864 | controller | deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-public\" 2025-10-13 20:41:20.161870 | controller | deleted\n logger.go:42: 20:02:25 | ctlplane-collapsed/2-cleanup | test step completed 2025-10-13 20:41:20.161875 | controller | 2-cleanup\n logger.go:42: 20:02:25 | ctlplane-collapsed | skipping kubernetes 2025-10-13 20:41:20.161881 | controller | event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n harness.go:514: 2025-10-13 20:41:20.161887 | controller | cleaning up\n harness.go:571: removing temp folder: \"\"\n--- PASS: kuttl (317.74s)\n 2025-10-13 20:41:20.161892 | controller | \ --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-collapsed 2025-10-13 20:41:20.161898 | controller | (316.26s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.161904 | controller | scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.161910 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.161915 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.161921 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.161927 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.161937 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.161942 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.161948 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.161955 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ 2025-10-13 20:41:20.161962 | controller | oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ 2025-10-13 20:41:20.161968 | controller | grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.161975 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.161981 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.161987 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.161993 | controller | pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.161998 | controller | \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.162004 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.162010 | controller | openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ 2025-10-13 20:41:20.162015 | controller | NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.162021 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.162027 | controller | pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.162032 | controller | \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.162038 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.162044 | controller | openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ 2025-10-13 20:41:20.162060 | controller | echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ 2025-10-13 20:41:20.162068 | controller | oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.162076 | controller | \"swift-swift-storage-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.162084 | controller | --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ 2025-10-13 20:41:20.162091 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ 2025-10-13 20:41:20.162098 | controller | cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.162103 | controller | pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-galera-0\" 2025-10-13 20:41:20.162109 | controller | deleted\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk 2025-10-13 20:41:20.162115 | controller | '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162120 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume \"local-storage01-crc\" 2025-10-13 20:41:20.162126 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162132 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume \"local-storage02-crc\" 2025-10-13 20:41:20.162137 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162149 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume \"local-storage03-crc\" 2025-10-13 20:41:20.162155 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162160 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume \"local-storage04-crc\" 2025-10-13 20:41:20.162166 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162172 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume \"local-storage05-crc\" 2025-10-13 20:41:20.162177 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162183 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume \"local-storage06-crc\" 2025-10-13 20:41:20.162189 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162194 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume \"local-storage07-crc\" 2025-10-13 20:41:20.162200 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162206 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume \"local-storage08-crc\" 2025-10-13 20:41:20.162211 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162217 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume \"local-storage09-crc\" 2025-10-13 20:41:20.162223 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162228 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume \"local-storage10-crc\" 2025-10-13 20:41:20.162234 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162240 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume \"local-storage11-crc\" 2025-10-13 20:41:20.162245 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162251 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume \"local-storage12-crc\" 2025-10-13 20:41:20.162257 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162262 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume \"local-storage13-crc\" 2025-10-13 20:41:20.162268 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162274 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume \"local-storage14-crc\" 2025-10-13 20:41:20.162279 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162285 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume \"local-storage15-crc\" 2025-10-13 20:41:20.162291 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162296 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume \"local-storage16-crc\" 2025-10-13 20:41:20.162302 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162308 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume \"local-storage17-crc\" 2025-10-13 20:41:20.162388 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162399 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume \"local-storage18-crc\" 2025-10-13 20:41:20.162423 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162429 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume \"local-storage19-crc\" 2025-10-13 20:41:20.162440 | controller | deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.162446 | controller | | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume \"local-storage20-crc\" 2025-10-13 20:41:20.162452 | controller | deleted\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME 2025-10-13 20:41:20.162457 | controller | \ PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION 2025-10-13 20:41:20.162463 | controller | \ AGE\nlocal-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer 2025-10-13 20:41:20.162469 | controller | \ true 5m26s\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash 2025-10-13 20:41:20.162474 | controller | scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ 2025-10-13 20:41:20.162480 | controller | SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.162486 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.162491 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.162497 | controller | oc apply -f -\n++ cat\nserviceaccount/crc-storage unchanged\n++ oc apply -f -\n++ 2025-10-13 20:41:20.162503 | controller | cat\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.162508 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.162514 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' 2025-10-13 20:41:20.162520 | controller | -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node 2025-10-13 20:41:20.162525 | controller | in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.162531 | controller | crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage 2025-10-13 20:41:20.162537 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.162545 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.162551 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.162556 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.162562 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.162568 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.162573 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.162579 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.162585 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.162590 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory 2025-10-13 20:41:20.162596 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.162602 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: 2025-10-13 20:41:20.162607 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.162613 | controller | scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.162619 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.162629 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.162635 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.162641 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.162647 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.162652 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.162666 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.162674 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname 2025-10-13 20:41:20.162682 | controller | scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.162690 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.162698 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.162704 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.162709 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.162715 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.162721 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase 2025-10-13 20:41:20.162726 | controller | | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template 2025-10-13 20:41:20.162732 | controller | '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ 2025-10-13 20:41:20.162738 | controller | NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.162744 | controller | crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage 2025-10-13 20:41:20.162749 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.162755 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.162761 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.162766 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.162772 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.162777 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.162786 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.162792 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.162798 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.162804 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ 2025-10-13 20:41:20.162809 | controller | OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' 2025-10-13 20:41:20.162815 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ 2025-10-13 20:41:20.162821 | controller | STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ 2025-10-13 20:41:20.162826 | controller | head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc 2025-10-13 20:41:20.162842 | controller | ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.162848 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.162854 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.162859 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.162865 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.162871 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.162876 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.162887 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.162893 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.162898 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.162904 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.162910 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.162915 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.162921 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.162927 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.162932 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.162945 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.162954 | controller | -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage 2025-10-13 20:41:20.162961 | controller | created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc 2025-10-13 20:41:20.162969 | controller | created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc 2025-10-13 20:41:20.162977 | controller | created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc 2025-10-13 20:41:20.162983 | controller | created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc 2025-10-13 20:41:20.162988 | controller | created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc 2025-10-13 20:41:20.162994 | controller | created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc 2025-10-13 20:41:20.163000 | controller | created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc 2025-10-13 20:41:20.163005 | controller | created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc 2025-10-13 20:41:20.163011 | controller | created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc 2025-10-13 20:41:20.163017 | controller | created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc 2025-10-13 20:41:20.163022 | controller | created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory 2025-10-13 20:41:20.163028 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.163034 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 2025-10-13 20:41:20.163039 | controller | 20:02:47 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.163048 | controller | ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running 2025-10-13 20:41:20.163054 | controller | tests using configured kubeconfig.\n harness.go:278: Successful connection to 2025-10-13 20:41:20.163060 | controller | cluster at: https://api.crc.testing:6443\n logger.go:42: 20:02:47 | | running 2025-10-13 20:41:20.163065 | controller | command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n 2025-10-13 20:41:20.163071 | controller | \ logger.go:42: 20:02:51 | | netconfig.network.openstack.org/netconfig configured\n 2025-10-13 20:41:20.163077 | controller | \ logger.go:42: 20:02:51 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.163082 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n 2025-10-13 20:41:20.163088 | controller | \ logger.go:42: 20:02:52 | | dnsmasq.network.openstack.org/dnsmasq configured\n 2025-10-13 20:41:20.163094 | controller | \ logger.go:42: 20:02:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.163099 | controller | ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n 2025-10-13 20:41:20.163105 | controller | \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.163111 | controller | \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.163116 | controller | \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.163122 | controller | \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply 2025-10-13 20:41:20.163128 | controller | -f -\n ]\n logger.go:42: 20:02:52 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.163134 | controller | configured\n harness.go:363: running tests\n harness.go:75: going to run test 2025-10-13 20:41:20.163139 | controller | suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: 2025-10-13 20:41:20.163145 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.163151 | controller | has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-galera-3replicas\n=== 2025-10-13 20:41:20.163156 | controller | PAUSE kuttl/harness/ctlplane-galera-3replicas\n=== CONT kuttl/harness/ctlplane-galera-3replicas\n 2025-10-13 20:41:20.163162 | controller | \ logger.go:42: 20:02:52 | ctlplane-galera-3replicas | Skipping creation of user-supplied 2025-10-13 20:41:20.163168 | controller | namespace: openstack-kuttl-tests\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.163173 | controller | | starting test step 1-deploy-galera-3replicas\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.163186 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera_3replicas.yaml\n 2025-10-13 20:41:20.163194 | controller | \ ]\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.163202 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.163210 | controller | for production! For production use at least 5G!\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.163218 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.163223 | controller | for production! For production use at least 5G!\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.163229 | controller | | openstackcontrolplane.core.openstack.org/openstack-galera-3replicas created\n 2025-10-13 20:41:20.163238 | controller | \ logger.go:42: 20:07:10 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.163243 | controller | | test step completed 1-deploy-galera-3replicas\n logger.go:42: 20:07:10 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163252 | controller | | starting test step 2-cleanup\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163258 | controller | | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n 2025-10-13 20:41:20.163264 | controller | \ mysql-db-openstack-galera-0 \\\n mysql-db-openstack-galera-1 \\\n 2025-10-13 20:41:20.163269 | controller | \ mysql-db-openstack-galera-2 \\\n mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.163275 | controller | \\\n mysql-db-openstack-cell1-galera-1 \\\n mysql-db-openstack-cell1-galera-2\n 2025-10-13 20:41:20.163283 | controller | \ oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n 2025-10-13 20:41:20.163289 | controller | \ oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret 2025-10-13 20:41:20.163295 | controller | -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163301 | controller | | persistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n logger.go:42: 2025-10-13 20:41:20.163306 | controller | 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-galera-1\" 2025-10-13 20:41:20.163312 | controller | deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.163318 | controller | \"mysql-db-openstack-galera-2\" deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163323 | controller | | persistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" deleted\n logger.go:42: 2025-10-13 20:41:20.163332 | controller | 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-cell1-galera-1\" 2025-10-13 20:41:20.163337 | controller | deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.163343 | controller | \"mysql-db-openstack-cell1-galera-2\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163349 | controller | | secret \"combined-ca-bundle\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163355 | controller | | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163360 | controller | | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163366 | controller | | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163371 | controller | | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 20:07:26 | 2025-10-13 20:41:20.163377 | controller | ctlplane-galera-3replicas/2-cleanup | secret \"cert-cinder-internal-svc\" deleted\n 2025-10-13 20:41:20.163383 | controller | \ logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-cinder-public-route\" 2025-10-13 20:41:20.163389 | controller | deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret 2025-10-13 20:41:20.163397 | controller | \"cert-cinder-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163415 | controller | | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 20:07:26 2025-10-13 20:41:20.163423 | controller | | ctlplane-galera-3replicas/2-cleanup | secret \"cert-galera-openstack-svc\" deleted\n 2025-10-13 20:41:20.163429 | controller | \ logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-glance-default-internal-svc\" 2025-10-13 20:41:20.163435 | controller | deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret 2025-10-13 20:41:20.163440 | controller | \"cert-glance-default-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163449 | controller | | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 20:07:26 2025-10-13 20:41:20.163463 | controller | | ctlplane-galera-3replicas/2-cleanup | secret \"cert-keystone-internal-svc\" deleted\n 2025-10-13 20:41:20.163471 | controller | \ logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-keystone-public-route\" 2025-10-13 20:41:20.163479 | controller | deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret 2025-10-13 20:41:20.163487 | controller | \"cert-keystone-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163494 | controller | | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163501 | controller | | secret \"cert-memcached-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163507 | controller | | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163512 | controller | | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163518 | controller | | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163524 | controller | | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163529 | controller | | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163535 | controller | | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 2025-10-13 20:41:20.163541 | controller | 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" 2025-10-13 20:41:20.163546 | controller | deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret 2025-10-13 20:41:20.163552 | controller | \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163558 | controller | | secret \"cert-nova-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163563 | controller | | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163569 | controller | | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163575 | controller | | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163580 | controller | | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163586 | controller | | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163592 | controller | | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163597 | controller | | secret \"cert-placement-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163603 | controller | | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163609 | controller | | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163614 | controller | | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163623 | controller | | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163629 | controller | | secret \"cert-swift-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163637 | controller | | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163643 | controller | | secret \"rootca-internal\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163649 | controller | | secret \"rootca-libvirt\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163654 | controller | | secret \"rootca-ovn\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163660 | controller | | secret \"rootca-public\" deleted\n logger.go:42: 20:07:44 | ctlplane-galera-3replicas/2-cleanup 2025-10-13 20:41:20.163666 | controller | | test step completed 2-cleanup\n logger.go:42: 20:07:44 | ctlplane-galera-3replicas 2025-10-13 20:41:20.163672 | controller | | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests 2025-10-13 20:41:20.163677 | controller | finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: 2025-10-13 20:41:20.163683 | controller | \"\"\n--- PASS: kuttl (297.42s)\n --- PASS: kuttl/harness (0.00s)\n --- 2025-10-13 20:41:20.163696 | controller | PASS: kuttl/harness/ctlplane-galera-3replicas (292.40s)\nPASS\nNo resources found\nmake[2]: 2025-10-13 20:41:20.163704 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.163712 | controller | scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.163720 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.163727 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.163733 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.163739 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.163745 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.163750 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.163756 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.163762 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ 2025-10-13 20:41:20.163767 | controller | oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ 2025-10-13 20:41:20.163773 | controller | grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.163779 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.163784 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.163790 | controller | cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.163796 | controller | pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" 2025-10-13 20:41:20.163801 | controller | deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.163807 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.163813 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.163818 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.163824 | controller | pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.163830 | controller | \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.163841 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ cut 2025-10-13 20:41:20.163847 | controller | -d / -f 1\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n+ 2025-10-13 20:41:20.163853 | controller | NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.163858 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.163864 | controller | pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.163870 | controller | \"glance-glance-default-external-api-0\" deleted\n++ oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163878 | controller | --no-headers\n++ awk '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163883 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume 2025-10-13 20:41:20.163889 | controller | \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163895 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume 2025-10-13 20:41:20.163901 | controller | \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163906 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume 2025-10-13 20:41:20.163912 | controller | \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163918 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume 2025-10-13 20:41:20.163923 | controller | \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163929 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume 2025-10-13 20:41:20.163935 | controller | \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163940 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume 2025-10-13 20:41:20.163946 | controller | \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163959 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume 2025-10-13 20:41:20.163967 | controller | \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163975 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume 2025-10-13 20:41:20.163982 | controller | \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.163990 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume 2025-10-13 20:41:20.163996 | controller | \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164002 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume 2025-10-13 20:41:20.164007 | controller | \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164013 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume 2025-10-13 20:41:20.164019 | controller | \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164024 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume 2025-10-13 20:41:20.164030 | controller | \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164036 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume 2025-10-13 20:41:20.164045 | controller | \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164051 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume 2025-10-13 20:41:20.164056 | controller | \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164062 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume 2025-10-13 20:41:20.164068 | controller | \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164074 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume 2025-10-13 20:41:20.164079 | controller | \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164085 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume 2025-10-13 20:41:20.164091 | controller | \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164096 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume 2025-10-13 20:41:20.164102 | controller | \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164108 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume 2025-10-13 20:41:20.164113 | controller | \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.164119 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume 2025-10-13 20:41:20.164125 | controller | \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete 2025-10-13 20:41:20.164130 | controller | sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY 2025-10-13 20:41:20.164136 | controller | \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner 2025-10-13 20:41:20.164141 | controller | \ Delete WaitForFirstConsumer true 5m6s\nstorageclass.storage.k8s.io 2025-10-13 20:41:20.164147 | controller | \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ 2025-10-13 20:41:20.164153 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.164158 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.164164 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.164170 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.164175 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.164181 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.164187 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' 2025-10-13 20:41:20.164192 | controller | -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node 2025-10-13 20:41:20.164198 | controller | in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.164204 | controller | crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage 2025-10-13 20:41:20.164217 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.164229 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.164237 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.164244 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.164255 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.164260 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.164266 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.164272 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.164283 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.164289 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory 2025-10-13 20:41:20.164294 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.164300 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: 2025-10-13 20:41:20.164306 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.164311 | controller | scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.164317 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.164323 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.164328 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.164334 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.164340 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.164346 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.164351 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.164357 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname 2025-10-13 20:41:20.164363 | controller | scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.164368 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.164374 | controller | set -ex\n++ OPERATION=create\n++ oc apply -f -\n++ cat\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.164380 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.164385 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.164394 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.164412 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase 2025-10-13 20:41:20.164421 | controller | | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template 2025-10-13 20:41:20.164426 | controller | '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ 2025-10-13 20:41:20.164432 | controller | NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.164438 | controller | crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage 2025-10-13 20:41:20.164443 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.164449 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.164458 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.164463 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.164469 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.164475 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.164480 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.164486 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.164500 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.164508 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ 2025-10-13 20:41:20.164515 | controller | OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' 2025-10-13 20:41:20.164523 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ 2025-10-13 20:41:20.164531 | controller | STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ 2025-10-13 20:41:20.164538 | controller | head -c-1\n++ tr '\\n' ' '\n++ sed -e 's|node/||'\n+ NODE_NAMES=crc\n+ '[' -z crc 2025-10-13 20:41:20.164543 | controller | ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.164549 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.164555 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.164560 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.164566 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.164572 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.164578 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.164587 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.164592 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.164598 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.164604 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.164609 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.164615 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.164621 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.164626 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.164632 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.164638 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.164643 | controller | -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage 2025-10-13 20:41:20.164649 | controller | created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc 2025-10-13 20:41:20.164655 | controller | created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc 2025-10-13 20:41:20.164660 | controller | created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc 2025-10-13 20:41:20.164669 | controller | created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc 2025-10-13 20:41:20.164675 | controller | created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc 2025-10-13 20:41:20.164680 | controller | created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc 2025-10-13 20:41:20.164686 | controller | created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc 2025-10-13 20:41:20.164691 | controller | created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc 2025-10-13 20:41:20.164697 | controller | created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc 2025-10-13 20:41:20.164703 | controller | created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc 2025-10-13 20:41:20.164708 | controller | created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory 2025-10-13 20:41:20.164714 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.164720 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 2025-10-13 20:41:20.164725 | controller | 20:08:06 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.164731 | controller | ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running 2025-10-13 20:41:20.164737 | controller | tests using configured kubeconfig.\n harness.go:278: Successful connection to 2025-10-13 20:41:20.164742 | controller | cluster at: https://api.crc.testing:6443\n logger.go:42: 20:08:06 | | running 2025-10-13 20:41:20.164758 | controller | command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n 2025-10-13 20:41:20.164766 | controller | \ logger.go:42: 20:08:07 | | netconfig.network.openstack.org/netconfig configured\n 2025-10-13 20:41:20.164774 | controller | \ logger.go:42: 20:08:07 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.164782 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n 2025-10-13 20:41:20.164789 | controller | \ logger.go:42: 20:08:07 | | dnsmasq.network.openstack.org/dnsmasq configured\n 2025-10-13 20:41:20.164795 | controller | \ logger.go:42: 20:08:07 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.164801 | controller | ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n 2025-10-13 20:41:20.164806 | controller | \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.164812 | controller | \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.164818 | controller | \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.164824 | controller | \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply 2025-10-13 20:41:20.164829 | controller | -f -\n ]\n logger.go:42: 20:08:07 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.164835 | controller | configured\n harness.go:363: running tests\n harness.go:75: going to run test 2025-10-13 20:41:20.164841 | controller | suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: 2025-10-13 20:41:20.164846 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.164852 | controller | has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-galera-basic\n=== 2025-10-13 20:41:20.164858 | controller | PAUSE kuttl/harness/ctlplane-galera-basic\n=== CONT kuttl/harness/ctlplane-galera-basic\n 2025-10-13 20:41:20.164867 | controller | \ logger.go:42: 20:08:07 | ctlplane-galera-basic | Skipping creation of user-supplied 2025-10-13 20:41:20.164873 | controller | namespace: openstack-kuttl-tests\n logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera 2025-10-13 20:41:20.164879 | controller | | starting test step 1-deploy-galera\n logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera 2025-10-13 20:41:20.164885 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera.yaml\n 2025-10-13 20:41:20.164893 | controller | \ ]\n logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | 2025-10-13 20:41:20.164899 | controller | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.164905 | controller | for production! For production use at least 5G!\n logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera 2025-10-13 20:41:20.164910 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.164916 | controller | for production! For production use at least 5G!\n logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera 2025-10-13 20:41:20.164922 | controller | | openstackcontrolplane.core.openstack.org/openstack-galera created\n logger.go:42: 2025-10-13 20:41:20.164927 | controller | 20:12:05 | ctlplane-galera-basic/1-deploy-galera | test step completed 1-deploy-galera\n 2025-10-13 20:41:20.164933 | controller | \ logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | starting test step 2025-10-13 20:41:20.164939 | controller | 2-cleanup\n logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | running 2025-10-13 20:41:20.164945 | controller | command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n mysql-db-openstack-galera-0 2025-10-13 20:41:20.164953 | controller | \\\n mysql-db-openstack-cell1-galera-0 \\\n srv-swift-storage-0\n 2025-10-13 20:41:20.164959 | controller | \ oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n 2025-10-13 20:41:20.164964 | controller | \ oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret 2025-10-13 20:41:20.164970 | controller | -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup 2025-10-13 20:41:20.164976 | controller | | persistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n logger.go:42: 2025-10-13 20:41:20.164981 | controller | 20:12:05 | ctlplane-galera-basic/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" 2025-10-13 20:41:20.164987 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"combined-ca-bundle\" 2025-10-13 20:41:20.164993 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-barbican-internal-svc\" 2025-10-13 20:41:20.164999 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-barbican-public-route\" 2025-10-13 20:41:20.165004 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-barbican-public-svc\" 2025-10-13 20:41:20.165017 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ceilometer-internal-svc\" 2025-10-13 20:41:20.165026 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-cinder-internal-svc\" 2025-10-13 20:41:20.165034 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-cinder-public-route\" 2025-10-13 20:41:20.165041 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-cinder-public-svc\" 2025-10-13 20:41:20.165049 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-galera-openstack-cell1-svc\" 2025-10-13 20:41:20.165055 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-galera-openstack-svc\" 2025-10-13 20:41:20.165061 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-glance-default-internal-svc\" 2025-10-13 20:41:20.165070 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-glance-default-public-route\" 2025-10-13 20:41:20.165076 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-glance-default-public-svc\" 2025-10-13 20:41:20.165082 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-keystone-internal-svc\" 2025-10-13 20:41:20.165088 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-keystone-public-route\" 2025-10-13 20:41:20.165094 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-keystone-public-svc\" 2025-10-13 20:41:20.165102 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-kube-state-metrics-svc\" 2025-10-13 20:41:20.165108 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-memcached-svc\" 2025-10-13 20:41:20.165114 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-internal-svc\" 2025-10-13 20:41:20.165120 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-ovndbs\" 2025-10-13 20:41:20.165125 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-public-route\" 2025-10-13 20:41:20.165131 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-public-svc\" 2025-10-13 20:41:20.165137 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-internal-svc\" 2025-10-13 20:41:20.165143 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" 2025-10-13 20:41:20.165149 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" 2025-10-13 20:41:20.165154 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" 2025-10-13 20:41:20.165160 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-public-route\" 2025-10-13 20:41:20.165166 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-public-svc\" 2025-10-13 20:41:20.165172 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovn-metrics\" 2025-10-13 20:41:20.165177 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" 2025-10-13 20:41:20.165183 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" 2025-10-13 20:41:20.165189 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovnnorthd-ovndbs\" 2025-10-13 20:41:20.165195 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-placement-internal-svc\" 2025-10-13 20:41:20.165200 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-placement-public-route\" 2025-10-13 20:41:20.165206 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-placement-public-svc\" 2025-10-13 20:41:20.165212 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-rabbitmq-cell1-svc\" 2025-10-13 20:41:20.165218 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-rabbitmq-svc\" 2025-10-13 20:41:20.165223 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-swift-internal-svc\" 2025-10-13 20:41:20.165229 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-swift-public-route\" 2025-10-13 20:41:20.165245 | controller | deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-swift-public-svc\" 2025-10-13 20:41:20.165253 | controller | deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-internal\" 2025-10-13 20:41:20.165261 | controller | deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-libvirt\" 2025-10-13 20:41:20.165269 | controller | deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-ovn\" 2025-10-13 20:41:20.165277 | controller | deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-public\" 2025-10-13 20:41:20.165282 | controller | deleted\n logger.go:42: 20:12:39 | ctlplane-galera-basic/2-cleanup | test step 2025-10-13 20:41:20.165288 | controller | completed 2-cleanup\n logger.go:42: 20:12:39 | ctlplane-galera-basic | skipping 2025-10-13 20:41:20.165294 | controller | kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n 2025-10-13 20:41:20.165300 | controller | \ harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- 2025-10-13 20:41:20.165306 | controller | PASS: kuttl (272.65s)\n --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-galera-basic 2025-10-13 20:41:20.165311 | controller | (271.12s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.165321 | controller | scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.165327 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.165333 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.165338 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.165344 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.165350 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.165356 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.165361 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.165367 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ 2025-10-13 20:41:20.165373 | controller | oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ 2025-10-13 20:41:20.165379 | controller | grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.165384 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.165390 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.165399 | controller | cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.165420 | controller | pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" 2025-10-13 20:41:20.165426 | controller | deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.165432 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.165437 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.165443 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.165449 | controller | pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.165458 | controller | \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.165464 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.165469 | controller | openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 1\n+ 2025-10-13 20:41:20.165475 | controller | NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.165481 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.165487 | controller | pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.165492 | controller | \"glance-glance-default-external-api-0\" deleted\n++ awk '{print $1}'\n++ oc get 2025-10-13 20:41:20.165498 | controller | pv --selector provisioned-by=crc-devsetup --no-headers\n+ for pv in `oc get pv --selector 2025-10-13 20:41:20.165504 | controller | provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume 2025-10-13 20:41:20.165510 | controller | \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165536 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume 2025-10-13 20:41:20.165545 | controller | \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165553 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume 2025-10-13 20:41:20.165561 | controller | \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165569 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume 2025-10-13 20:41:20.165576 | controller | \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165582 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume 2025-10-13 20:41:20.165588 | controller | \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165593 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume 2025-10-13 20:41:20.165599 | controller | \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165605 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume 2025-10-13 20:41:20.165611 | controller | \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165620 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume 2025-10-13 20:41:20.165626 | controller | \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165632 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume 2025-10-13 20:41:20.165637 | controller | \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165643 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume 2025-10-13 20:41:20.165649 | controller | \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165655 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume 2025-10-13 20:41:20.165660 | controller | \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165666 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume 2025-10-13 20:41:20.165672 | controller | \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165678 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume 2025-10-13 20:41:20.165687 | controller | \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165693 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume 2025-10-13 20:41:20.165698 | controller | \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165704 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume 2025-10-13 20:41:20.165710 | controller | \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165716 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume 2025-10-13 20:41:20.165722 | controller | \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165727 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume 2025-10-13 20:41:20.165733 | controller | \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165739 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume 2025-10-13 20:41:20.165745 | controller | \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165750 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume 2025-10-13 20:41:20.165756 | controller | \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.165762 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume 2025-10-13 20:41:20.165767 | controller | \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete 2025-10-13 20:41:20.165773 | controller | sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY 2025-10-13 20:41:20.165779 | controller | \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner 2025-10-13 20:41:20.165785 | controller | \ Delete WaitForFirstConsumer true 4m41s\nstorageclass.storage.k8s.io 2025-10-13 20:41:20.165796 | controller | \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ 2025-10-13 20:41:20.165810 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.165818 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.165826 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.165838 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.165845 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.165851 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.165857 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' 2025-10-13 20:41:20.165863 | controller | -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node 2025-10-13 20:41:20.165868 | controller | in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.165874 | controller | crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage 2025-10-13 20:41:20.165880 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.165886 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.165891 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.165900 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.165906 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.165912 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.165918 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.165923 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.165929 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.165935 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory 2025-10-13 20:41:20.165940 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.165946 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: 2025-10-13 20:41:20.165952 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.165958 | controller | scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.165966 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.165972 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.165977 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.165983 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.165989 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.165995 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.166000 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.166006 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname 2025-10-13 20:41:20.166012 | controller | scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.166020 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.166025 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.166031 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.166037 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.166043 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.166048 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase 2025-10-13 20:41:20.166054 | controller | | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template 2025-10-13 20:41:20.166060 | controller | '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ 2025-10-13 20:41:20.166076 | controller | NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.166085 | controller | crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage 2025-10-13 20:41:20.166093 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.166101 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.166111 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.166117 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.166123 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.166128 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.166134 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.166140 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.166145 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.166151 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ 2025-10-13 20:41:20.166157 | controller | OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' 2025-10-13 20:41:20.166163 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ 2025-10-13 20:41:20.166168 | controller | STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ 2025-10-13 20:41:20.166174 | controller | head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc 2025-10-13 20:41:20.166180 | controller | ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.166186 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.166191 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.166197 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.166203 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.166208 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.166214 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.166220 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.166226 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.166231 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.166237 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.166243 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.166249 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.166254 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.166260 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.166266 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.166272 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.166277 | controller | -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage 2025-10-13 20:41:20.166283 | controller | created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc 2025-10-13 20:41:20.166289 | controller | created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc 2025-10-13 20:41:20.166294 | controller | created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc 2025-10-13 20:41:20.166303 | controller | created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc 2025-10-13 20:41:20.166308 | controller | created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc 2025-10-13 20:41:20.166314 | controller | created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc 2025-10-13 20:41:20.166320 | controller | created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc 2025-10-13 20:41:20.166326 | controller | created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc 2025-10-13 20:41:20.166331 | controller | created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc 2025-10-13 20:41:20.166348 | controller | created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc 2025-10-13 20:41:20.166357 | controller | created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory 2025-10-13 20:41:20.166365 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.166373 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 2025-10-13 20:41:20.166381 | controller | 20:13:01 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.166386 | controller | ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running 2025-10-13 20:41:20.166395 | controller | tests using configured kubeconfig.\n harness.go:278: Successful connection to 2025-10-13 20:41:20.166413 | controller | cluster at: https://api.crc.testing:6443\n logger.go:42: 20:13:01 | | running 2025-10-13 20:41:20.166422 | controller | command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n 2025-10-13 20:41:20.166428 | controller | \ logger.go:42: 20:13:02 | | netconfig.network.openstack.org/netconfig configured\n 2025-10-13 20:41:20.166434 | controller | \ logger.go:42: 20:13:02 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.166439 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n 2025-10-13 20:41:20.166445 | controller | \ logger.go:42: 20:13:03 | | dnsmasq.network.openstack.org/dnsmasq configured\n 2025-10-13 20:41:20.166451 | controller | \ logger.go:42: 20:13:03 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.166457 | controller | ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n 2025-10-13 20:41:20.166462 | controller | \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.166468 | controller | \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.166474 | controller | \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.166480 | controller | \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply 2025-10-13 20:41:20.166486 | controller | -f -\n ]\n logger.go:42: 20:13:03 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.166491 | controller | configured\n harness.go:363: running tests\n harness.go:75: going to run test 2025-10-13 20:41:20.166497 | controller | suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: 2025-10-13 20:41:20.166503 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.166509 | controller | has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-nodeselectors\n=== 2025-10-13 20:41:20.166514 | controller | PAUSE kuttl/harness/ctlplane-nodeselectors\n=== CONT kuttl/harness/ctlplane-nodeselectors\n 2025-10-13 20:41:20.166524 | controller | \ logger.go:42: 20:13:03 | ctlplane-nodeselectors | Skipping creation of user-supplied 2025-10-13 20:41:20.166530 | controller | namespace: openstack-kuttl-tests\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack 2025-10-13 20:41:20.166535 | controller | | starting test step 1-deploy-openstack\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack 2025-10-13 20:41:20.166541 | controller | | running command: [sh -c oc annotate namespace $NAMESPACE openshift.io/node-selector=\"beta.kubernetes.io/os=linux\"\n 2025-10-13 20:41:20.166547 | controller | \ ]\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack 2025-10-13 20:41:20.166553 | controller | | namespace/openstack-kuttl-tests annotated\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack 2025-10-13 20:41:20.166558 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/nodeselectors/global 2025-10-13 20:41:20.166564 | controller | | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack 2025-10-13 20:41:20.166570 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.166576 | controller | for production! For production use at least 5G!\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack 2025-10-13 20:41:20.166581 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.166587 | controller | for production! For production use at least 5G!\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack 2025-10-13 20:41:20.166593 | controller | | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 2025-10-13 20:41:20.166599 | controller | 20:17:19 | ctlplane-nodeselectors/1-deploy-openstack | test step completed 1-deploy-openstack\n 2025-10-13 20:41:20.166612 | controller | \ logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | starting test step 2-\n 2025-10-13 20:41:20.166620 | controller | \ logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | running command: [sh -c 2025-10-13 20:41:20.166629 | controller | echo \"Checking all pods have expected nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.166636 | controller | node-role.kubernetes.io/worker:\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get 2025-10-13 20:41:20.166644 | controller | pods -n $NAMESPACE -l service!=dnsmasq -o=go-template --template='{{ range .items 2025-10-13 20:41:20.166652 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' 2025-10-13 20:41:20.166659 | controller | | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.166666 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.166673 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.166680 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.166687 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.166693 | controller | \ ]\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all 2025-10-13 20:41:20.166699 | controller | pods have expected nodeselector\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- 2025-10-13 20:41:20.166708 | controller | | running command: [sh -c echo \"Checking all cronjobs have expected nodeselector\"\n 2025-10-13 20:41:20.166714 | controller | \ EXPECTED_NODE_SELECTOR=\"node-role.kubernetes.io/worker:\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc 2025-10-13 20:41:20.166720 | controller | get cronjobs -n $NAMESPACE -o=go-template --template='{{ range .items }}{{ .metadata.name}}: 2025-10-13 20:41:20.166726 | controller | {{ .spec.jobTemplate.spec.template.spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep 2025-10-13 20:41:20.166734 | controller | -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.166740 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.166746 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.166752 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.166757 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.166763 | controller | \ ]\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all 2025-10-13 20:41:20.166771 | controller | cronjobs have expected nodeselector\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- 2025-10-13 20:41:20.166777 | controller | | test step completed 2-\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector 2025-10-13 20:41:20.166783 | controller | | starting test step 3-update-nodeselector\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector 2025-10-13 20:41:20.166788 | controller | | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack 2025-10-13 20:41:20.166794 | controller | --type='json' -p='[{\n \"op\": \"replace\",\n \"path\": \"/spec/nodeSelector\",\n 2025-10-13 20:41:20.166800 | controller | \ \"value\": {\"kubernetes.io/os\":\"linux\"}\n }]'\n ]\n 2025-10-13 20:41:20.166806 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.166811 | controller | patched\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector 2025-10-13 20:41:20.166817 | controller | | test step completed 3-update-nodeselector\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.166823 | controller | | starting test step 4-\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.166829 | controller | | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n 2025-10-13 20:41:20.166834 | controller | \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n 2025-10-13 20:41:20.166840 | controller | \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.166846 | controller | --field-selector=status.phase=Running -o=go-template --template='{{ range .items 2025-10-13 20:41:20.166852 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' 2025-10-13 20:41:20.166857 | controller | | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.166863 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.166869 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.166874 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.166888 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.166896 | controller | \ ]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | Checking all 2025-10-13 20:41:20.166904 | controller | running pods have new nodeselector\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.166912 | controller | | Found 28 pods with bad or missing nodeselector:\n logger.go:42: 20:17:20 | 2025-10-13 20:41:20.166919 | controller | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.166925 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.166931 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.166937 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.166946 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.166951 | controller | 20:17:20 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.166957 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.166963 | controller | | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.166968 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.166974 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.166980 | controller | | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.166985 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.166991 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.166997 | controller | 20:17:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167002 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167008 | controller | | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167014 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167019 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167025 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167031 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167049 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167055 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167061 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.167066 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167072 | controller | 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167078 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167083 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167089 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167095 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167100 | controller | | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167106 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167112 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167117 | controller | | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167123 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167129 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167134 | controller | | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167145 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167151 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167165 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167173 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.167180 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167188 | controller | 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167196 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167202 | controller | | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167208 | controller | \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167213 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167219 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:21 | 2025-10-13 20:41:20.167225 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.167231 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167236 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.167242 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.167248 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.167253 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.167259 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.167265 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.167270 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.167276 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.167282 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167287 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:21 | 2025-10-13 20:41:20.167293 | controller | ctlplane-nodeselectors/4- | Found 28 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.167299 | controller | 20:17:21 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167304 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167310 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167316 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.167321 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167327 | controller | 20:17:21 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167333 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167338 | controller | | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167344 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167354 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167362 | controller | | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167368 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.167374 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167382 | controller | 20:17:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167388 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167399 | controller | | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167420 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167426 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167431 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167437 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167451 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167459 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167467 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.167475 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167482 | controller | 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167490 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167497 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167504 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167510 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167516 | controller | | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167521 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167527 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167533 | controller | | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167539 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167544 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167550 | controller | | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167556 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167561 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167567 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167573 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.167578 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167588 | controller | 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167593 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167599 | controller | | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167605 | controller | \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167610 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167616 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:22 | 2025-10-13 20:41:20.167622 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.167627 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167633 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.167639 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.167644 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.167650 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.167656 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.167661 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.167667 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.167673 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.167678 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:22 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167684 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:23 | 2025-10-13 20:41:20.167690 | controller | ctlplane-nodeselectors/4- | Found 25 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.167695 | controller | 20:17:23 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167701 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167715 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167723 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.167730 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167738 | controller | 20:17:23 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167746 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167755 | controller | | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167761 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167767 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167773 | controller | | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167778 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.167784 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167793 | controller | 20:17:23 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167798 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167804 | controller | | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167810 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.167815 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167821 | controller | 20:17:23 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167827 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167832 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167838 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.167844 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167849 | controller | 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167855 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167861 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167866 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167872 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167878 | controller | | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167883 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167889 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167895 | controller | | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167900 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167906 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167912 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167917 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.167923 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.167928 | controller | 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167934 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167942 | controller | | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.167948 | controller | \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167954 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.167959 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:24 | 2025-10-13 20:41:20.167965 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.167971 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.167984 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.167996 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.168004 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.168011 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.168018 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.168024 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.168030 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.168035 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.168041 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168046 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:24 | 2025-10-13 20:41:20.168052 | controller | ctlplane-nodeselectors/4- | Found 23 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.168058 | controller | 20:17:24 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168064 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168069 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168075 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.168084 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168089 | controller | 20:17:24 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168095 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168101 | controller | | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168106 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168112 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168118 | controller | | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168123 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.168129 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168135 | controller | 20:17:24 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168140 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168146 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168152 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168157 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168163 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168168 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.168174 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168180 | controller | 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168185 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168194 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168200 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168205 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168211 | controller | | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168217 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168222 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168228 | controller | | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168234 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.168247 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168255 | controller | 20:17:24 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168263 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168270 | controller | | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168278 | controller | \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.168285 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168290 | controller | 20:17:24 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168296 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168302 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:25 | 2025-10-13 20:41:20.168307 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.168313 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168319 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.168324 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.168330 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.168336 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.168341 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.168347 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.168356 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.168361 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.168367 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168373 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:25 | 2025-10-13 20:41:20.168378 | controller | ctlplane-nodeselectors/4- | Found 21 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.168384 | controller | 20:17:25 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168390 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168399 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168423 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.168429 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168434 | controller | 20:17:25 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168440 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168446 | controller | | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168452 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168457 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168463 | controller | | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168468 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.168474 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168480 | controller | 20:17:25 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168485 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168491 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168497 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168502 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168508 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168514 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.168519 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168533 | controller | 20:17:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168541 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168549 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168556 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168564 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168570 | controller | | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168576 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.168582 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168587 | controller | 20:17:25 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168593 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168599 | controller | | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168604 | controller | \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.168610 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168616 | controller | 20:17:25 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168625 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168631 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:26 | 2025-10-13 20:41:20.168636 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.168647 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168653 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.168661 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.168667 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.168672 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.168678 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.168683 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.168689 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.168695 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.168703 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168710 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:26 | 2025-10-13 20:41:20.168717 | controller | ctlplane-nodeselectors/4- | Found 20 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.168724 | controller | 20:17:26 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168731 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168738 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168746 | controller | \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.168753 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168760 | controller | 20:17:26 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168767 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168774 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168781 | controller | \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.168788 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168795 | controller | 20:17:26 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168803 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168810 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168818 | controller | \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.168834 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168843 | controller | 20:17:26 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168851 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168858 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168877 | controller | \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.168883 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168888 | controller | 20:17:26 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168894 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168899 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168905 | controller | \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168911 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168916 | controller | | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168922 | controller | \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.168928 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168933 | controller | 20:17:26 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168939 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168945 | controller | | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.168950 | controller | \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.168956 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.168965 | controller | 20:17:26 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168971 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.168977 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:27 | 2025-10-13 20:41:20.168982 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.168988 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.168994 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.168999 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.169005 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.169011 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.169016 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.169022 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.169028 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.169033 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.169039 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:27 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169045 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:28 | 2025-10-13 20:41:20.169050 | controller | ctlplane-nodeselectors/4- | Found 20 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.169056 | controller | 20:17:28 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169062 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169067 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169078 | controller | \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.169083 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169089 | controller | 20:17:28 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169095 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169100 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169113 | controller | \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.169121 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169128 | controller | 20:17:28 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169136 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169141 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169147 | controller | \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.169153 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169158 | controller | 20:17:28 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169164 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169169 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169175 | controller | \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.169181 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169186 | controller | 20:17:28 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169192 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169201 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169207 | controller | \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169212 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169218 | controller | | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169223 | controller | \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.169231 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169237 | controller | 20:17:28 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169243 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169248 | controller | | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169254 | controller | \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.169260 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169265 | controller | 20:17:28 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169271 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169277 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:29 | 2025-10-13 20:41:20.169285 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.169291 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169296 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.169302 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.169308 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.169313 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.169319 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.169325 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.169330 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.169336 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.169341 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169347 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:29 | 2025-10-13 20:41:20.169353 | controller | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.169358 | controller | 20:17:29 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169364 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169379 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169387 | controller | \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.169397 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169426 | controller | 20:17:29 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169433 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169439 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169445 | controller | \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.169450 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169456 | controller | 20:17:29 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169462 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169467 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169473 | controller | \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.169479 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169484 | controller | 20:17:29 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169490 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169496 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169501 | controller | \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.169507 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169516 | controller | 20:17:29 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169525 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169531 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169536 | controller | \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169542 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169548 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169565 | controller | \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.169573 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169579 | controller | 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169584 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169590 | controller | | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169596 | controller | \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169601 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169607 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:30 | 2025-10-13 20:41:20.169613 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.169618 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169624 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.169630 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.169635 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.169641 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.169646 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.169652 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.169658 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.169664 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.169669 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169675 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:30 | 2025-10-13 20:41:20.169688 | controller | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.169696 | controller | 20:17:30 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169704 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169712 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169717 | controller | \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.169723 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169732 | controller | 20:17:30 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169738 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169744 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169749 | controller | \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.169755 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169761 | controller | 20:17:30 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169766 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169772 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169778 | controller | \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.169783 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169789 | controller | 20:17:30 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169795 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169800 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169806 | controller | \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.169812 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169818 | controller | 20:17:30 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169826 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169832 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169838 | controller | \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169843 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169851 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169857 | controller | \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.169863 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.169868 | controller | 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169874 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169880 | controller | | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.169885 | controller | \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169891 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169897 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:31 | 2025-10-13 20:41:20.169903 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.169908 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169914 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.169919 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.169928 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.169933 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.169939 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.169951 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.169959 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.169967 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.169974 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.169979 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:31 | 2025-10-13 20:41:20.169985 | controller | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.169991 | controller | 20:17:31 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.169996 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170002 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170008 | controller | \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.170013 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170019 | controller | 20:17:31 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170025 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170030 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170036 | controller | \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.170042 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170048 | controller | 20:17:31 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170053 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170065 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170070 | controller | \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.170076 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170082 | controller | 20:17:31 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170088 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170093 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170099 | controller | \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.170105 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170111 | controller | 20:17:31 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170118 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170125 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170131 | controller | \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170140 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170146 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170151 | controller | \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.170157 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170163 | controller | 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170169 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170174 | controller | | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170180 | controller | \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170186 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170191 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:32 | 2025-10-13 20:41:20.170197 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.170203 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170209 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.170221 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.170229 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.170237 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.170244 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.170250 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.170256 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.170262 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.170267 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:32 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170273 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:33 | 2025-10-13 20:41:20.170279 | controller | ctlplane-nodeselectors/4- | Found 18 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.170284 | controller | 20:17:33 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170290 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170296 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170302 | controller | \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.170307 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170313 | controller | 20:17:33 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170319 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170325 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170330 | controller | \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.170336 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170345 | controller | 20:17:33 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170351 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170356 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170362 | controller | \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.170368 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170374 | controller | 20:17:33 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170379 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170385 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170391 | controller | \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.170414 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170427 | controller | 20:17:33 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170438 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170444 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170450 | controller | \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170456 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170461 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170467 | controller | \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.170473 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170479 | controller | 20:17:33 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170484 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170490 | controller | | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170496 | controller | \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.170502 | controller | 1 additional commands\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | 2025-10-13 20:41:20.170515 | controller | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n 2025-10-13 20:41:20.170524 | controller | \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n 2025-10-13 20:41:20.170532 | controller | \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.170539 | controller | --field-selector=status.phase=Running -o=go-template --template='{{ range .items 2025-10-13 20:41:20.170546 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' 2025-10-13 20:41:20.170554 | controller | | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.170561 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.170566 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.170572 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.170578 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.170587 | controller | \ ]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | Checking all 2025-10-13 20:41:20.170593 | controller | running pods have new nodeselector\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170599 | controller | | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:34 | 2025-10-13 20:41:20.170604 | controller | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170610 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170616 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170621 | controller | \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.170627 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170633 | controller | 20:17:34 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170639 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170645 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170650 | controller | \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.170656 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170662 | controller | 20:17:34 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170668 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170673 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170679 | controller | \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.170685 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170691 | controller | 20:17:34 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170699 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170705 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170711 | controller | \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.170717 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170722 | controller | 20:17:34 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170728 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170734 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170740 | controller | \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170745 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170751 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170757 | controller | \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.170762 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170768 | controller | 20:17:34 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170774 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170790 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:35 | 2025-10-13 20:41:20.170798 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.170806 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170813 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.170819 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.170824 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.170830 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.170836 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.170842 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.170848 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.170853 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.170859 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170865 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:35 | 2025-10-13 20:41:20.170874 | controller | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.170880 | controller | 20:17:35 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170885 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170891 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170897 | controller | \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.170903 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170908 | controller | 20:17:35 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170914 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170920 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170926 | controller | \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.170931 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170937 | controller | 20:17:35 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170943 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170949 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170954 | controller | \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.170960 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.170966 | controller | 20:17:35 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.170974 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.170980 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.170986 | controller | \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.170994 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171000 | controller | 20:17:35 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171006 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171012 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171018 | controller | \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171023 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171029 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171035 | controller | \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.171041 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171046 | controller | 20:17:35 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171059 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171067 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:36 | 2025-10-13 20:41:20.171075 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.171082 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171088 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.171094 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.171099 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.171105 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.171111 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.171117 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.171122 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.171128 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.171134 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:36 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171140 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:37 | 2025-10-13 20:41:20.171145 | controller | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.171151 | controller | 20:17:37 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171157 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171163 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171169 | controller | \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.171174 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171180 | controller | 20:17:37 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171186 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171191 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171200 | controller | \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.171206 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171212 | controller | 20:17:37 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171218 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171223 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171229 | controller | \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.171235 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171241 | controller | 20:17:37 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171249 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171255 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171261 | controller | \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.171266 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171272 | controller | 20:17:37 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171278 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171284 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171289 | controller | \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171295 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171301 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171307 | controller | \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.171313 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171318 | controller | 20:17:37 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171330 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171338 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:38 | 2025-10-13 20:41:20.171346 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.171354 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171360 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.171365 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.171371 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.171377 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.171382 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.171388 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.171397 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.171427 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.171436 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171448 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:38 | 2025-10-13 20:41:20.171456 | controller | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.171464 | controller | 20:17:38 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171472 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171480 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171488 | controller | \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.171495 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171503 | controller | 20:17:38 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171509 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171515 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171520 | controller | \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.171526 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171532 | controller | 20:17:38 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171538 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171543 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171549 | controller | \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.171555 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171561 | controller | 20:17:38 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171570 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171576 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171581 | controller | \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.171587 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171593 | controller | 20:17:38 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171599 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171604 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171610 | controller | \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171616 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171627 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171633 | controller | \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.171639 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171654 | controller | 20:17:38 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171663 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171675 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:39 | 2025-10-13 20:41:20.171682 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.171690 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171697 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.171702 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.171708 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.171714 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.171719 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.171725 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.171731 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.171737 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.171742 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171749 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:39 | 2025-10-13 20:41:20.171755 | controller | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.171760 | controller | 20:17:39 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171766 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171772 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171778 | controller | \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.171783 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171789 | controller | 20:17:39 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171795 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171801 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171806 | controller | \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.171812 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171818 | controller | 20:17:39 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171824 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171829 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171835 | controller | \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.171841 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171846 | controller | 20:17:39 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171856 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171861 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171867 | controller | \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.171873 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171881 | controller | 20:17:39 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171887 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171892 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171898 | controller | \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171904 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171910 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.171915 | controller | \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.171929 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.171937 | controller | 20:17:39 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171945 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.171952 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:40 | 2025-10-13 20:41:20.171958 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.171964 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.171969 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.171975 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.171981 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.171986 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.171992 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.171998 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.172004 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.172009 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.172015 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:40 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172021 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:41 | 2025-10-13 20:41:20.172027 | controller | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.172032 | controller | 20:17:41 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172038 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172044 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172050 | controller | \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.172055 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172061 | controller | 20:17:41 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172067 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172073 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172081 | controller | \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.172087 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172093 | controller | 20:17:41 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172099 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172105 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172110 | controller | \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.172116 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172122 | controller | 20:17:41 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172131 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172137 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172142 | controller | \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.172148 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172154 | controller | 20:17:41 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172160 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172165 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172171 | controller | \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172177 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172183 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172195 | controller | \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.172204 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172212 | controller | 20:17:41 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172219 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172225 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:42 | 2025-10-13 20:41:20.172231 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.172236 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172242 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.172248 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.172253 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.172259 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.172265 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.172271 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.172276 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.172282 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.172288 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172296 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:42 | 2025-10-13 20:41:20.172302 | controller | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.172310 | controller | 20:17:42 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172316 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172322 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172328 | controller | \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.172333 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172339 | controller | 20:17:42 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172345 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172350 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172356 | controller | \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.172362 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172367 | controller | 20:17:42 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172373 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172379 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172384 | controller | \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.172390 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172414 | controller | 20:17:42 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172430 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172438 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172444 | controller | \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.172450 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172455 | controller | 20:17:42 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172461 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172467 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172472 | controller | \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172478 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172492 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172500 | controller | \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.172507 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172515 | controller | 20:17:42 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172522 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172529 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:43 | 2025-10-13 20:41:20.172539 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.172545 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172551 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.172557 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.172562 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.172568 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.172574 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.172579 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.172585 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.172591 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.172596 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172602 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:43 | 2025-10-13 20:41:20.172608 | controller | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.172613 | controller | 20:17:43 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172619 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172625 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172630 | controller | \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.172636 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172642 | controller | 20:17:43 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172647 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172653 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172659 | controller | \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.172664 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172670 | controller | 20:17:43 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172676 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172681 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172687 | controller | \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.172693 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172698 | controller | 20:17:43 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172707 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172713 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172718 | controller | \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.172724 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172732 | controller | 20:17:43 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172738 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172743 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172749 | controller | \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172762 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172770 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172777 | controller | \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.172784 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172790 | controller | 20:17:43 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172796 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172801 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:44 | 2025-10-13 20:41:20.172807 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.172813 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172818 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.172824 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.172829 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.172835 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.172841 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.172846 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.172852 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.172858 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.172863 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:44 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172869 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:45 | 2025-10-13 20:41:20.172874 | controller | ctlplane-nodeselectors/4- | Found 15 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.172880 | controller | 20:17:45 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172886 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172891 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172897 | controller | \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172903 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172908 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172914 | controller | \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.172920 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172929 | controller | 20:17:45 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172934 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172940 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172946 | controller | \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.172951 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.172957 | controller | 20:17:45 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172962 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172968 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.172974 | controller | \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.172979 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.172990 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173001 | controller | \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173007 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173012 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173018 | controller | \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.173030 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173039 | controller | 20:17:45 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173046 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173053 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:46 | 2025-10-13 20:41:20.173059 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.173068 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173073 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.173079 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.173085 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.173090 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.173096 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.173102 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.173107 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.173113 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.173119 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173124 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:46 | 2025-10-13 20:41:20.173130 | controller | ctlplane-nodeselectors/4- | Found 11 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.173136 | controller | 20:17:46 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173144 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173150 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173156 | controller | \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173161 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173167 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173173 | controller | \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.173178 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173184 | controller | 20:17:46 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173189 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173195 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173201 | controller | \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173206 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173212 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173218 | controller | \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.173223 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173229 | controller | 20:17:46 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173235 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173240 | controller | | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173246 | controller | \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.173252 | controller | 1 additional commands\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | 2025-10-13 20:41:20.173257 | controller | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n 2025-10-13 20:41:20.173263 | controller | \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n 2025-10-13 20:41:20.173271 | controller | \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.173277 | controller | --field-selector=status.phase=Running -o=go-template --template='{{ range .items 2025-10-13 20:41:20.173282 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' 2025-10-13 20:41:20.173294 | controller | | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.173302 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.173310 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.173317 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.173323 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.173328 | controller | \ ]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | Checking all 2025-10-13 20:41:20.173334 | controller | running pods have new nodeselector\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173340 | controller | | Found 11 pods with bad or missing nodeselector:\n logger.go:42: 20:17:47 | 2025-10-13 20:41:20.173348 | controller | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173354 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173360 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173366 | controller | \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173371 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173377 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173383 | controller | \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.173388 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173397 | controller | 20:17:47 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173425 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173434 | controller | | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173441 | controller | \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173449 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173454 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173460 | controller | \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.173466 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173471 | controller | 20:17:47 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173477 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173483 | controller | | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173488 | controller | \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.173494 | controller | 1 additional commands\n logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | 2025-10-13 20:41:20.173500 | controller | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n 2025-10-13 20:41:20.173505 | controller | \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n 2025-10-13 20:41:20.173511 | controller | \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.173517 | controller | --field-selector=status.phase=Running -o=go-template --template='{{ range .items 2025-10-13 20:41:20.173522 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' 2025-10-13 20:41:20.173528 | controller | | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.173534 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.173539 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.173545 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.173554 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.173560 | controller | \ ]\n logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | Checking all 2025-10-13 20:41:20.173566 | controller | running pods have new nodeselector\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173574 | controller | | Found 10 pods with bad or missing nodeselector:\n logger.go:42: 20:17:49 | 2025-10-13 20:41:20.173580 | controller | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173608 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173616 | controller | | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173623 | controller | \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173631 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173638 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173646 | controller | \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.173653 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173661 | controller | 20:17:49 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173668 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173674 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173680 | controller | \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173686 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173691 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173697 | controller | \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.173703 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173708 | controller | 20:17:49 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173714 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173720 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:50 | 2025-10-13 20:41:20.173725 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.173731 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173737 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.173742 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.173748 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.173754 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.173759 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.173765 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.173771 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.173777 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.173782 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173788 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:50 | 2025-10-13 20:41:20.173793 | controller | ctlplane-nodeselectors/4- | Found 9 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.173802 | controller | 20:17:50 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173808 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173814 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173819 | controller | \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.173825 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173831 | controller | 20:17:50 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173839 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173845 | controller | | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173851 | controller | \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173856 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173864 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173870 | controller | \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.173883 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.173890 | controller | 20:17:50 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.173898 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173905 | controller | | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.173912 | controller | \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.173918 | controller | 1 additional commands\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | 2025-10-13 20:41:20.173923 | controller | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n 2025-10-13 20:41:20.173929 | controller | \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n 2025-10-13 20:41:20.173934 | controller | \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.173940 | controller | --field-selector=status.phase=Running -o=go-template --template='{{ range .items 2025-10-13 20:41:20.173946 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' 2025-10-13 20:41:20.173951 | controller | | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.173957 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.173963 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.173968 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.173974 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.173980 | controller | \ ]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | Checking all 2025-10-13 20:41:20.173985 | controller | running pods have new nodeselector\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.173991 | controller | | Found 9 pods with bad or missing nodeselector:\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174000 | controller | | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174006 | controller | \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174014 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174020 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174026 | controller | \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.174031 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174037 | controller | 20:17:51 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174043 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174048 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174054 | controller | \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174060 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174065 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174071 | controller | \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.174077 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174082 | controller | 20:17:51 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174088 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174094 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:52 | 2025-10-13 20:41:20.174099 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.174105 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174110 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.174118 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.174124 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.174130 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.174135 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.174148 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.174156 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.174164 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.174171 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:52 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174176 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:53 | 2025-10-13 20:41:20.174182 | controller | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.174188 | controller | 20:17:53 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174193 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174199 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174205 | controller | \ logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.174210 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174219 | controller | 20:17:53 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174225 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174230 | controller | | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174236 | controller | \ logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174242 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174247 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174253 | controller | \ logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.174259 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174264 | controller | 20:17:53 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174270 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174276 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:54 | 2025-10-13 20:41:20.174281 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.174287 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174293 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.174298 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.174304 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.174310 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.174315 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.174321 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.174327 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.174332 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.174338 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174344 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:54 | 2025-10-13 20:41:20.174349 | controller | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.174355 | controller | 20:17:54 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174361 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174366 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174372 | controller | \ logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.174377 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174383 | controller | 20:17:54 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174389 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174416 | controller | | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174437 | controller | \ logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174454 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174462 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174469 | controller | \ logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.174476 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174482 | controller | 20:17:54 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174488 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174494 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:55 | 2025-10-13 20:41:20.174500 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.174505 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174511 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.174517 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.174522 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.174528 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.174534 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.174539 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.174545 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.174551 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.174556 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174562 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:55 | 2025-10-13 20:41:20.174568 | controller | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.174573 | controller | 20:17:55 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174579 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174585 | controller | | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174590 | controller | \ logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.174596 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174602 | controller | 20:17:55 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174607 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174613 | controller | | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174619 | controller | \ logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174624 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174630 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174636 | controller | \ logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.174641 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174650 | controller | 20:17:55 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174656 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174661 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:17:56 | 2025-10-13 20:41:20.174667 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.174673 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174678 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.174684 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.174690 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.174698 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.174706 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.174719 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.174727 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.174735 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.174743 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:56 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174751 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:57 | 2025-10-13 20:41:20.174757 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.174763 | controller | 20:17:57 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174769 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174775 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174780 | controller | \ logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.174786 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174792 | controller | 20:17:57 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174798 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174803 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174809 | controller | \ logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174815 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174821 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174826 | controller | \ logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.174832 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174838 | controller | 20:17:57 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.174844 | controller | \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.174849 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174855 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.174864 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.174870 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.174876 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.174881 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.174887 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.174893 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.174899 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.174904 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174910 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:58 | 2025-10-13 20:41:20.174916 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.174922 | controller | 20:17:58 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174927 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174933 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174939 | controller | \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.174945 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.174951 | controller | 20:17:58 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174956 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174962 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174968 | controller | \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.174981 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.174989 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.174997 | controller | \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.175005 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175023 | controller | 20:17:58 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.175029 | controller | \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.175035 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175041 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.175047 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.175053 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.175058 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.175064 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.175070 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.175076 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.175084 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.175090 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175096 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:17:59 | 2025-10-13 20:41:20.175102 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.175107 | controller | 20:17:59 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175113 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175119 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175125 | controller | \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.175131 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175136 | controller | 20:17:59 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175142 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175148 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175154 | controller | \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175159 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175165 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175171 | controller | \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.175177 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175183 | controller | 20:17:59 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.175188 | controller | \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.175194 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175200 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.175208 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.175214 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.175220 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.175225 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.175231 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.175237 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.175243 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.175248 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175261 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:00 | 2025-10-13 20:41:20.175270 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.175278 | controller | 20:18:00 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175286 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175296 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175302 | controller | \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.175308 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175314 | controller | 20:18:00 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175320 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175328 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175334 | controller | \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175340 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175346 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175351 | controller | \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.175357 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175363 | controller | 20:18:00 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.175369 | controller | \ logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.175374 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175380 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.175386 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.175395 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.175417 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.175432 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.175440 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.175447 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.175452 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.175458 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175464 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:02 | 2025-10-13 20:41:20.175470 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.175475 | controller | 20:18:02 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175481 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175487 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175493 | controller | \ logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.175498 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175504 | controller | 20:18:02 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175510 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175515 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175524 | controller | \ logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175530 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175536 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175541 | controller | \ logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.175547 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175553 | controller | 20:18:02 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.175566 | controller | \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.175575 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175583 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.175590 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.175598 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.175605 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.175613 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.175620 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.175626 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.175632 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.175638 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175647 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:03 | 2025-10-13 20:41:20.175652 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.175658 | controller | 20:18:03 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175664 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175670 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175675 | controller | \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.175681 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175687 | controller | 20:18:03 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175693 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175698 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175704 | controller | \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175710 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175715 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175721 | controller | \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.175727 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175733 | controller | 20:18:03 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.175741 | controller | \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.175747 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175753 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.175759 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.175764 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.175770 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.175776 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.175781 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.175787 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.175793 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.175799 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175804 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:04 | 2025-10-13 20:41:20.175810 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.175816 | controller | 20:18:04 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175822 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175827 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175840 | controller | \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.175848 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175857 | controller | 20:18:04 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175865 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175872 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175878 | controller | \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175883 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175889 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.175895 | controller | \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.175901 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.175906 | controller | 20:18:04 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.175912 | controller | \ logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.175918 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.175924 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.175933 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.175939 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.175944 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.175958 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.175964 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.175970 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.175976 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.175982 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.175988 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:06 | 2025-10-13 20:41:20.175994 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.175999 | controller | 20:18:06 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176005 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176011 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176017 | controller | \ logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.176022 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176028 | controller | 20:18:06 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176034 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176040 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176045 | controller | \ logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176051 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176057 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176063 | controller | \ logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.176068 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176074 | controller | 20:18:06 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.176080 | controller | \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.176086 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176091 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.176097 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.176103 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.176116 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.176127 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.176136 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.176144 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.176151 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.176156 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176162 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:07 | 2025-10-13 20:41:20.176171 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.176177 | controller | 20:18:07 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176182 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176188 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176194 | controller | \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.176200 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176205 | controller | 20:18:07 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176211 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176217 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176223 | controller | \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176229 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176234 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176243 | controller | \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.176248 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176254 | controller | 20:18:07 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.176260 | controller | \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.176266 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176271 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.176277 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.176283 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.176289 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.176294 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.176300 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.176306 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.176312 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.176317 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176323 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:08 | 2025-10-13 20:41:20.176329 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.176335 | controller | 20:18:08 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176340 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176346 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176352 | controller | \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.176358 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176366 | controller | 20:18:08 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176372 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176377 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176391 | controller | \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176418 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176427 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176432 | controller | \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.176438 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176444 | controller | 20:18:08 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.176450 | controller | \ logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.176456 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176461 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.176467 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.176473 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.176478 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.176484 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.176490 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.176496 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.176501 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.176507 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176513 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:10 | 2025-10-13 20:41:20.176519 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.176524 | controller | 20:18:10 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176530 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176536 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176542 | controller | \ logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.176551 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176557 | controller | 20:18:10 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176562 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176568 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176574 | controller | \ logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176580 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176585 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176594 | controller | \ logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.176600 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176606 | controller | 20:18:10 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.176611 | controller | \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.176617 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176623 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.176629 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.176634 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.176640 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.176646 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.176651 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.176657 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.176663 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.176676 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176684 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:11 | 2025-10-13 20:41:20.176692 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.176700 | controller | 20:18:11 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176707 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176713 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176719 | controller | \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.176725 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176730 | controller | 20:18:11 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176736 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176741 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176747 | controller | \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176753 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176758 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176764 | controller | \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.176770 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176775 | controller | 20:18:11 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.176781 | controller | \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.176787 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176796 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.176802 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.176807 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.176813 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.176821 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.176827 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.176835 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.176841 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.176847 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176852 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:12 | 2025-10-13 20:41:20.176858 | controller | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.176864 | controller | 20:18:12 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176869 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176875 | controller | | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176881 | controller | \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.176886 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176892 | controller | 20:18:12 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176898 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176903 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176909 | controller | \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176915 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.176920 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.176926 | controller | \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.176932 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.176945 | controller | 20:18:12 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.176953 | controller | \ logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.176961 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.176969 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.176976 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.176981 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.176987 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.176993 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.176999 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.177007 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.177013 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.177019 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177024 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:14 | 2025-10-13 20:41:20.177030 | controller | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.177036 | controller | 20:18:14 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177042 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177047 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177053 | controller | \ logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177059 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177064 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177070 | controller | \ logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177076 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177081 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177087 | controller | \ logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.177093 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.177098 | controller | 20:18:14 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.177104 | controller | \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.177110 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177115 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.177121 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.177130 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.177136 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.177142 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.177148 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.177153 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.177159 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.177165 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177170 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:15 | 2025-10-13 20:41:20.177176 | controller | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.177182 | controller | 20:18:15 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177187 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177193 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177209 | controller | \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177217 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177225 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177232 | controller | \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177240 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177246 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177251 | controller | \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.177257 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.177263 | controller | 20:18:15 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.177268 | controller | \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.177274 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177283 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.177288 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.177294 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.177300 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.177306 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.177311 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.177317 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.177323 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.177328 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177334 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:16 | 2025-10-13 20:41:20.177340 | controller | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.177346 | controller | 20:18:16 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177351 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177359 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177365 | controller | \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177371 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177376 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177382 | controller | \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177388 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177416 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177426 | controller | \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.177434 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.177440 | controller | 20:18:16 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.177446 | controller | \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.177452 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177458 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.177464 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.177470 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.177478 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.177484 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.177490 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.177503 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.177511 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.177519 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177527 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:17 | 2025-10-13 20:41:20.177535 | controller | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.177543 | controller | 20:18:17 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177550 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177557 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177563 | controller | \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177568 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177574 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177580 | controller | \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177586 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177592 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177597 | controller | \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.177603 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.177609 | controller | 20:18:17 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.177615 | controller | \ logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.177621 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177645 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.177653 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.177660 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.177667 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.177677 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.177683 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.177690 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.177696 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.177703 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177709 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:19 | 2025-10-13 20:41:20.177715 | controller | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.177722 | controller | 20:18:19 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177728 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177734 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177741 | controller | \ logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177747 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177753 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177760 | controller | \ logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177766 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177773 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177779 | controller | \ logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.177785 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.177792 | controller | 20:18:19 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.177806 | controller | \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.177814 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177822 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.177830 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.177838 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.177844 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.177850 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.177856 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.177866 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.177871 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.177877 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177883 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:20 | 2025-10-13 20:41:20.177889 | controller | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.177895 | controller | 20:18:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177903 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177909 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177915 | controller | \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177920 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177926 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177932 | controller | \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177938 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.177944 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.177949 | controller | \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.177955 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.177961 | controller | 20:18:20 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.177967 | controller | \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.177972 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.177978 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.177984 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.177990 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.177995 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.178001 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.178009 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.178015 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.178021 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.178027 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178032 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:21 | 2025-10-13 20:41:20.178038 | controller | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.178044 | controller | 20:18:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178050 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178056 | controller | | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178061 | controller | \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178067 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178081 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178089 | controller | \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178097 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178109 | controller | | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178117 | controller | \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.178122 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.178128 | controller | 20:18:21 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.178134 | controller | \ logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.178140 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178145 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.178151 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.178157 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.178162 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.178168 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.178174 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.178179 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.178188 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.178194 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178199 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:23 | 2025-10-13 20:41:20.178205 | controller | ctlplane-nodeselectors/4- | Found 5 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.178211 | controller | 20:18:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178216 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178222 | controller | | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178228 | controller | \ logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178234 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178239 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178245 | controller | \ logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.178251 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.178256 | controller | 20:18:23 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178262 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178267 | controller | | command failure, skipping 1 additional commands\n logger.go:42: 20:18:24 | 2025-10-13 20:41:20.178273 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running 2025-10-13 20:41:20.178279 | controller | pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178284 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.178290 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.178296 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.178304 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.178310 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.178316 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.178321 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.178327 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.178333 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178338 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:24 | 2025-10-13 20:41:20.178352 | controller | ctlplane-nodeselectors/4- | Found 3 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.178360 | controller | 20:18:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178368 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178375 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178383 | controller | \ logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178389 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178397 | controller | | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178415 | controller | \ logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.178424 | controller | 1 additional commands\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | 2025-10-13 20:41:20.178430 | controller | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n 2025-10-13 20:41:20.178435 | controller | \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n 2025-10-13 20:41:20.178441 | controller | \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.178446 | controller | --field-selector=status.phase=Running -o=go-template --template='{{ range .items 2025-10-13 20:41:20.178452 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' 2025-10-13 20:41:20.178458 | controller | | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n 2025-10-13 20:41:20.178463 | controller | \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" 2025-10-13 20:41:20.178469 | controller | | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo 2025-10-13 20:41:20.178478 | controller | \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n 2025-10-13 20:41:20.178484 | controller | \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n 2025-10-13 20:41:20.178490 | controller | \ ]\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | Checking all 2025-10-13 20:41:20.178495 | controller | running pods have new nodeselector\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178501 | controller | | Found 3 pods with bad or missing nodeselector:\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178507 | controller | | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178512 | controller | \ logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178518 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178524 | controller | | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178533 | controller | \ logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.178538 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.178544 | controller | 20:18:25 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.178550 | controller | \ logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.178556 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178561 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.178567 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.178573 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.178579 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.178584 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.178590 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.178596 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.178602 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.178607 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178613 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:27 | 2025-10-13 20:41:20.178619 | controller | ctlplane-nodeselectors/4- | Found 2 pods with bad or missing nodeselector:\n logger.go:42: 2025-10-13 20:41:20.178625 | controller | 20:18:27 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178638 | controller | node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178647 | controller | | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n 2025-10-13 20:41:20.178654 | controller | \ logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.178662 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 2025-10-13 20:41:20.178670 | controller | 20:18:27 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n 2025-10-13 20:41:20.178677 | controller | \ logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.178683 | controller | echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux 2025-10-13 20:41:20.178689 | controller | kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n 2025-10-13 20:41:20.178694 | controller | $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template 2025-10-13 20:41:20.178700 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ 2025-10-13 20:41:20.178706 | controller | end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e 2025-10-13 20:41:20.178712 | controller | '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.178718 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.178723 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with 2025-10-13 20:41:20.178729 | controller | bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.178735 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178744 | controller | | Checking all running pods have new nodeselector\n logger.go:42: 20:18:28 | 2025-10-13 20:41:20.178753 | controller | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all cronjobs 2025-10-13 20:41:20.178761 | controller | have expected nodeselector\"\n EXPECTED_NODE_SELECTOR=\"kubernetes.io/os:linux\"\n 2025-10-13 20:41:20.178766 | controller | \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get cronjobs -n $NAMESPACE -o=go-template 2025-10-13 20:41:20.178772 | controller | --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.jobTemplate.spec.template.spec.nodeSelector 2025-10-13 20:41:20.178778 | controller | }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' 2025-10-13 20:41:20.178784 | controller | | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo 2025-10-13 20:41:20.178790 | controller | -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT 2025-10-13 20:41:20.178795 | controller | -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs 2025-10-13 20:41:20.178801 | controller | with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n 2025-10-13 20:41:20.178807 | controller | \ exit 1\n fi\n ]\n logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- 2025-10-13 20:41:20.178812 | controller | | Checking all cronjobs have expected nodeselector\n logger.go:42: 20:18:28 | 2025-10-13 20:41:20.178818 | controller | ctlplane-nodeselectors/4- | test step completed 4-\n logger.go:42: 20:18:28 | 2025-10-13 20:41:20.178824 | controller | ctlplane-nodeselectors/5-cleanup | starting test step 5-cleanup\n logger.go:42: 2025-10-13 20:41:20.178829 | controller | 20:18:29 | ctlplane-nodeselectors/5-cleanup | running command: [sh -c oc annotate 2025-10-13 20:41:20.178835 | controller | namespace $NAMESPACE openshift.io/node-selector-\n oc delete --ignore-not-found=true 2025-10-13 20:41:20.178841 | controller | -n $NAMESPACE pvc \\\n srv-swift-storage-0\n oc delete secret --ignore-not-found=true 2025-10-13 20:41:20.178847 | controller | combined-ca-bundle -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n 2025-10-13 20:41:20.178852 | controller | \ oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 2025-10-13 20:41:20.178858 | controller | 20:18:29 | ctlplane-nodeselectors/5-cleanup | namespace/openstack-kuttl-tests annotated\n 2025-10-13 20:41:20.178864 | controller | \ logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret \"combined-ca-bundle\" 2025-10-13 20:41:20.178870 | controller | deleted\n logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret 2025-10-13 20:41:20.178875 | controller | \"cert-barbican-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.178881 | controller | | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.178887 | controller | | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.178892 | controller | | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 20:18:30 | 2025-10-13 20:41:20.178898 | controller | ctlplane-nodeselectors/5-cleanup | secret \"cert-cinder-internal-svc\" deleted\n 2025-10-13 20:41:20.178911 | controller | \ logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-cinder-public-route\" 2025-10-13 20:41:20.178920 | controller | deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret 2025-10-13 20:41:20.178928 | controller | \"cert-cinder-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.178935 | controller | | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 20:18:30 2025-10-13 20:41:20.178943 | controller | | ctlplane-nodeselectors/5-cleanup | secret \"cert-galera-openstack-svc\" deleted\n 2025-10-13 20:41:20.178949 | controller | \ logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-glance-default-internal-svc\" 2025-10-13 20:41:20.178961 | controller | deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret 2025-10-13 20:41:20.178967 | controller | \"cert-glance-default-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.178973 | controller | | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 20:18:30 2025-10-13 20:41:20.178979 | controller | | ctlplane-nodeselectors/5-cleanup | secret \"cert-keystone-internal-svc\" deleted\n 2025-10-13 20:41:20.178984 | controller | \ logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-keystone-public-route\" 2025-10-13 20:41:20.178990 | controller | deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret 2025-10-13 20:41:20.178996 | controller | \"cert-keystone-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179002 | controller | | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179007 | controller | | secret \"cert-memcached-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179013 | controller | | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179019 | controller | | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179025 | controller | | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179030 | controller | | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179036 | controller | | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179042 | controller | | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 2025-10-13 20:41:20.179050 | controller | 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" 2025-10-13 20:41:20.179056 | controller | deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret 2025-10-13 20:41:20.179062 | controller | \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179068 | controller | | secret \"cert-nova-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179074 | controller | | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179079 | controller | | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179085 | controller | | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179091 | controller | | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179096 | controller | | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179102 | controller | | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179108 | controller | | secret \"cert-placement-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179114 | controller | | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179120 | controller | | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179125 | controller | | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179131 | controller | | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179139 | controller | | secret \"cert-swift-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179145 | controller | | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179159 | controller | | secret \"rootca-internal\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179167 | controller | | secret \"rootca-libvirt\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179175 | controller | | secret \"rootca-ovn\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179183 | controller | | secret \"rootca-public\" deleted\n logger.go:42: 20:19:03 | ctlplane-nodeselectors/5-cleanup 2025-10-13 20:41:20.179191 | controller | | test step completed 5-cleanup\n logger.go:42: 20:19:03 | ctlplane-nodeselectors 2025-10-13 20:41:20.179197 | controller | | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests 2025-10-13 20:41:20.179202 | controller | finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: 2025-10-13 20:41:20.179208 | controller | \"\"\n--- PASS: kuttl (361.27s)\n --- PASS: kuttl/harness (0.00s)\n --- 2025-10-13 20:41:20.179214 | controller | PASS: kuttl/harness/ctlplane-nodeselectors (359.74s)\nPASS\nNo resources found\nmake[2]: 2025-10-13 20:41:20.179220 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.179225 | controller | scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.179231 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.179237 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.179243 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.179248 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.179254 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.179260 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.179269 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.179274 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ 2025-10-13 20:41:20.179280 | controller | oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ grep Bound\n++ 2025-10-13 20:41:20.179286 | controller | awk '{print $6}'\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179292 | controller | --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.179297 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ 2025-10-13 20:41:20.179303 | controller | cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.179320 | controller | pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" 2025-10-13 20:41:20.179326 | controller | deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.179331 | controller | | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ 2025-10-13 20:41:20.179337 | controller | cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ 2025-10-13 20:41:20.179343 | controller | cut -d / -f 2\n+ NAME=mysql-db-openstack-cell1-galera-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.179352 | controller | pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.179357 | controller | \"mysql-db-openstack-cell1-galera-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.179363 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.179369 | controller | openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ 2025-10-13 20:41:20.179375 | controller | NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ 2025-10-13 20:41:20.179380 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.179386 | controller | pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.179395 | controller | \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.179414 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.179422 | controller | openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 1\n+ 2025-10-13 20:41:20.179428 | controller | NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ 2025-10-13 20:41:20.179434 | controller | cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests 2025-10-13 20:41:20.179440 | controller | pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.179454 | controller | \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector 2025-10-13 20:41:20.179462 | controller | provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo 2025-10-13 20:41:20.179470 | controller | openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ 2025-10-13 20:41:20.179478 | controller | echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ 2025-10-13 20:41:20.179486 | controller | oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim 2025-10-13 20:41:20.179493 | controller | \"mysql-db-openstack-galera-0\" deleted\n++ oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179500 | controller | --no-headers\n++ awk '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179508 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume 2025-10-13 20:41:20.179515 | controller | \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179522 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume 2025-10-13 20:41:20.179528 | controller | \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179534 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume 2025-10-13 20:41:20.179540 | controller | \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179546 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume 2025-10-13 20:41:20.179552 | controller | \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179557 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume 2025-10-13 20:41:20.179563 | controller | \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179569 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume 2025-10-13 20:41:20.179575 | controller | \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179580 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume 2025-10-13 20:41:20.179589 | controller | \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179595 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume 2025-10-13 20:41:20.179601 | controller | \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179607 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume 2025-10-13 20:41:20.179613 | controller | \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179618 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume 2025-10-13 20:41:20.179624 | controller | \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179630 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume 2025-10-13 20:41:20.179636 | controller | \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179641 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume 2025-10-13 20:41:20.179647 | controller | \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179653 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume 2025-10-13 20:41:20.179659 | controller | \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179664 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume 2025-10-13 20:41:20.179670 | controller | \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179679 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume 2025-10-13 20:41:20.179685 | controller | \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179691 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume 2025-10-13 20:41:20.179696 | controller | \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179702 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume 2025-10-13 20:41:20.179708 | controller | \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179714 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume 2025-10-13 20:41:20.179727 | controller | \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179735 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume 2025-10-13 20:41:20.179746 | controller | \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup 2025-10-13 20:41:20.179754 | controller | --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume 2025-10-13 20:41:20.179762 | controller | \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete 2025-10-13 20:41:20.179768 | controller | sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY 2025-10-13 20:41:20.179774 | controller | \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner 2025-10-13 20:41:20.179780 | controller | \ Delete WaitForFirstConsumer true 6m10s\nstorageclass.storage.k8s.io 2025-10-13 20:41:20.179785 | controller | \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ 2025-10-13 20:41:20.179791 | controller | cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.179800 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.179806 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.179812 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.179818 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.179823 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.179829 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' 2025-10-13 20:41:20.179835 | controller | -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node 2025-10-13 20:41:20.179841 | controller | in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.179846 | controller | crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage 2025-10-13 20:41:20.179852 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.179858 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.179864 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.179869 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.179875 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.179881 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.179886 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.179892 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.179898 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.179904 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory 2025-10-13 20:41:20.179909 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.179915 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: 2025-10-13 20:41:20.179921 | controller | Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.179927 | controller | scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash 2025-10-13 20:41:20.179932 | controller | scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.179938 | controller | ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ 2025-10-13 20:41:20.179944 | controller | '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc 2025-10-13 20:41:20.179950 | controller | apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage 2025-10-13 20:41:20.179955 | controller | unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io 2025-10-13 20:41:20.179961 | controller | crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage 2025-10-13 20:41:20.179967 | controller | \ Active\noc project crc-storage\nAlready on project \"crc-storage\" 2025-10-13 20:41:20.179973 | controller | on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname 2025-10-13 20:41:20.179986 | controller | scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ 2025-10-13 20:41:20.179997 | controller | . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ 2025-10-13 20:41:20.180006 | controller | set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ 2025-10-13 20:41:20.180014 | controller | cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.180020 | controller | -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply 2025-10-13 20:41:20.180026 | controller | -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ 2025-10-13 20:41:20.180032 | controller | PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase 2025-10-13 20:41:20.180038 | controller | | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template 2025-10-13 20:41:20.180043 | controller | '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ 2025-10-13 20:41:20.180049 | controller | NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.180055 | controller | crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage 2025-10-13 20:41:20.180064 | controller | job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ 2025-10-13 20:41:20.180070 | controller | cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": 2025-10-13 20:41:20.180075 | controller | privileged (container \"storage\" must not set securityContext.privileged=true), 2025-10-13 20:41:20.180081 | controller | allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), 2025-10-13 20:41:20.180087 | controller | unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), 2025-10-13 20:41:20.180093 | controller | restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), 2025-10-13 20:41:20.180098 | controller | runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.180104 | controller | runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc 2025-10-13 20:41:20.180110 | controller | created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.180116 | controller | --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ 2025-10-13 20:41:20.180121 | controller | OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' 2025-10-13 20:41:20.180127 | controller | ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ 2025-10-13 20:41:20.180133 | controller | STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ 2025-10-13 20:41:20.180139 | controller | head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc 2025-10-13 20:41:20.180144 | controller | ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.180150 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.180156 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.180162 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.180167 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.180173 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.180179 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.180184 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.180190 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.180199 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.180205 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.180211 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.180216 | controller | -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' 2025-10-13 20:41:20.180222 | controller | -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ 2025-10-13 20:41:20.180228 | controller | for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq 2025-10-13 20:41:20.180233 | controller | -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ 2025-10-13 20:41:20.180239 | controller | cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed 2025-10-13 20:41:20.180245 | controller | -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage 2025-10-13 20:41:20.180258 | controller | created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc 2025-10-13 20:41:20.180266 | controller | created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc 2025-10-13 20:41:20.180274 | controller | created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc 2025-10-13 20:41:20.180282 | controller | created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc 2025-10-13 20:41:20.180289 | controller | created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc 2025-10-13 20:41:20.180295 | controller | created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc 2025-10-13 20:41:20.180305 | controller | created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc 2025-10-13 20:41:20.180312 | controller | created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc 2025-10-13 20:41:20.180319 | controller | created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc 2025-10-13 20:41:20.180326 | controller | created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc 2025-10-13 20:41:20.180332 | controller | created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory 2025-10-13 20:41:20.180340 | controller | '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving 2025-10-13 20:41:20.180347 | controller | directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 2025-10-13 20:41:20.180354 | controller | 20:19:25 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.180362 | controller | ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running 2025-10-13 20:41:20.180369 | controller | tests using configured kubeconfig.\n harness.go:278: Successful connection to 2025-10-13 20:41:20.180377 | controller | cluster at: https://api.crc.testing:6443\n logger.go:42: 20:19:25 | | running 2025-10-13 20:41:20.180384 | controller | command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n 2025-10-13 20:41:20.180391 | controller | \ logger.go:42: 20:19:26 | | netconfig.network.openstack.org/netconfig configured\n 2025-10-13 20:41:20.180420 | controller | \ logger.go:42: 20:19:26 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.180432 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n 2025-10-13 20:41:20.180439 | controller | \ logger.go:42: 20:19:26 | | dnsmasq.network.openstack.org/dnsmasq configured\n 2025-10-13 20:41:20.180452 | controller | \ logger.go:42: 20:19:26 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.180460 | controller | ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n 2025-10-13 20:41:20.180467 | controller | \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.180474 | controller | \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.180482 | controller | \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub 2025-10-13 20:41:20.180489 | controller | \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply 2025-10-13 20:41:20.180496 | controller | -f -\n ]\n logger.go:42: 20:19:27 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.180503 | controller | configured\n harness.go:363: running tests\n harness.go:75: going to run test 2025-10-13 20:41:20.180511 | controller | suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: 2025-10-13 20:41:20.180518 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.180525 | controller | has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-tls-cert-rotation\n=== 2025-10-13 20:41:20.180532 | controller | PAUSE kuttl/harness/ctlplane-tls-cert-rotation\n=== CONT kuttl/harness/ctlplane-tls-cert-rotation\n 2025-10-13 20:41:20.180539 | controller | \ logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation | Skipping creation of user-supplied 2025-10-13 20:41:20.180546 | controller | namespace: openstack-kuttl-tests\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180554 | controller | | starting test step 0-deploy-openstack-tls-ingress-only\n logger.go:42: 20:19:27 2025-10-13 20:41:20.180560 | controller | | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: 2025-10-13 20:41:20.180566 | controller | [sh -c oc kustomize ../../../../config/samples/tls/tls_ingress | oc apply -n $NAMESPACE 2025-10-13 20:41:20.180572 | controller | -f -\n ]\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180590 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.180599 | controller | for production! For production use at least 5G!\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180607 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.180615 | controller | for production! For production use at least 5G!\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180622 | controller | | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 2025-10-13 20:41:20.180630 | controller | 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running 2025-10-13 20:41:20.180636 | controller | command: [sh -c echo \"Waiting for OpenStack control plane to be ready...\"\n oc 2025-10-13 20:41:20.180642 | controller | wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l 2025-10-13 20:41:20.180647 | controller | core.openstack.org/openstackcontrolplane\n ]\n logger.go:42: 20:19:27 2025-10-13 20:41:20.180653 | controller | | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Waiting for OpenStack 2025-10-13 20:41:20.180659 | controller | control plane to be ready...\n logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180665 | controller | | openstackcontrolplane.core.openstack.org/openstack condition met\n logger.go:42: 2025-10-13 20:41:20.180670 | controller | 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running 2025-10-13 20:41:20.180676 | controller | command: [sh -c echo \"Fail if internal https endpoints are registered\"\n oc 2025-10-13 20:41:20.180686 | controller | exec -i openstackclient -n $NAMESPACE -- bash -c \"openstack endpoint list --interface 2025-10-13 20:41:20.180692 | controller | internal -f value -c URL\" | grep 'https:' && exit 1\n exit 0\n ]\n 2025-10-13 20:41:20.180697 | controller | \ logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180703 | controller | | Fail if internal https endpoints are registered\n logger.go:42: 20:23:20 | 2025-10-13 20:41:20.180709 | controller | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: 2025-10-13 20:41:20.180715 | controller | [sh -c echo \"check ovn sb internalDbAddress use tcp\"\n oc get -n $NAMESPACE 2025-10-13 20:41:20.180720 | controller | OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q tcp\n 2025-10-13 20:41:20.180726 | controller | \ ]\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180732 | controller | | check ovn sb internalDbAddress use tcp\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180738 | controller | | running command: [sh -c echo \"check ovn sb DB connection use tcp\"\n oc 2025-10-13 20:41:20.180743 | controller | exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c \"ovn-sbctl --no-leader-only 2025-10-13 20:41:20.180749 | controller | get-connection | grep -q ptcp\"\n ]\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180755 | controller | | check ovn sb DB connection use tcp\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180761 | controller | | Defaulted container \"ovsdbserver-sb\" out of: ovsdbserver-sb, openstack-network-exporter\n 2025-10-13 20:41:20.180766 | controller | \ logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180772 | controller | | running command: [sh -c echo \"check nova transport_url use tcp\"\n oc 2025-10-13 20:41:20.180778 | controller | exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c \"grep transport_url 2025-10-13 20:41:20.180787 | controller | /etc/nova/nova.conf.d/01-nova.conf | grep -q 'ssl=0'\"\n ]\n logger.go:42: 2025-10-13 20:41:20.180793 | controller | 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check 2025-10-13 20:41:20.180798 | controller | nova transport_url use tcp\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180804 | controller | | running command: [sh -c echo \"check neutron ovn_sb_connection url tcp address\"\n 2025-10-13 20:41:20.180810 | controller | \ oc exec -i deployment/neutron -n $NAMESPACE -- bash -c \"grep ovn_sb_connection 2025-10-13 20:41:20.180816 | controller | /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp\"\n ]\n logger.go:42: 2025-10-13 20:41:20.180822 | controller | 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check 2025-10-13 20:41:20.180827 | controller | neutron ovn_sb_connection url tcp address\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180833 | controller | | Defaulted container \"neutron-api\" out of: neutron-api, neutron-httpd\n logger.go:42: 2025-10-13 20:41:20.180846 | controller | 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running 2025-10-13 20:41:20.180855 | controller | command: [sh -c echo \"Waiting for OpenStack control plane to be ready...\"\n oc 2025-10-13 20:41:20.180863 | controller | wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l 2025-10-13 20:41:20.180870 | controller | core.openstack.org/openstackcontrolplane\n ]\n logger.go:42: 20:23:22 2025-10-13 20:41:20.180878 | controller | | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Waiting for OpenStack 2025-10-13 20:41:20.180884 | controller | control plane to be ready...\n logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180893 | controller | | openstackcontrolplane.core.openstack.org/openstack condition met\n logger.go:42: 2025-10-13 20:41:20.180899 | controller | 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running 2025-10-13 20:41:20.180905 | controller | command: [sh -c echo \"Fail if internal https endpoints are registered\"\n oc 2025-10-13 20:41:20.180911 | controller | exec -i openstackclient -n $NAMESPACE -- bash -c \"openstack endpoint list --interface 2025-10-13 20:41:20.180917 | controller | internal -f value -c URL\" | grep 'https:' && exit 1\n exit 0\n ]\n 2025-10-13 20:41:20.180922 | controller | \ logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180928 | controller | | Fail if internal https endpoints are registered\n logger.go:42: 20:23:24 | 2025-10-13 20:41:20.180934 | controller | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: 2025-10-13 20:41:20.180939 | controller | [sh -c echo \"check ovn sb internalDbAddress use tcp\"\n oc get -n $NAMESPACE 2025-10-13 20:41:20.180945 | controller | OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q tcp\n 2025-10-13 20:41:20.180951 | controller | \ ]\n logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180957 | controller | | check ovn sb internalDbAddress use tcp\n logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180963 | controller | | running command: [sh -c echo \"check ovn sb DB connection use tcp\"\n oc 2025-10-13 20:41:20.180968 | controller | exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c \"ovn-sbctl --no-leader-only 2025-10-13 20:41:20.180974 | controller | get-connection | grep -q ptcp\"\n ]\n logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180980 | controller | | check ovn sb DB connection use tcp\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.180986 | controller | | Defaulted container \"ovsdbserver-sb\" out of: ovsdbserver-sb, openstack-network-exporter\n 2025-10-13 20:41:20.180995 | controller | \ logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.181000 | controller | | running command: [sh -c echo \"check nova transport_url use tcp\"\n oc 2025-10-13 20:41:20.181006 | controller | exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c \"grep transport_url 2025-10-13 20:41:20.181012 | controller | /etc/nova/nova.conf.d/01-nova.conf | grep -q 'ssl=0'\"\n ]\n logger.go:42: 2025-10-13 20:41:20.181018 | controller | 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check 2025-10-13 20:41:20.181024 | controller | nova transport_url use tcp\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.181029 | controller | | running command: [sh -c echo \"check neutron ovn_sb_connection url tcp address\"\n 2025-10-13 20:41:20.181035 | controller | \ oc exec -i deployment/neutron -n $NAMESPACE -- bash -c \"grep ovn_sb_connection 2025-10-13 20:41:20.181041 | controller | /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp\"\n ]\n logger.go:42: 2025-10-13 20:41:20.181047 | controller | 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check 2025-10-13 20:41:20.181053 | controller | neutron ovn_sb_connection url tcp address\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.181058 | controller | | Defaulted container \"neutron-api\" out of: neutron-api, neutron-httpd\n logger.go:42: 2025-10-13 20:41:20.181066 | controller | 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | test 2025-10-13 20:41:20.181072 | controller | step completed 0-deploy-openstack-tls-ingress-only\n logger.go:42: 20:23:25 | 2025-10-13 20:41:20.181080 | controller | ctlplane-tls-cert-rotation/1-deploy-openstack | starting test step 1-deploy-openstack\n 2025-10-13 20:41:20.181086 | controller | \ logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/1-deploy-openstack | running 2025-10-13 20:41:20.181094 | controller | command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.181100 | controller | | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 20:23:26 | ctlplane-tls-cert-rotation/1-deploy-openstack 2025-10-13 20:41:20.181113 | controller | | openstackcontrolplane.core.openstack.org/openstack configured\n logger.go:42: 2025-10-13 20:41:20.181122 | controller | 20:26:10 | ctlplane-tls-cert-rotation/1-deploy-openstack | test step completed 1-deploy-openstack\n 2025-10-13 20:41:20.181130 | controller | \ logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181138 | controller | starting test step 2-get-endpoints-certs\n logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181145 | controller | | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc 2025-10-13 20:41:20.181151 | controller | exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.181157 | controller | > /tmp/endpoint_fingerprints_before\n ]\n logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181163 | controller | | Get fingerprints of all service certs\n logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181168 | controller | | ++ openstack endpoint list -c URL -f value\n logger.go:42: 20:26:11 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181174 | controller | | ++ awk -F/ '{print $3}'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181180 | controller | | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.181186 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181192 | controller | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 2025-10-13 20:41:20.181197 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo nova-internal.openstack-kuttl-tests.svc:8774\n 2025-10-13 20:41:20.181203 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181209 | controller | + host_port=nova-internal.openstack-kuttl-tests.svc:8774\n logger.go:42: 20:26:13 2025-10-13 20:41:20.181215 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! nova-internal.openstack-kuttl-tests.svc:8774 2025-10-13 20:41:20.181220 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181226 | controller | | ++ openssl s_client -connect nova-internal.openstack-kuttl-tests.svc:8774\n logger.go:42: 2025-10-13 20:41:20.181242 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.181248 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181254 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181259 | controller | | + finger_print=69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE\n logger.go:42: 2025-10-13 20:41:20.181265 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE 2025-10-13 20:41:20.181271 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181277 | controller | | + echo 'nova-internal.openstack-kuttl-tests.svc:8774 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE'\n 2025-10-13 20:41:20.181283 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181291 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.181297 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181303 | controller | ++ echo glance-default-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181309 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.181314 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181320 | controller | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181326 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! glance-default-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.181332 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181337 | controller | | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing:443\n 2025-10-13 20:41:20.181343 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181349 | controller | ++ openssl s_client -connect glance-default-public-openstack-kuttl-tests.apps-crc.testing:443\n 2025-10-13 20:41:20.181355 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181360 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | 2025-10-13 20:41:20.181366 | controller | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n 2025-10-13 20:41:20.181379 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181387 | controller | + finger_print=3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB\n logger.go:42: 2025-10-13 20:41:20.181398 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB 2025-10-13 20:41:20.181423 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181430 | controller | | + echo 'glance-default-public-openstack-kuttl-tests.apps-crc.testing:443 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB'\n 2025-10-13 20:41:20.181439 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181445 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.181451 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181456 | controller | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 2025-10-13 20:41:20.181462 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo swift-public-openstack-kuttl-tests.apps-crc.testing\n 2025-10-13 20:41:20.181468 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181473 | controller | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181479 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! swift-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.181485 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181491 | controller | | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.181496 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.181502 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181508 | controller | | ++ openssl s_client -connect swift-public-openstack-kuttl-tests.apps-crc.testing:443\n 2025-10-13 20:41:20.181516 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181525 | controller | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181531 | controller | | + finger_print=FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A\n logger.go:42: 2025-10-13 20:41:20.181536 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A 2025-10-13 20:41:20.181542 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181548 | controller | | + echo 'swift-public-openstack-kuttl-tests.apps-crc.testing:443 FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A'\n 2025-10-13 20:41:20.181554 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181559 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.181565 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181571 | controller | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 2025-10-13 20:41:20.181576 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo glance-default-internal.openstack-kuttl-tests.svc:9292\n 2025-10-13 20:41:20.181582 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181588 | controller | + host_port=glance-default-internal.openstack-kuttl-tests.svc:9292\n logger.go:42: 2025-10-13 20:41:20.181593 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! glance-default-internal.openstack-kuttl-tests.svc:9292 2025-10-13 20:41:20.181599 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181605 | controller | | ++ openssl s_client -connect glance-default-internal.openstack-kuttl-tests.svc:9292\n 2025-10-13 20:41:20.181610 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181616 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | 2025-10-13 20:41:20.181622 | controller | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n 2025-10-13 20:41:20.181627 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181633 | controller | + finger_print=82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69\n logger.go:42: 2025-10-13 20:41:20.181639 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69 2025-10-13 20:41:20.181652 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181681 | controller | | + echo 'glance-default-internal.openstack-kuttl-tests.svc:9292 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69'\n 2025-10-13 20:41:20.181690 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181697 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.181705 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181710 | controller | ++ echo cinder-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181716 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.181722 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181728 | controller | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181733 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! cinder-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.181743 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181749 | controller | | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.181755 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client 2025-10-13 20:41:20.181760 | controller | -connect cinder-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.181766 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.181771 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181777 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181783 | controller | | + finger_print=30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF\n logger.go:42: 2025-10-13 20:41:20.181789 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF 2025-10-13 20:41:20.181794 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181800 | controller | | + echo 'cinder-public-openstack-kuttl-tests.apps-crc.testing:443 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF'\n 2025-10-13 20:41:20.181806 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181811 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.181817 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181823 | controller | ++ echo placement-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181828 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.181834 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181840 | controller | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181845 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! placement-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.181851 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181857 | controller | | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.181862 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client 2025-10-13 20:41:20.181868 | controller | -connect placement-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.181874 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.181879 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181885 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181891 | controller | | + finger_print=5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5\n logger.go:42: 2025-10-13 20:41:20.181896 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5 2025-10-13 20:41:20.181902 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181911 | controller | | + echo 'placement-public-openstack-kuttl-tests.apps-crc.testing:443 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5'\n 2025-10-13 20:41:20.181924 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181939 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.181947 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181954 | controller | ++ echo neutron-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181961 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.181967 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.181972 | controller | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.181978 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! neutron-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.181984 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.181989 | controller | | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.181995 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client 2025-10-13 20:41:20.182001 | controller | -connect neutron-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.182006 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.182012 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182018 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182024 | controller | | + finger_print=67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77\n logger.go:42: 2025-10-13 20:41:20.182029 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77 2025-10-13 20:41:20.182035 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182041 | controller | | + echo 'neutron-public-openstack-kuttl-tests.apps-crc.testing:443 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77'\n 2025-10-13 20:41:20.182046 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182052 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.182058 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182063 | controller | ++ echo cinder-internal.openstack-kuttl-tests.svc:8776\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182069 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.182075 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182080 | controller | + host_port=cinder-internal.openstack-kuttl-tests.svc:8776\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182086 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! cinder-internal.openstack-kuttl-tests.svc:8776 2025-10-13 20:41:20.182092 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182101 | controller | | ++ openssl s_client -connect cinder-internal.openstack-kuttl-tests.svc:8776\n 2025-10-13 20:41:20.182106 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182112 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | 2025-10-13 20:41:20.182118 | controller | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n 2025-10-13 20:41:20.182124 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182132 | controller | + finger_print=01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93\n logger.go:42: 2025-10-13 20:41:20.182138 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93 2025-10-13 20:41:20.182143 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182149 | controller | | + echo 'cinder-internal.openstack-kuttl-tests.svc:8776 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93'\n 2025-10-13 20:41:20.182155 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182160 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.182166 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182172 | controller | ++ echo barbican-internal.openstack-kuttl-tests.svc:9311\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182177 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.182190 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182198 | controller | + host_port=barbican-internal.openstack-kuttl-tests.svc:9311\n logger.go:42: 2025-10-13 20:41:20.182206 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! barbican-internal.openstack-kuttl-tests.svc:9311 2025-10-13 20:41:20.182214 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182221 | controller | | ++ openssl s_client -connect barbican-internal.openstack-kuttl-tests.svc:9311\n 2025-10-13 20:41:20.182230 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182236 | controller | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182242 | controller | | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182247 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72\n 2025-10-13 20:41:20.182253 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182261 | controller | + [[ -n 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72 ]]\n logger.go:42: 2025-10-13 20:41:20.182267 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'barbican-internal.openstack-kuttl-tests.svc:9311 2025-10-13 20:41:20.182273 | controller | 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72'\n logger.go:42: 2025-10-13 20:41:20.182278 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack 2025-10-13 20:41:20.182284 | controller | endpoint list -c URL -f value | awk -F/ '{print $3}')\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182290 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo swift-internal.openstack-kuttl-tests.svc:8080\n 2025-10-13 20:41:20.182295 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182301 | controller | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182307 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=swift-internal.openstack-kuttl-tests.svc:8080\n 2025-10-13 20:41:20.182315 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182321 | controller | + [[ ! swift-internal.openstack-kuttl-tests.svc:8080 =~ :[0-9]+$ ]]\n logger.go:42: 2025-10-13 20:41:20.182327 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client 2025-10-13 20:41:20.182332 | controller | -connect swift-internal.openstack-kuttl-tests.svc:8080\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182341 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.182346 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182352 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182358 | controller | | + finger_print=F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9\n logger.go:42: 2025-10-13 20:41:20.182364 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9 2025-10-13 20:41:20.182369 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182375 | controller | | + echo 'swift-internal.openstack-kuttl-tests.svc:8080 F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9'\n 2025-10-13 20:41:20.182381 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182386 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.182392 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182418 | controller | ++ echo keystone-internal.openstack-kuttl-tests.svc:5000\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182430 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.182438 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182444 | controller | + host_port=keystone-internal.openstack-kuttl-tests.svc:5000\n logger.go:42: 2025-10-13 20:41:20.182450 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! keystone-internal.openstack-kuttl-tests.svc:5000 2025-10-13 20:41:20.182456 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182462 | controller | | ++ openssl s_client -connect keystone-internal.openstack-kuttl-tests.svc:5000\n 2025-10-13 20:41:20.182467 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182481 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | 2025-10-13 20:41:20.182489 | controller | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n 2025-10-13 20:41:20.182497 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182505 | controller | + finger_print=08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23\n logger.go:42: 2025-10-13 20:41:20.182512 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23 2025-10-13 20:41:20.182524 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182531 | controller | | + echo 'keystone-internal.openstack-kuttl-tests.svc:5000 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23'\n 2025-10-13 20:41:20.182538 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182544 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.182550 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182556 | controller | ++ echo barbican-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.182561 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.182567 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182573 | controller | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.182581 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! barbican-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.182587 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182593 | controller | | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.182599 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client 2025-10-13 20:41:20.182604 | controller | -connect barbican-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.182613 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.182618 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182624 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182630 | controller | | + finger_print=5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A\n logger.go:42: 2025-10-13 20:41:20.182635 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A 2025-10-13 20:41:20.182641 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182647 | controller | | + echo 'barbican-public-openstack-kuttl-tests.apps-crc.testing:443 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A'\n 2025-10-13 20:41:20.182652 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182658 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.182664 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182670 | controller | ++ echo nova-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182675 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.182681 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182687 | controller | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.182692 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! nova-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.182698 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182704 | controller | | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.182709 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client 2025-10-13 20:41:20.182715 | controller | -connect nova-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.182721 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.182726 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182732 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182745 | controller | | + finger_print=00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99\n logger.go:42: 2025-10-13 20:41:20.182754 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99 2025-10-13 20:41:20.182761 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182769 | controller | | + echo 'nova-public-openstack-kuttl-tests.apps-crc.testing:443 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99'\n 2025-10-13 20:41:20.182781 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182787 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.182793 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182799 | controller | ++ echo placement-internal.openstack-kuttl-tests.svc:8778\n logger.go:42: 20:26:13 2025-10-13 20:41:20.182804 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.182810 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182816 | controller | + host_port=placement-internal.openstack-kuttl-tests.svc:8778\n logger.go:42: 2025-10-13 20:41:20.182822 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! placement-internal.openstack-kuttl-tests.svc:8778 2025-10-13 20:41:20.182827 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182833 | controller | | ++ openssl s_client -connect placement-internal.openstack-kuttl-tests.svc:8778\n 2025-10-13 20:41:20.182839 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182844 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | 2025-10-13 20:41:20.182850 | controller | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n 2025-10-13 20:41:20.182856 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182861 | controller | + finger_print=CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36\n logger.go:42: 2025-10-13 20:41:20.182867 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36 2025-10-13 20:41:20.182873 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182879 | controller | | + echo 'placement-internal.openstack-kuttl-tests.svc:8778 CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36'\n 2025-10-13 20:41:20.182884 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182890 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.182896 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182901 | controller | ++ echo keystone-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.182907 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.182913 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.182919 | controller | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 2025-10-13 20:41:20.182924 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! keystone-public-openstack-kuttl-tests.apps-crc.testing 2025-10-13 20:41:20.182930 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182936 | controller | | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.182941 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client 2025-10-13 20:41:20.182947 | controller | -connect keystone-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 2025-10-13 20:41:20.182956 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint 2025-10-13 20:41:20.182962 | controller | -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182970 | controller | | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.182976 | controller | | + finger_print=51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3\n logger.go:42: 2025-10-13 20:41:20.182982 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3 2025-10-13 20:41:20.182987 | controller | ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183000 | controller | | + echo 'keystone-public-openstack-kuttl-tests.apps-crc.testing:443 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3'\n 2025-10-13 20:41:20.183008 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.183016 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n 2025-10-13 20:41:20.183024 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.183031 | controller | ++ echo neutron-internal.openstack-kuttl-tests.svc:9696\n logger.go:42: 20:26:13 2025-10-13 20:41:20.183039 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n 2025-10-13 20:41:20.183044 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.183050 | controller | + host_port=neutron-internal.openstack-kuttl-tests.svc:9696\n logger.go:42: 20:26:13 2025-10-13 20:41:20.183056 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! neutron-internal.openstack-kuttl-tests.svc:9696 2025-10-13 20:41:20.183061 | controller | =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183067 | controller | | ++ openssl s_client -connect neutron-internal.openstack-kuttl-tests.svc:9696\n 2025-10-13 20:41:20.183073 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.183079 | controller | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183084 | controller | | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 2025-10-13 20:41:20.183090 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83\n 2025-10-13 20:41:20.183096 | controller | \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.183101 | controller | + [[ -n 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83 ]]\n logger.go:42: 2025-10-13 20:41:20.183107 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'neutron-internal.openstack-kuttl-tests.svc:9696 2025-10-13 20:41:20.183113 | controller | 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83'\n logger.go:42: 2025-10-13 20:41:20.183118 | controller | 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh 2025-10-13 20:41:20.183124 | controller | -c echo \"Waiting for OpenStack control plane to be ready...\"\n oc wait 2025-10-13 20:41:20.183130 | controller | openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l core.openstack.org/openstackcontrolplane\n 2025-10-13 20:41:20.183135 | controller | \ ]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183141 | controller | | Waiting for OpenStack control plane to be ready...\n logger.go:42: 20:26:14 2025-10-13 20:41:20.183147 | controller | | ctlplane-tls-cert-rotation/2-get-endpoints-certs | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.183153 | controller | condition met\n logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183158 | controller | | running command: [sh -c echo \"Fail if internal http endpoints are registered\"\n 2025-10-13 20:41:20.183164 | controller | \ oc exec -i openstackclient -n $NAMESPACE -- bash -c \"openstack endpoint 2025-10-13 20:41:20.183173 | controller | list --interface internal -f value -c URL\" | grep 'http:' && exit 1\n exit 2025-10-13 20:41:20.183178 | controller | 0\n ]\n logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183187 | controller | | Fail if internal http endpoints are registered\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183193 | controller | | running command: [sh -c echo \"check ovn sb internalDbAddress use ssl\"\n oc 2025-10-13 20:41:20.183198 | controller | get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} 2025-10-13 20:41:20.183204 | controller | | grep -q ssl\n ]\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183210 | controller | | check ovn sb internalDbAddress use ssl\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183216 | controller | | running command: [sh -c echo \"check ovn sb DB connection use ssl\"\n oc 2025-10-13 20:41:20.183221 | controller | exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c \"ovn-sbctl --no-leader-only 2025-10-13 20:41:20.183227 | controller | get-connection | grep -q pssl\"\n ]\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183233 | controller | | check ovn sb DB connection use ssl\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183238 | controller | | Defaulted container \"ovsdbserver-sb\" out of: ovsdbserver-sb, openstack-network-exporter\n 2025-10-13 20:41:20.183244 | controller | \ logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.183257 | controller | running command: [sh -c echo \"check nova transport_url use ssl\"\n oc exec 2025-10-13 20:41:20.183265 | controller | -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c \"grep transport_url 2025-10-13 20:41:20.183273 | controller | /etc/nova/nova.conf.d/01-nova.conf | grep -q 'ssl=1'\"\n ]\n logger.go:42: 2025-10-13 20:41:20.183281 | controller | 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check nova transport_url 2025-10-13 20:41:20.183288 | controller | use ssl\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183294 | controller | | running command: [sh -c echo \"check neutron ovn_sb_connection url ssl\"\n oc 2025-10-13 20:41:20.183300 | controller | exec -i deployment/neutron -n $NAMESPACE -- bash -c \"grep ovn_sb_connection /etc/neutron/neutron.conf.d/01-neutron.conf| 2025-10-13 20:41:20.183305 | controller | grep -q ssl\"\n ]\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183311 | controller | | check neutron ovn_sb_connection url ssl\n logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs 2025-10-13 20:41:20.183317 | controller | | Defaulted container \"neutron-api\" out of: neutron-api, neutron-httpd\n logger.go:42: 2025-10-13 20:41:20.183323 | controller | 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | test step completed 2025-10-13 20:41:20.183334 | controller | 2-get-endpoints-certs\n logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration 2025-10-13 20:41:20.183340 | controller | | starting test step 3-change-cert-duration\n logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration 2025-10-13 20:41:20.183346 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_duration 2025-10-13 20:41:20.183351 | controller | | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 20:26:18 | ctlplane-tls-cert-rotation/3-change-cert-duration 2025-10-13 20:41:20.183357 | controller | | openstackcontrolplane.core.openstack.org/openstack configured\n logger.go:42: 2025-10-13 20:41:20.183363 | controller | 20:26:19 | ctlplane-tls-cert-rotation/3-change-cert-duration | test step completed 2025-10-13 20:41:20.183368 | controller | 3-change-cert-duration\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183377 | controller | | starting test step 4-\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183383 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.183388 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.183397 | controller | \ ]\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.183415 | controller | rotation of non API service certificates...\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183424 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.183430 | controller | \ logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.183435 | controller | on port 15691...\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.183441 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183447 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183452 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:26:19 2025-10-13 20:41:20.183458 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.183464 | controller | 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.183469 | controller | match the secret.\n logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.183475 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.183481 | controller | \ logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.183486 | controller | on port 6642...\n logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.183492 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:26:20 2025-10-13 20:41:20.183498 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.183503 | controller | \ logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.183509 | controller | on port 6644 match the secret.\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183515 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183520 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 match the secret.\n logger.go:42: 2025-10-13 20:41:20.183526 | controller | 20:26:21 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.183539 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183547 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183555 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.183563 | controller | 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.183571 | controller | 6643...\n logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.183577 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:22 2025-10-13 20:41:20.183583 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.183589 | controller | \ logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.183595 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183604 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.183610 | controller | \ logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.183615 | controller | on port 3000...\n logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.183621 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.183627 | controller | 20:26:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.183633 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183638 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183647 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.183653 | controller | 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.183659 | controller | 15671...\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.183665 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:23 2025-10-13 20:41:20.183670 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.183676 | controller | \ logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.183682 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183688 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.183694 | controller | 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.183699 | controller | 3306...\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.183705 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:24 2025-10-13 20:41:20.183713 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.183719 | controller | Ports: 3306)\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.183725 | controller | to openstack on port 3306...\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183731 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.183736 | controller | 20:26:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.183742 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.183748 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.183754 | controller | \ ]\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.183759 | controller | of all service certs\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183765 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.183771 | controller | 20:26:24 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.183777 | controller | commands\n logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.183782 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.183791 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.183796 | controller | 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.183805 | controller | certificates...\n logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.183818 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.183827 | controller | 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.183835 | controller | \ logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.183843 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183851 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183857 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.183862 | controller | 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.183868 | controller | \ logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.183874 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183880 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.183885 | controller | \ logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.183891 | controller | on port 6642...\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.183897 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.183903 | controller | 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.183908 | controller | 6644...\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.183914 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:26 2025-10-13 20:41:20.183920 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.183926 | controller | \ logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.183931 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183937 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.183943 | controller | 1981)\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.183954 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.183964 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.183972 | controller | 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.183981 | controller | 6643...\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.183991 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:27 2025-10-13 20:41:20.184000 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.184013 | controller | \ logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184021 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184029 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.184037 | controller | \ logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.184045 | controller | on port 3000...\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.184057 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.184065 | controller | 20:26:28 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.184073 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184081 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184089 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.184097 | controller | 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.184105 | controller | 15671...\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.184113 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:29 2025-10-13 20:41:20.184121 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.184129 | controller | \ logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184137 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184156 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.184168 | controller | 20:26:29 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.184179 | controller | 3306...\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.184190 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:29 2025-10-13 20:41:20.184201 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.184209 | controller | Ports: 3306)\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.184217 | controller | to openstack on port 3306...\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184225 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.184233 | controller | 20:26:30 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.184241 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.184249 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.184257 | controller | \ ]\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.184265 | controller | of all service certs\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184274 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.184281 | controller | 20:26:30 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.184290 | controller | commands\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.184298 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.184306 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.184314 | controller | 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.184322 | controller | certificates...\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.184330 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.184338 | controller | 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.184346 | controller | \ logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184359 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184422 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184435 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.184443 | controller | 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.184451 | controller | \ logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184460 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184468 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.184476 | controller | \ logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.184484 | controller | on port 6642...\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.184496 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.184504 | controller | 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.184512 | controller | 6644...\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.184520 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:32 2025-10-13 20:41:20.184528 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.184536 | controller | \ logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184545 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184556 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.184564 | controller | 1981)\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.184572 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184580 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.184588 | controller | 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.184607 | controller | 6643...\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.184619 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:33 2025-10-13 20:41:20.184630 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.184641 | controller | \ logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184652 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184661 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.184669 | controller | \ logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.184677 | controller | on port 3000...\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.184685 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.184694 | controller | 20:26:34 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.184702 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184710 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184722 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.184730 | controller | 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.184738 | controller | 15671...\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.184746 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:34 2025-10-13 20:41:20.184755 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.184763 | controller | \ logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184771 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184779 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.184787 | controller | 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.184795 | controller | 3306...\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.184803 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:35 2025-10-13 20:41:20.184811 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.184819 | controller | Ports: 3306)\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.184827 | controller | to openstack on port 3306...\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184835 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.184843 | controller | 20:26:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.184851 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.184859 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.184867 | controller | \ ]\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.184875 | controller | of all service certs\n logger.go:42: 20:26:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184883 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.184895 | controller | 20:26:36 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.184903 | controller | commands\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.184911 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.184919 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.184927 | controller | 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.184935 | controller | certificates...\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.184943 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.184951 | controller | 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.184959 | controller | \ logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.184967 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184975 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.184994 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.185015 | controller | 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.185027 | controller | \ logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185038 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185046 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.185054 | controller | \ logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.185062 | controller | on port 6642...\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.185071 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.185079 | controller | 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.185087 | controller | 6644...\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185095 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:38 2025-10-13 20:41:20.185103 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.185111 | controller | \ logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185119 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185127 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.185135 | controller | 1981)\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.185143 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185151 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.185159 | controller | 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.185167 | controller | 6643...\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185175 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:39 2025-10-13 20:41:20.185183 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.185191 | controller | \ logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185199 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185207 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.185215 | controller | \ logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.185223 | controller | on port 3000...\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.185231 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.185239 | controller | 20:26:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.185247 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185255 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185263 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.185271 | controller | 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.185279 | controller | 15671...\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185291 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:40 2025-10-13 20:41:20.185299 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.185308 | controller | \ logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185320 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185328 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.185336 | controller | 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.185348 | controller | 3306...\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185356 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:41 2025-10-13 20:41:20.185364 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.185382 | controller | Ports: 3306)\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.185398 | controller | to openstack on port 3306...\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185433 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.185444 | controller | 20:26:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.185452 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.185460 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.185468 | controller | \ ]\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.185476 | controller | of all service certs\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185484 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.185492 | controller | 20:26:41 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.185500 | controller | commands\n logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.185508 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.185516 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.185524 | controller | 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.185532 | controller | certificates...\n logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.185540 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.185548 | controller | 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.185556 | controller | \ logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185564 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185572 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185580 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.185588 | controller | 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.185596 | controller | \ logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185604 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185617 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.185625 | controller | \ logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.185633 | controller | on port 6642...\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.185641 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.185649 | controller | 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.185657 | controller | 6644...\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185665 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:44 2025-10-13 20:41:20.185673 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.185681 | controller | \ logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185689 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185722 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.185733 | controller | 1981)\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.185743 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185754 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.185764 | controller | 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.185774 | controller | 6643...\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185790 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:44 2025-10-13 20:41:20.185801 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.185811 | controller | \ logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185821 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185841 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.185853 | controller | \ logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.185864 | controller | on port 3000...\n logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.185875 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.185886 | controller | 20:26:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.185895 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185903 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185911 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.185919 | controller | 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.185927 | controller | 15671...\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185935 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:46 2025-10-13 20:41:20.185943 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.185951 | controller | \ logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.185959 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.185972 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.185980 | controller | 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.185988 | controller | 3306...\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.185996 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:46 2025-10-13 20:41:20.186004 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.186012 | controller | Ports: 3306)\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.186020 | controller | to openstack on port 3306...\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186028 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.186036 | controller | 20:26:47 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.186044 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.186052 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.186060 | controller | \ ]\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.186068 | controller | of all service certs\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186076 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.186084 | controller | 20:26:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.186092 | controller | commands\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.186100 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.186108 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.186116 | controller | 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.186124 | controller | certificates...\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.186132 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.186140 | controller | 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.186148 | controller | \ logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186156 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186164 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186172 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.186180 | controller | 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.186193 | controller | \ logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186204 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186222 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.186234 | controller | \ logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.186245 | controller | on port 6642...\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.186256 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.186273 | controller | 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.186281 | controller | 6644...\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.186289 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:49 2025-10-13 20:41:20.186297 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.186305 | controller | \ logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186313 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186321 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.186329 | controller | 1981)\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.186337 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186345 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.186353 | controller | 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.186361 | controller | 6643...\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.186369 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:50 2025-10-13 20:41:20.186377 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.186385 | controller | \ logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186393 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186434 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.186445 | controller | \ logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.186456 | controller | on port 3000...\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.186464 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.186472 | controller | 20:26:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.186480 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186488 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186496 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.186504 | controller | 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.186512 | controller | 15671...\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.186520 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:51 2025-10-13 20:41:20.186528 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.186536 | controller | \ logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186544 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186552 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.186560 | controller | 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.186568 | controller | 3306...\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.186581 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:52 2025-10-13 20:41:20.186589 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.186597 | controller | Ports: 3306)\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.186605 | controller | to openstack on port 3306...\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186613 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.186621 | controller | 20:26:52 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.186629 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.186648 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.186660 | controller | \ ]\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.186677 | controller | of all service certs\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186688 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.186698 | controller | 20:26:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.186706 | controller | commands\n logger.go:42: 20:26:53 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.186714 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.186722 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.186730 | controller | 20:26:53 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.186738 | controller | certificates...\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.186746 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.186754 | controller | 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.186762 | controller | \ logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186770 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186778 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186786 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.186794 | controller | 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.186802 | controller | \ logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186810 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186818 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.186826 | controller | \ logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.186834 | controller | on port 6642...\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.186842 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.186850 | controller | 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.186858 | controller | 6644...\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.186866 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:55 2025-10-13 20:41:20.186874 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.186886 | controller | \ logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186894 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186902 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.186910 | controller | 1981)\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.186918 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186926 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.186934 | controller | 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.186942 | controller | 6643...\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.186950 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:56 2025-10-13 20:41:20.186958 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.186966 | controller | \ logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.186974 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.186986 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.186994 | controller | \ logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.187002 | controller | on port 3000...\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.187010 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.187029 | controller | 20:26:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.187041 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187052 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187063 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.187074 | controller | 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.187084 | controller | 15671...\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.187095 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:57 2025-10-13 20:41:20.187110 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.187119 | controller | \ logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187127 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187135 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.187143 | controller | 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.187151 | controller | 3306...\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.187159 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:58 2025-10-13 20:41:20.187167 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.187175 | controller | Ports: 3306)\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.187183 | controller | to openstack on port 3306...\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187199 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.187207 | controller | 20:26:58 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.187215 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.187223 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.187231 | controller | \ ]\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.187240 | controller | of all service certs\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187248 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.187256 | controller | 20:26:58 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.187264 | controller | commands\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.187272 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.187280 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.187288 | controller | 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.187296 | controller | certificates...\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.187304 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.187312 | controller | 20:26:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.187320 | controller | \ logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187328 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187336 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187344 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.187352 | controller | 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.187360 | controller | \ logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187368 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187376 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.187384 | controller | \ logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.187397 | controller | on port 6642...\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.187426 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.187434 | controller | 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.187454 | controller | 6644...\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.187465 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:00 2025-10-13 20:41:20.187476 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.187488 | controller | \ logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187499 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187508 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.187521 | controller | 1981)\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.187533 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187541 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.187549 | controller | 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.187557 | controller | 6643...\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.187565 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:01 2025-10-13 20:41:20.187574 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.187582 | controller | \ logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187590 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187598 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.187606 | controller | \ logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.187614 | controller | on port 3000...\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.187622 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.187630 | controller | 20:27:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.187638 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187646 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187654 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.187662 | controller | 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.187670 | controller | 15671...\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.187678 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:02 2025-10-13 20:41:20.187686 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.187695 | controller | \ logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187703 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187711 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.187719 | controller | 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.187727 | controller | 3306...\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.187735 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:03 2025-10-13 20:41:20.187743 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.187751 | controller | Ports: 3306)\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.187759 | controller | to openstack on port 3306...\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187767 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.187775 | controller | 20:27:03 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.187783 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.187795 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.187803 | controller | \ ]\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.187811 | controller | of all service certs\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187818 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.187837 | controller | 20:27:03 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.187848 | controller | commands\n logger.go:42: 20:27:04 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.187859 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.187875 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.187884 | controller | 20:27:04 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.187892 | controller | certificates...\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.187900 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.187908 | controller | 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.187920 | controller | \ logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187928 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187936 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187944 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.187953 | controller | 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.187962 | controller | \ logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.187971 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.187981 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.187989 | controller | \ logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.187997 | controller | on port 6642...\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.188005 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.188013 | controller | 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.188020 | controller | 6644...\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188028 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:06 2025-10-13 20:41:20.188036 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.188044 | controller | \ logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188052 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188060 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.188068 | controller | 1981)\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.188076 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188084 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.188096 | controller | 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.188104 | controller | 6643...\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188112 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:07 2025-10-13 20:41:20.188120 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.188127 | controller | \ logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188135 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188143 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.188151 | controller | \ logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.188159 | controller | on port 3000...\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.188167 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.188175 | controller | 20:27:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.188183 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188191 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188199 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.188216 | controller | 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.188227 | controller | 15671...\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188238 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:08 2025-10-13 20:41:20.188249 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.188259 | controller | \ logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188267 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188275 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.188283 | controller | 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.188291 | controller | 3306...\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188299 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:09 2025-10-13 20:41:20.188307 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.188315 | controller | Ports: 3306)\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.188323 | controller | to openstack on port 3306...\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188330 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.188338 | controller | 20:27:09 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.188346 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.188359 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.188367 | controller | \ ]\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.188375 | controller | of all service certs\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188383 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.188398 | controller | 20:27:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.188427 | controller | commands\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.188435 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.188443 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.188451 | controller | 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.188459 | controller | certificates...\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.188467 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.188475 | controller | 20:27:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.188483 | controller | \ logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188491 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188499 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188507 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.188514 | controller | 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.188522 | controller | \ logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188530 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188538 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.188546 | controller | \ logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.188554 | controller | on port 6642...\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.188562 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.188570 | controller | 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.188578 | controller | 6644...\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188586 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:11 2025-10-13 20:41:20.188594 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.188601 | controller | \ logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188619 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188636 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.188647 | controller | 1981)\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.188657 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188667 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.188675 | controller | 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.188683 | controller | 6643...\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188690 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:12 2025-10-13 20:41:20.188698 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.188710 | controller | \ logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188718 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188726 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.188734 | controller | \ logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.188742 | controller | on port 3000...\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.188750 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.188758 | controller | 20:27:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.188766 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188774 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188781 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.188789 | controller | 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.188809 | controller | 15671...\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188817 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:13 2025-10-13 20:41:20.188825 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.188833 | controller | \ logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.188841 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188849 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.188856 | controller | 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.188864 | controller | 3306...\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.188872 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:14 2025-10-13 20:41:20.188880 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.188888 | controller | Ports: 3306)\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.188896 | controller | to openstack on port 3306...\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188904 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.188912 | controller | 20:27:14 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.188920 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.188928 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.188935 | controller | \ ]\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.188943 | controller | of all service certs\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.188953 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.188962 | controller | 20:27:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.188971 | controller | commands\n logger.go:42: 20:27:15 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.188980 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.188992 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.189000 | controller | 20:27:15 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.189017 | controller | certificates...\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.189029 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.189040 | controller | 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.189050 | controller | \ logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189061 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189069 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189077 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.189085 | controller | 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.189093 | controller | \ logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189100 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189108 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.189116 | controller | \ logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.189124 | controller | on port 6642...\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.189132 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.189140 | controller | 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.189148 | controller | 6644...\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.189156 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:17 2025-10-13 20:41:20.189164 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.189176 | controller | \ logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189184 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189192 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.189200 | controller | 1981)\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.189208 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189219 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.189227 | controller | 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.189235 | controller | 6643...\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.189243 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:18 2025-10-13 20:41:20.189251 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.189259 | controller | \ logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189267 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189275 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.189283 | controller | \ logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.189298 | controller | on port 3000...\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.189306 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.189314 | controller | 20:27:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.189322 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189330 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189338 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.189346 | controller | 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.189354 | controller | 15671...\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.189362 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:19 2025-10-13 20:41:20.189370 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.189378 | controller | \ logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189422 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189441 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.189451 | controller | 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.189459 | controller | 3306...\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.189467 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:20 2025-10-13 20:41:20.189475 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.189483 | controller | Ports: 3306)\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.189491 | controller | to openstack on port 3306...\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189499 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.189507 | controller | 20:27:20 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.189515 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.189522 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.189530 | controller | \ ]\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.189538 | controller | of all service certs\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189546 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.189554 | controller | 20:27:20 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.189562 | controller | commands\n logger.go:42: 20:27:21 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.189570 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.189578 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.189586 | controller | 20:27:21 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.189594 | controller | certificates...\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.189607 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.189619 | controller | 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.189627 | controller | \ logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189634 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189642 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189650 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.189658 | controller | 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.189666 | controller | \ logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189674 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189682 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.189690 | controller | \ logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.189698 | controller | on port 6642...\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.189706 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.189714 | controller | 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.189721 | controller | 6644...\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.189757 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:23 2025-10-13 20:41:20.189768 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.189778 | controller | \ logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189788 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189798 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.189808 | controller | 1981)\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.189819 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189828 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.189847 | controller | 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.189858 | controller | 6643...\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.189869 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:24 2025-10-13 20:41:20.189880 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.189890 | controller | \ logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.189900 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189908 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.189916 | controller | \ logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.189924 | controller | on port 3000...\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.189931 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.189939 | controller | 20:27:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.189952 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189960 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.189968 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.189976 | controller | 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.189984 | controller | 15671...\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.189992 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:25 2025-10-13 20:41:20.190000 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.190008 | controller | \ logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.190016 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190024 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.190031 | controller | 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.190039 | controller | 3306...\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.190047 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:26 2025-10-13 20:41:20.190055 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.190063 | controller | Ports: 3306)\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.190071 | controller | to openstack on port 3306...\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190084 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.190092 | controller | 20:27:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.190100 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.190107 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.190115 | controller | \ ]\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.190123 | controller | of all service certs\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190131 | controller | | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 2025-10-13 20:41:20.190139 | controller | 20:27:26 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional 2025-10-13 20:41:20.190147 | controller | commands\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | running command: 2025-10-13 20:41:20.190155 | controller | [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE 2025-10-13 20:41:20.190163 | controller | bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 2025-10-13 20:41:20.190171 | controller | 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service 2025-10-13 20:41:20.190179 | controller | certificates...\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.190186 | controller | service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 2025-10-13 20:41:20.190194 | controller | 20:27:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n 2025-10-13 20:41:20.190202 | controller | \ logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.190221 | controller | from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190237 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190248 | controller | | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 2025-10-13 20:41:20.190259 | controller | 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n 2025-10-13 20:41:20.190268 | controller | \ logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.190281 | controller | from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190289 | controller | | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.190297 | controller | \ logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.190304 | controller | on port 6642...\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.190312 | controller | retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 2025-10-13 20:41:20.190321 | controller | 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.190328 | controller | 6644...\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.190336 | controller | certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:28 2025-10-13 20:41:20.190344 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.190352 | controller | \ logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.190360 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190368 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.190376 | controller | 1981)\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.190384 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190392 | controller | | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 2025-10-13 20:41:20.190421 | controller | 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.190433 | controller | 6643...\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.190441 | controller | certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:29 2025-10-13 20:41:20.190449 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.190457 | controller | \ logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.190465 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190473 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.190481 | controller | \ logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.190489 | controller | on port 3000...\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.190497 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.190508 | controller | 20:27:30 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.190516 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190524 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190532 | controller | | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 2025-10-13 20:41:20.190545 | controller | 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.190553 | controller | 15671...\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.190561 | controller | certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:30 2025-10-13 20:41:20.190569 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.190577 | controller | \ logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.190585 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190593 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.190601 | controller | 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.190608 | controller | 3306...\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Error retrieving 2025-10-13 20:41:20.190626 | controller | certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:31 2025-10-13 20:41:20.190637 | controller | | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.190648 | controller | Ports: 3306)\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.190659 | controller | to openstack on port 3306...\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190670 | controller | | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 2025-10-13 20:41:20.190679 | controller | 20:27:31 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints 2025-10-13 20:41:20.190686 | controller | of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash 2025-10-13 20:41:20.190694 | controller | -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n 2025-10-13 20:41:20.190702 | controller | \ ]\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Get fingerprints 2025-10-13 20:41:20.190710 | controller | of all service certs\n logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190718 | controller | | error: unable to upgrade connection: container not found (\"openstackclient\")\n 2025-10-13 20:41:20.190726 | controller | \ logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.190734 | controller | 1 additional commands\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190742 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.190750 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.190758 | controller | \ ]\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.190766 | controller | rotation of non API service certificates...\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190774 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.190781 | controller | \ logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.190789 | controller | on port 15691...\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.190797 | controller | for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:33 2025-10-13 20:41:20.190805 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 2025-10-13 20:41:20.190813 | controller | 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 2025-10-13 20:41:20.190821 | controller | DO NOT match the secret.\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190829 | controller | | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190842 | controller | | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.190850 | controller | 20:27:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 2025-10-13 20:41:20.190858 | controller | 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190866 | controller | | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190874 | controller | | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 2025-10-13 20:41:20.190882 | controller | 20:27:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.190890 | controller | 6644...\n logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.190898 | controller | for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:27:35 2025-10-13 20:41:20.190910 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.190918 | controller | \ logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.190926 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190933 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.190941 | controller | 1981)\n logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.190949 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.190957 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.190965 | controller | 20:27:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.190973 | controller | 6643...\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.190981 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:27:36 2025-10-13 20:41:20.190989 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.191007 | controller | \ logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.191018 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191029 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.191040 | controller | \ logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.191055 | controller | on port 3000...\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Error 2025-10-13 20:41:20.191063 | controller | retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 2025-10-13 20:41:20.191071 | controller | 20:27:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 2025-10-13 20:41:20.191079 | controller | 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191086 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191094 | controller | | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.191102 | controller | 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.191110 | controller | 15671...\n logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191118 | controller | for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:38 2025-10-13 20:41:20.191126 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.191138 | controller | \ logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.191146 | controller | on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191154 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.191162 | controller | 20:27:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.191169 | controller | 3306...\n logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191177 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:27:39 | 2025-10-13 20:41:20.191185 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.191193 | controller | Ports: 3306)\n logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.191201 | controller | to openstack on port 3306...\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191209 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:27:40 2025-10-13 20:41:20.191217 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.191225 | controller | \ logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.191233 | controller | 15691\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.191241 | controller | on port 5671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.191249 | controller | on port 15671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.191257 | controller | on port 1981\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.191265 | controller | on port 1981\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.191273 | controller | on port 5671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.191281 | controller | on port 15671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.191289 | controller | on port 15691\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.191296 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191304 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.191312 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.191320 | controller | \ ]\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.191328 | controller | rotation of non API service certificates...\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191336 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.191347 | controller | \ logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.191355 | controller | on port 15691...\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191363 | controller | for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:41 2025-10-13 20:41:20.191371 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 2025-10-13 20:41:20.191389 | controller | 20:27:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 2025-10-13 20:41:20.191421 | controller | DO NOT match the secret.\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191437 | controller | | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191454 | controller | | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.191462 | controller | 20:27:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 2025-10-13 20:41:20.191470 | controller | 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191478 | controller | | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191486 | controller | | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 2025-10-13 20:41:20.191494 | controller | 20:27:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.191502 | controller | 6644...\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191510 | controller | for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:27:43 2025-10-13 20:41:20.191518 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.191525 | controller | \ logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.191533 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191541 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.191549 | controller | 1981)\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.191557 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191565 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.191573 | controller | 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.191581 | controller | 6643...\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191589 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:27:44 2025-10-13 20:41:20.191597 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.191605 | controller | \ logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.191613 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191621 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.191629 | controller | \ logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.191637 | controller | on port 3000...\n logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191644 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:27:46 2025-10-13 20:41:20.191652 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.191660 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191668 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191676 | controller | | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.191684 | controller | 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.191692 | controller | 15671...\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191700 | controller | for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:46 2025-10-13 20:41:20.191708 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.191719 | controller | \ logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.191731 | controller | on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191739 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.191747 | controller | 20:27:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.191755 | controller | 3306...\n logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191763 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:27:48 | 2025-10-13 20:41:20.191771 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.191789 | controller | Ports: 3306)\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.191801 | controller | to openstack on port 3306...\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191812 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:27:48 2025-10-13 20:41:20.191828 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.191837 | controller | \ logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.191845 | controller | 15691\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.191853 | controller | on port 5671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.191860 | controller | on port 15671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.191868 | controller | on port 1981\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.191876 | controller | on port 1981\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.191884 | controller | on port 5671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.191892 | controller | on port 15671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.191900 | controller | on port 15691\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.191908 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191916 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.191924 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.191932 | controller | \ ]\n logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.191940 | controller | rotation of non API service certificates...\n logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.191948 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.191956 | controller | \ logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.191964 | controller | on port 15691...\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.191972 | controller | for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:50 2025-10-13 20:41:20.191980 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 2025-10-13 20:41:20.191987 | controller | 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 2025-10-13 20:41:20.191995 | controller | DO NOT match the secret.\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192003 | controller | | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192011 | controller | | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.192023 | controller | 20:27:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 2025-10-13 20:41:20.192031 | controller | 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192039 | controller | | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192047 | controller | | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 2025-10-13 20:41:20.192055 | controller | 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.192063 | controller | 6644...\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192071 | controller | for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:27:51 2025-10-13 20:41:20.192079 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.192087 | controller | \ logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.192095 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192103 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.192111 | controller | 1981)\n logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.192118 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192126 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.192134 | controller | 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.192142 | controller | 6643...\n logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192150 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:27:53 2025-10-13 20:41:20.192167 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.192179 | controller | \ logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.192190 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192201 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.192210 | controller | \ logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.192218 | controller | on port 3000...\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192226 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:27:54 2025-10-13 20:41:20.192234 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.192242 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192250 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192258 | controller | | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.192266 | controller | 20:27:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.192274 | controller | 15671...\n logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192282 | controller | for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:55 2025-10-13 20:41:20.192295 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.192303 | controller | \ logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.192314 | controller | on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192322 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.192331 | controller | 20:27:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.192340 | controller | 3306...\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192350 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:27:56 | 2025-10-13 20:41:20.192358 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.192366 | controller | Ports: 3306)\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.192374 | controller | to openstack on port 3306...\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192382 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:27:56 2025-10-13 20:41:20.192390 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.192420 | controller | \ logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.192432 | controller | 15691\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.192440 | controller | on port 5671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.192448 | controller | on port 15671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.192460 | controller | on port 1981\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.192468 | controller | on port 1981\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.192476 | controller | on port 5671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.192484 | controller | on port 15671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.192492 | controller | on port 15691\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.192500 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192508 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.192516 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.192524 | controller | \ ]\n logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.192532 | controller | rotation of non API service certificates...\n logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192540 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.192548 | controller | \ logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.192556 | controller | on port 15691...\n logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192574 | controller | for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:58 2025-10-13 20:41:20.192585 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 2025-10-13 20:41:20.192596 | controller | 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 2025-10-13 20:41:20.192607 | controller | DO NOT match the secret.\n logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192618 | controller | | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192627 | controller | | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.192639 | controller | 20:27:59 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 2025-10-13 20:41:20.192647 | controller | 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192655 | controller | | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192663 | controller | | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 2025-10-13 20:41:20.192671 | controller | 20:27:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.192679 | controller | 6644...\n logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192687 | controller | for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:00 2025-10-13 20:41:20.192695 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.192703 | controller | \ logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.192711 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192718 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.192726 | controller | 1981)\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.192734 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192742 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.192750 | controller | 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.192758 | controller | 6643...\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192770 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:01 2025-10-13 20:41:20.192778 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.192786 | controller | \ logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.192794 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192802 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.192810 | controller | \ logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.192818 | controller | on port 3000...\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192825 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:03 2025-10-13 20:41:20.192833 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.192841 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192849 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192857 | controller | | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.192865 | controller | 20:28:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.192873 | controller | 15671...\n logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192881 | controller | for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:28:04 2025-10-13 20:41:20.192889 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.192897 | controller | \ logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.192908 | controller | on port 15691 DO NOT match the secret.\n logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192916 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.192924 | controller | 20:28:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.192932 | controller | 3306...\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.192950 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:05 | 2025-10-13 20:41:20.192962 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.192972 | controller | Ports: 3306)\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.192983 | controller | to openstack on port 3306...\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.192994 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:05 2025-10-13 20:41:20.193002 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.193010 | controller | \ logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.193018 | controller | 15691\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.193025 | controller | on port 5671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.193033 | controller | on port 15671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.193041 | controller | on port 1981\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.193049 | controller | on port 1981\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.193057 | controller | on port 5671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.193070 | controller | on port 15671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.193078 | controller | on port 15691\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.193086 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193093 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.193101 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.193109 | controller | \ ]\n logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.193117 | controller | rotation of non API service certificates...\n logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193125 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.193133 | controller | \ logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.193141 | controller | on port 15691...\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193149 | controller | for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:28:07 2025-10-13 20:41:20.193157 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 2025-10-13 20:41:20.193165 | controller | 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 2025-10-13 20:41:20.193172 | controller | DO NOT match the secret.\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193180 | controller | | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193188 | controller | | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.193200 | controller | 20:28:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 2025-10-13 20:41:20.193208 | controller | 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193216 | controller | | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193224 | controller | | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 2025-10-13 20:41:20.193232 | controller | 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 2025-10-13 20:41:20.193243 | controller | 6644...\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193251 | controller | for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:08 2025-10-13 20:41:20.193259 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n 2025-10-13 20:41:20.193267 | controller | \ logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.193275 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193283 | controller | | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 2025-10-13 20:41:20.193291 | controller | 1981)\n logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to 2025-10-13 20:41:20.193299 | controller | ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193307 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.193315 | controller | 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.193333 | controller | 6643...\n logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193344 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:10 2025-10-13 20:41:20.193355 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.193366 | controller | \ logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.193377 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193385 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.193397 | controller | \ logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.193444 | controller | on port 3000...\n logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193453 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:11 2025-10-13 20:41:20.193461 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.193469 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193477 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193485 | controller | | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.193493 | controller | 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.193501 | controller | 15671...\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193509 | controller | for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:28:12 2025-10-13 20:41:20.193517 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.193525 | controller | \ logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.193533 | controller | on port 15691 DO NOT match the secret.\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193546 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.193554 | controller | 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.193562 | controller | 3306...\n logger.go:42: 20:28:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193570 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:14 | 2025-10-13 20:41:20.193578 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.193586 | controller | Ports: 3306)\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.193594 | controller | to openstack on port 3306...\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193602 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:14 2025-10-13 20:41:20.193609 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.193617 | controller | \ logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.193625 | controller | 15691\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.193633 | controller | on port 5671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq 2025-10-13 20:41:20.193641 | controller | on port 15671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.193649 | controller | on port 1981\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.193657 | controller | on port 1981\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.193665 | controller | on port 5671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.193673 | controller | on port 15671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.193680 | controller | on port 15691\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.193688 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193696 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.193712 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.193720 | controller | \ ]\n logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.193731 | controller | rotation of non API service certificates...\n logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193739 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.193759 | controller | \ logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.193797 | controller | on port 15691...\n logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193809 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193819 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193830 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:17 2025-10-13 20:41:20.193838 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.193846 | controller | 20:28:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.193854 | controller | match the secret.\n logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.193862 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.193874 | controller | \ logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.193882 | controller | on port 6642...\n logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193890 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:18 2025-10-13 20:41:20.193898 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.193906 | controller | \ logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.193914 | controller | on port 6644 match the secret.\n logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193922 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193930 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.193937 | controller | 20:28:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.193945 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193953 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.193961 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.193969 | controller | 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.193977 | controller | 6643...\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.193985 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:19 2025-10-13 20:41:20.193993 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.194001 | controller | \ logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.194009 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194017 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.194025 | controller | \ logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.194033 | controller | on port 3000...\n logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194041 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:21 2025-10-13 20:41:20.194049 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.194057 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194065 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194078 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.194086 | controller | 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.194094 | controller | 15671...\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194102 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:21 | 2025-10-13 20:41:20.194110 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.194118 | controller | \ logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.194125 | controller | on port 15691 match the secret.\n logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194133 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.194145 | controller | 20:28:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.194163 | controller | 3306...\n logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194175 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:22 | 2025-10-13 20:41:20.194185 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.194196 | controller | Ports: 3306)\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.194206 | controller | to openstack on port 3306...\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194214 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:23 2025-10-13 20:41:20.194222 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.194230 | controller | \ logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.194238 | controller | on port 1981\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.194246 | controller | on port 1981\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.194258 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194266 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.194274 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.194282 | controller | \ ]\n logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.194290 | controller | rotation of non API service certificates...\n logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194298 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.194306 | controller | \ logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.194314 | controller | on port 15691...\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194322 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194329 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194337 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:25 2025-10-13 20:41:20.194345 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.194356 | controller | 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.194365 | controller | match the secret.\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.194372 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.194380 | controller | \ logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.194388 | controller | on port 6642...\n logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194396 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:26 2025-10-13 20:41:20.194429 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.194437 | controller | \ logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.194445 | controller | on port 6644 match the secret.\n logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194453 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194465 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.194473 | controller | 20:28:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.194481 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194489 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194497 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.194505 | controller | 20:28:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.194513 | controller | 6643...\n logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194521 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:28 2025-10-13 20:41:20.194528 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.194536 | controller | \ logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.194544 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194563 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.194574 | controller | \ logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.194585 | controller | on port 3000...\n logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194596 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:29 2025-10-13 20:41:20.194607 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.194616 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194624 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194632 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.194640 | controller | 20:28:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.194648 | controller | 15671...\n logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194656 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:30 | 2025-10-13 20:41:20.194664 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.194672 | controller | \ logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.194680 | controller | on port 15691 match the secret.\n logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194688 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.194696 | controller | 20:28:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.194704 | controller | 3306...\n logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194712 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:32 | 2025-10-13 20:41:20.194720 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.194727 | controller | Ports: 3306)\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.194735 | controller | to openstack on port 3306...\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194743 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:32 2025-10-13 20:41:20.194756 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.194779 | controller | \ logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.194787 | controller | on port 1981\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.194795 | controller | on port 1981\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.194803 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194811 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.194819 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.194827 | controller | \ ]\n logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.194835 | controller | rotation of non API service certificates...\n logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194843 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.194850 | controller | \ logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.194858 | controller | on port 15691...\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194866 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194874 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194882 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:34 2025-10-13 20:41:20.194890 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.194898 | controller | 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.194906 | controller | match the secret.\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.194914 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.194922 | controller | \ logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.194930 | controller | on port 6642...\n logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.194948 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:35 2025-10-13 20:41:20.194960 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.194971 | controller | \ logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.194982 | controller | on port 6644 match the secret.\n logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.194992 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195000 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.195013 | controller | 20:28:36 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.195021 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195029 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195037 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.195045 | controller | 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.195057 | controller | 6643...\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195065 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:36 2025-10-13 20:41:20.195073 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.195081 | controller | \ logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.195089 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195097 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.195105 | controller | \ logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.195112 | controller | on port 3000...\n logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195120 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:38 2025-10-13 20:41:20.195128 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.195136 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195144 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195152 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.195160 | controller | 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.195168 | controller | 15671...\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195176 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:38 | 2025-10-13 20:41:20.195184 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.195192 | controller | \ logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.195200 | controller | on port 15691 match the secret.\n logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195208 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.195216 | controller | 20:28:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.195223 | controller | 3306...\n logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195231 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:39 | 2025-10-13 20:41:20.195239 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.195247 | controller | Ports: 3306)\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.195255 | controller | to openstack on port 3306...\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195266 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:40 2025-10-13 20:41:20.195274 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.195282 | controller | \ logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.195290 | controller | on port 1981\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.195298 | controller | on port 1981\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.195306 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195323 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.195335 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.195351 | controller | \ ]\n logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.195362 | controller | rotation of non API service certificates...\n logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195371 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.195379 | controller | \ logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.195387 | controller | on port 15691...\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195399 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195430 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195438 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:42 2025-10-13 20:41:20.195446 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.195454 | controller | 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.195462 | controller | match the secret.\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.195470 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.195478 | controller | \ logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.195486 | controller | on port 6642...\n logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195494 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:43 2025-10-13 20:41:20.195502 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.195510 | controller | \ logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.195518 | controller | on port 6644 match the secret.\n logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195526 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195534 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.195542 | controller | 20:28:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.195550 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195558 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195566 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.195573 | controller | 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.195581 | controller | 6643...\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195589 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:45 2025-10-13 20:41:20.195597 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.195605 | controller | \ logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.195613 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195621 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.195629 | controller | \ logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.195642 | controller | on port 3000...\n logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195657 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:46 2025-10-13 20:41:20.195665 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.195673 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195681 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195689 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.195697 | controller | 20:28:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.195705 | controller | 15671...\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195713 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:47 | 2025-10-13 20:41:20.195731 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.195742 | controller | \ logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.195753 | controller | on port 15691 match the secret.\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195764 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.195775 | controller | 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.195784 | controller | 3306...\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195792 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:48 | 2025-10-13 20:41:20.195800 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.195813 | controller | Ports: 3306)\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.195821 | controller | to openstack on port 3306...\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195829 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:48 2025-10-13 20:41:20.195837 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.195845 | controller | \ logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.195853 | controller | on port 1981\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.195861 | controller | on port 1981\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.195869 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195876 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.195884 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.195892 | controller | \ ]\n logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.195900 | controller | rotation of non API service certificates...\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195908 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.195916 | controller | \ logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.195924 | controller | on port 15691...\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.195932 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195940 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.195952 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:50 2025-10-13 20:41:20.195960 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.195968 | controller | 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.195976 | controller | match the secret.\n logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.195984 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.195992 | controller | \ logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.196000 | controller | on port 6642...\n logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196008 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:51 2025-10-13 20:41:20.196016 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.196024 | controller | \ logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.196031 | controller | on port 6644 match the secret.\n logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196039 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196047 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.196055 | controller | 20:28:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.196063 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196071 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196079 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.196087 | controller | 20:28:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.196105 | controller | 6643...\n logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196116 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:53 2025-10-13 20:41:20.196127 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.196138 | controller | \ logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.196148 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196156 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.196164 | controller | \ logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.196172 | controller | on port 3000...\n logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196180 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:54 2025-10-13 20:41:20.196188 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.196196 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196204 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196212 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.196220 | controller | 20:28:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.196228 | controller | 15671...\n logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196240 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:55 | 2025-10-13 20:41:20.196248 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.196256 | controller | \ logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.196263 | controller | on port 15691 match the secret.\n logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196271 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.196283 | controller | 20:28:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.196291 | controller | 3306...\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196303 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:57 | 2025-10-13 20:41:20.196311 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.196319 | controller | Ports: 3306)\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.196327 | controller | to openstack on port 3306...\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196335 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:57 2025-10-13 20:41:20.196343 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.196351 | controller | \ logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.196359 | controller | on port 1981\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.196367 | controller | on port 1981\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.196375 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196383 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.196395 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.196420 | controller | \ ]\n logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.196432 | controller | rotation of non API service certificates...\n logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196440 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.196448 | controller | \ logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.196456 | controller | on port 15691...\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196465 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196473 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196481 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:00 2025-10-13 20:41:20.196489 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.196497 | controller | 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.196515 | controller | match the secret.\n logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.196526 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.196537 | controller | \ logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.196548 | controller | on port 6642...\n logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196565 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:01 2025-10-13 20:41:20.196573 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.196581 | controller | \ logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.196589 | controller | on port 6644 match the secret.\n logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196597 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196606 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.196614 | controller | 20:29:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.196622 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196630 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196638 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.196646 | controller | 20:29:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.196654 | controller | 6643...\n logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196662 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:03 2025-10-13 20:41:20.196670 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.196678 | controller | \ logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.196686 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196694 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.196702 | controller | \ logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.196710 | controller | on port 3000...\n logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196718 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:05 2025-10-13 20:41:20.196726 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.196734 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196742 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196750 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.196758 | controller | 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.196766 | controller | 15671...\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196774 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:05 | 2025-10-13 20:41:20.196782 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.196795 | controller | \ logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.196803 | controller | on port 15691 match the secret.\n logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196811 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.196819 | controller | 20:29:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.196827 | controller | 3306...\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.196838 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:07 | 2025-10-13 20:41:20.196847 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.196855 | controller | Ports: 3306)\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.196863 | controller | to openstack on port 3306...\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196871 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:07 2025-10-13 20:41:20.196879 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.196897 | controller | \ logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.196908 | controller | on port 1981\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.196919 | controller | on port 1981\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.196931 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:29:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196942 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.196950 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.196958 | controller | \ ]\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.196966 | controller | rotation of non API service certificates...\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.196974 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.196982 | controller | \ logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.196990 | controller | on port 15691...\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197003 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197011 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197019 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:10 2025-10-13 20:41:20.197027 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.197035 | controller | 20:29:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.197043 | controller | match the secret.\n logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.197051 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.197059 | controller | \ logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.197067 | controller | on port 6642...\n logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197075 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:11 2025-10-13 20:41:20.197083 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.197092 | controller | \ logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.197100 | controller | on port 6644 match the secret.\n logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197108 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197116 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.197124 | controller | 20:29:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.197136 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197144 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197152 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.197160 | controller | 20:29:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.197168 | controller | 6643...\n logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197176 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:13 2025-10-13 20:41:20.197184 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.197192 | controller | \ logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.197200 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197208 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.197216 | controller | \ logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.197224 | controller | on port 3000...\n logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197232 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:14 2025-10-13 20:41:20.197240 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.197248 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197256 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197274 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.197286 | controller | 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.197297 | controller | 15671...\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197313 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:15 | 2025-10-13 20:41:20.197322 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.197331 | controller | \ logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.197339 | controller | on port 15691 match the secret.\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197347 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.197355 | controller | 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.197363 | controller | 3306...\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197371 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:16 | 2025-10-13 20:41:20.197379 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.197387 | controller | Ports: 3306)\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.197399 | controller | to openstack on port 3306...\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197429 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:16 2025-10-13 20:41:20.197437 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.197445 | controller | \ logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.197458 | controller | on port 1981\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.197466 | controller | on port 1981\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.197474 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197482 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.197490 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.197498 | controller | \ ]\n logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.197506 | controller | rotation of non API service certificates...\n logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197514 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.197522 | controller | \ logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.197530 | controller | on port 15691...\n logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197538 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197546 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197555 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:18 2025-10-13 20:41:20.197563 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.197571 | controller | 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.197579 | controller | match the secret.\n logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.197587 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.197595 | controller | \ logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.197603 | controller | on port 6642...\n logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197616 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:19 2025-10-13 20:41:20.197624 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.197632 | controller | \ logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.197640 | controller | on port 6644 match the secret.\n logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197648 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197656 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.197664 | controller | 20:29:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.197682 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197694 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197706 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.197717 | controller | 20:29:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.197728 | controller | 6643...\n logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197736 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:21 2025-10-13 20:41:20.197745 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.197773 | controller | \ logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.197781 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197789 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.197818 | controller | \ logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.197829 | controller | on port 3000...\n logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197838 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:23 2025-10-13 20:41:20.197847 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.197856 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197865 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197874 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.197887 | controller | 20:29:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.197896 | controller | 15671...\n logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197905 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:24 | 2025-10-13 20:41:20.197914 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.197923 | controller | \ logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.197932 | controller | on port 15691 match the secret.\n logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.197941 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.197950 | controller | 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.197959 | controller | 3306...\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.197968 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:25 | 2025-10-13 20:41:20.197977 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.197986 | controller | Ports: 3306)\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.197994 | controller | to openstack on port 3306...\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198003 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:25 2025-10-13 20:41:20.198012 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.198021 | controller | \ logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.198030 | controller | on port 1981\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.198039 | controller | on port 1981\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.198048 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198057 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.198065 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.198073 | controller | \ ]\n logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.198084 | controller | rotation of non API service certificates...\n logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198096 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.198104 | controller | \ logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.198112 | controller | on port 15691...\n logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198131 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198143 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198154 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:28 2025-10-13 20:41:20.198165 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.198176 | controller | 20:29:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.198186 | controller | match the secret.\n logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.198196 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.198206 | controller | \ logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.198216 | controller | on port 6642...\n logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198225 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:29 2025-10-13 20:41:20.198233 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.198241 | controller | \ logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.198249 | controller | on port 6644 match the secret.\n logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198257 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198265 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.198273 | controller | 20:29:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.198282 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198295 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198303 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.198311 | controller | 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.198319 | controller | 6643...\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198327 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:30 2025-10-13 20:41:20.198335 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.198343 | controller | \ logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.198351 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198359 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.198368 | controller | \ logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.198376 | controller | on port 3000...\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198384 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:32 2025-10-13 20:41:20.198399 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.198433 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198442 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198450 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.198458 | controller | 20:29:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.198466 | controller | 15671...\n logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198474 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:33 | 2025-10-13 20:41:20.198482 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.198491 | controller | \ logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.198499 | controller | on port 15691 match the secret.\n logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198507 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.198515 | controller | 20:29:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.198523 | controller | 3306...\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198531 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:34 | 2025-10-13 20:41:20.198550 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.198562 | controller | Ports: 3306)\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.198573 | controller | to openstack on port 3306...\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198584 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:34 2025-10-13 20:41:20.198595 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.198605 | controller | \ logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.198613 | controller | on port 1981\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.198621 | controller | on port 1981\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.198629 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198637 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.198645 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.198653 | controller | \ ]\n logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.198661 | controller | rotation of non API service certificates...\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198669 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.198677 | controller | \ logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.198685 | controller | on port 15691...\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198694 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198702 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198710 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:36 2025-10-13 20:41:20.198718 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.198731 | controller | 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.198739 | controller | match the secret.\n logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.198747 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.198755 | controller | \ logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.198763 | controller | on port 6642...\n logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198771 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:37 2025-10-13 20:41:20.198779 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.198787 | controller | \ logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.198795 | controller | on port 6644 match the secret.\n logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198803 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198816 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.198824 | controller | 20:29:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.198832 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198840 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198848 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.198857 | controller | 20:29:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.198865 | controller | 6643...\n logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198873 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:39 2025-10-13 20:41:20.198881 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.198892 | controller | \ logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.198900 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198908 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.198916 | controller | \ logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.198935 | controller | on port 3000...\n logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.198946 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:40 2025-10-13 20:41:20.198957 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.198973 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198983 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.198991 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.198999 | controller | 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.199007 | controller | 15671...\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199015 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:41 | 2025-10-13 20:41:20.199023 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.199035 | controller | \ logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.199043 | controller | on port 15691 match the secret.\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199051 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.199060 | controller | 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.199068 | controller | 3306...\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199076 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:42 | 2025-10-13 20:41:20.199084 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.199092 | controller | Ports: 3306)\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.199101 | controller | to openstack on port 3306...\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199109 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:42 2025-10-13 20:41:20.199117 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.199125 | controller | \ logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.199133 | controller | on port 1981\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.199141 | controller | on port 1981\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.199149 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199157 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.199165 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.199172 | controller | \ ]\n logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.199180 | controller | rotation of non API service certificates...\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199188 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.199196 | controller | \ logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.199204 | controller | on port 15691...\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199212 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199220 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199228 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:44 2025-10-13 20:41:20.199236 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.199244 | controller | 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.199252 | controller | match the secret.\n logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.199260 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.199268 | controller | \ logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.199276 | controller | on port 6642...\n logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199283 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:45 2025-10-13 20:41:20.199291 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.199303 | controller | \ logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.199321 | controller | on port 6644 match the secret.\n logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199332 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199343 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.199354 | controller | 20:29:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.199364 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199373 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199381 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.199389 | controller | 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.199418 | controller | 6643...\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199435 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:47 2025-10-13 20:41:20.199443 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.199451 | controller | \ logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.199459 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199467 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.199475 | controller | \ logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.199483 | controller | on port 3000...\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199491 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:49 2025-10-13 20:41:20.199499 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.199507 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199515 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199523 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.199531 | controller | 20:29:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.199539 | controller | 15671...\n logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199546 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:50 | 2025-10-13 20:41:20.199554 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.199562 | controller | \ logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.199570 | controller | on port 15691 match the secret.\n logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199578 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.199586 | controller | 20:29:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.199594 | controller | 3306...\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199602 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:51 | 2025-10-13 20:41:20.199610 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.199623 | controller | Ports: 3306)\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.199631 | controller | to openstack on port 3306...\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199639 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:51 2025-10-13 20:41:20.199646 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.199654 | controller | \ logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.199662 | controller | on port 1981\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.199670 | controller | on port 1981\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.199678 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199693 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.199701 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.199709 | controller | \ ]\n logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.199728 | controller | rotation of non API service certificates...\n logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199739 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.199750 | controller | \ logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.199760 | controller | on port 15691...\n logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199771 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199781 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199789 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:53 2025-10-13 20:41:20.199797 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.199805 | controller | 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.199813 | controller | match the secret.\n logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.199821 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.199829 | controller | \ logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.199837 | controller | on port 6642...\n logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199844 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:54 2025-10-13 20:41:20.199852 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.199860 | controller | \ logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.199868 | controller | on port 6644 match the secret.\n logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199876 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199884 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.199892 | controller | 20:29:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.199900 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199908 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199920 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.199932 | controller | 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.199940 | controller | 6643...\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.199948 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:56 2025-10-13 20:41:20.199956 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.199964 | controller | \ logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.199972 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.199980 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.199988 | controller | \ logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.199996 | controller | on port 3000...\n logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200003 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:58 2025-10-13 20:41:20.200011 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.200019 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200027 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200035 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.200043 | controller | 20:29:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.200051 | controller | 15671...\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200059 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:59 | 2025-10-13 20:41:20.200067 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.200074 | controller | \ logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.200082 | controller | on port 15691 match the secret.\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200100 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.200111 | controller | 20:29:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.200122 | controller | 3306...\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200133 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:00 | 2025-10-13 20:41:20.200143 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.200154 | controller | Ports: 3306)\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.200164 | controller | to openstack on port 3306...\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200173 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:00 2025-10-13 20:41:20.200183 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.200192 | controller | \ logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.200200 | controller | on port 1981\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.200208 | controller | on port 1981\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.200216 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200228 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.200237 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.200245 | controller | \ ]\n logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.200252 | controller | rotation of non API service certificates...\n logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200260 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.200268 | controller | \ logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.200276 | controller | on port 15691...\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200284 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200292 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200305 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:02 2025-10-13 20:41:20.200313 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.200321 | controller | 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.200329 | controller | match the secret.\n logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.200337 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.200345 | controller | \ logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.200353 | controller | on port 6642...\n logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200361 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:03 2025-10-13 20:41:20.200373 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.200381 | controller | \ logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.200389 | controller | on port 6644 match the secret.\n logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200418 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200431 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.200439 | controller | 20:30:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.200447 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200455 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200463 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.200471 | controller | 20:30:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.200479 | controller | 6643...\n logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200488 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:05 2025-10-13 20:41:20.200496 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.200514 | controller | \ logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.200526 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200542 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.200554 | controller | \ logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.200564 | controller | on port 3000...\n logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200575 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:07 2025-10-13 20:41:20.200585 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.200595 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200604 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200612 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.200621 | controller | 20:30:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.200629 | controller | 15671...\n logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200637 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:08 | 2025-10-13 20:41:20.200645 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.200653 | controller | \ logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.200661 | controller | on port 15691 match the secret.\n logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200669 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.200677 | controller | 20:30:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.200685 | controller | 3306...\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200693 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:09 | 2025-10-13 20:41:20.200701 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.200709 | controller | Ports: 3306)\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.200717 | controller | to openstack on port 3306...\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200725 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:09 2025-10-13 20:41:20.200733 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.200741 | controller | \ logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.200749 | controller | on port 1981\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.200757 | controller | on port 1981\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.200765 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200773 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.200781 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.200789 | controller | \ ]\n logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.200797 | controller | rotation of non API service certificates...\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200805 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.200813 | controller | \ logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.200822 | controller | on port 15691...\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200834 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200842 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200850 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:11 2025-10-13 20:41:20.200858 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.200866 | controller | 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.200874 | controller | match the secret.\n logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.200886 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.200905 | controller | \ logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.200916 | controller | on port 6642...\n logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.200927 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:12 2025-10-13 20:41:20.200938 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.200949 | controller | \ logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.200959 | controller | on port 6644 match the secret.\n logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200972 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.200980 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.200988 | controller | 20:30:13 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.200996 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201005 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201013 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.201021 | controller | 20:30:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.201029 | controller | 6643...\n logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201037 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:14 2025-10-13 20:41:20.201045 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.201053 | controller | \ logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.201061 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201069 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.201077 | controller | \ logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.201085 | controller | on port 3000...\n logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201093 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:15 2025-10-13 20:41:20.201101 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.201109 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201117 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201129 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.201137 | controller | 20:30:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.201145 | controller | 15671...\n logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201153 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:16 | 2025-10-13 20:41:20.201161 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.201169 | controller | \ logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.201177 | controller | on port 15691 match the secret.\n logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201185 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.201193 | controller | 20:30:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.201201 | controller | 3306...\n logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201209 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:17 | 2025-10-13 20:41:20.201217 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.201225 | controller | Ports: 3306)\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.201233 | controller | to openstack on port 3306...\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201240 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:18 2025-10-13 20:41:20.201248 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.201256 | controller | \ logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.201264 | controller | on port 1981\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.201282 | controller | on port 1981\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.201293 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201305 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.201315 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.201325 | controller | \ ]\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.201333 | controller | rotation of non API service certificates...\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201341 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.201349 | controller | \ logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.201357 | controller | on port 15691...\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201365 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201373 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201381 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:20 2025-10-13 20:41:20.201397 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.201427 | controller | 20:30:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.201435 | controller | match the secret.\n logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.201443 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.201455 | controller | \ logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.201463 | controller | on port 6642...\n logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201471 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:21 2025-10-13 20:41:20.201479 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.201487 | controller | \ logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.201495 | controller | on port 6644 match the secret.\n logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201503 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201511 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.201519 | controller | 20:30:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.201527 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201535 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201543 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.201551 | controller | 20:30:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.201559 | controller | 6643...\n logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201566 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:23 2025-10-13 20:41:20.201574 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.201582 | controller | \ logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.201590 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201602 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.201610 | controller | \ logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.201618 | controller | on port 3000...\n logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201625 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:25 2025-10-13 20:41:20.201633 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.201642 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201649 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201657 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.201666 | controller | 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.201684 | controller | 15671...\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201696 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:25 | 2025-10-13 20:41:20.201707 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.201718 | controller | \ logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.201728 | controller | on port 15691 match the secret.\n logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201736 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.201750 | controller | 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.201758 | controller | 3306...\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201767 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:27 | 2025-10-13 20:41:20.201775 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.201783 | controller | Ports: 3306)\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.201791 | controller | to openstack on port 3306...\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201799 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:27 2025-10-13 20:41:20.201807 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.201815 | controller | \ logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.201823 | controller | on port 1981\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.201853 | controller | on port 1981\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.201864 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201873 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.201882 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.201891 | controller | \ ]\n logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.201900 | controller | rotation of non API service certificates...\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201909 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.201928 | controller | \ logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.201937 | controller | on port 15691...\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.201946 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201955 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.201964 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:29 2025-10-13 20:41:20.201973 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.201982 | controller | 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.201991 | controller | match the secret.\n logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.202000 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.202009 | controller | \ logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.202018 | controller | on port 6642...\n logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202027 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:30 2025-10-13 20:41:20.202036 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.202044 | controller | \ logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.202053 | controller | on port 6644 match the secret.\n logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202062 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202076 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.202085 | controller | 20:30:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.202094 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202102 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202120 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.202131 | controller | 20:30:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.202143 | controller | 6643...\n logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202153 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:32 2025-10-13 20:41:20.202163 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.202174 | controller | \ logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.202183 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202194 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.202202 | controller | \ logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.202210 | controller | on port 3000...\n logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202218 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:33 2025-10-13 20:41:20.202226 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.202234 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202242 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202250 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.202258 | controller | 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.202266 | controller | 15671...\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202274 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:34 | 2025-10-13 20:41:20.202282 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.202290 | controller | \ logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.202298 | controller | on port 15691 match the secret.\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202312 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.202320 | controller | 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.202328 | controller | 3306...\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202336 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:35 | 2025-10-13 20:41:20.202344 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.202352 | controller | Ports: 3306)\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.202360 | controller | to openstack on port 3306...\n logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202368 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:36 2025-10-13 20:41:20.202380 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.202388 | controller | \ logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.202420 | controller | on port 1981\n logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.202438 | controller | on port 1981\n logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.202449 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202459 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.202469 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.202486 | controller | \ ]\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.202496 | controller | rotation of non API service certificates...\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202504 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.202512 | controller | \ logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.202520 | controller | on port 15691...\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202528 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202536 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202544 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:38 2025-10-13 20:41:20.202564 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.202576 | controller | 20:30:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.202587 | controller | match the secret.\n logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.202597 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.202608 | controller | \ logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.202618 | controller | on port 6642...\n logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202628 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:39 2025-10-13 20:41:20.202639 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.202649 | controller | \ logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.202658 | controller | on port 6644 match the secret.\n logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202666 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202674 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.202682 | controller | 20:30:40 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.202690 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202698 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202706 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.202714 | controller | 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.202722 | controller | 6643...\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202735 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:40 2025-10-13 20:41:20.202743 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.202751 | controller | \ logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.202759 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202767 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.202775 | controller | \ logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.202783 | controller | on port 3000...\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202791 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:42 2025-10-13 20:41:20.202799 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.202807 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202815 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202822 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.202830 | controller | 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.202838 | controller | 15671...\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202846 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:42 | 2025-10-13 20:41:20.202858 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.202866 | controller | \ logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.202874 | controller | on port 15691 match the secret.\n logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202882 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.202890 | controller | 20:30:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.202898 | controller | 3306...\n logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.202906 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:44 | 2025-10-13 20:41:20.202914 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.202922 | controller | Ports: 3306)\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.202930 | controller | to openstack on port 3306...\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.202948 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:44 2025-10-13 20:41:20.202960 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.202971 | controller | \ logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.202986 | controller | on port 1981\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.202997 | controller | on port 1981\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.203005 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203013 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.203021 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.203033 | controller | \ ]\n logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.203041 | controller | rotation of non API service certificates...\n logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203052 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.203060 | controller | \ logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.203068 | controller | on port 15691...\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203076 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203084 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203092 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:46 2025-10-13 20:41:20.203100 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.203108 | controller | 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.203116 | controller | match the secret.\n logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.203124 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.203132 | controller | \ logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.203139 | controller | on port 6642...\n logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203147 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:47 2025-10-13 20:41:20.203155 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.203163 | controller | \ logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.203171 | controller | on port 6644 match the secret.\n logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203179 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203187 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.203195 | controller | 20:30:48 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.203203 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203211 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203222 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.203230 | controller | 20:30:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.203238 | controller | 6643...\n logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203246 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:49 2025-10-13 20:41:20.203254 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.203262 | controller | \ logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.203270 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203278 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.203285 | controller | \ logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.203293 | controller | on port 3000...\n logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203305 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:50 2025-10-13 20:41:20.203313 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.203331 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203342 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203353 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.203364 | controller | 20:30:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.203374 | controller | 15671...\n logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203382 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:51 | 2025-10-13 20:41:20.203390 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.203419 | controller | \ logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.203431 | controller | on port 15691 match the secret.\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203439 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.203447 | controller | 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.203455 | controller | 3306...\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203463 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:52 | 2025-10-13 20:41:20.203471 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.203479 | controller | Ports: 3306)\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.203487 | controller | to openstack on port 3306...\n logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203495 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:53 2025-10-13 20:41:20.203508 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.203516 | controller | \ logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.203524 | controller | on port 1981\n logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.203532 | controller | on port 1981\n logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.203539 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203547 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.203555 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.203563 | controller | \ ]\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.203571 | controller | rotation of non API service certificates...\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203579 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.203587 | controller | \ logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.203595 | controller | on port 15691...\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203603 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203611 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203623 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:55 2025-10-13 20:41:20.203631 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.203639 | controller | 20:30:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.203647 | controller | match the secret.\n logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.203655 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.203663 | controller | \ logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.203675 | controller | on port 6642...\n logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203683 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:56 2025-10-13 20:41:20.203691 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.203699 | controller | \ logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.203707 | controller | on port 6644 match the secret.\n logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203715 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203734 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.203745 | controller | 20:30:57 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.203757 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203767 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203779 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.203787 | controller | 20:30:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.203795 | controller | 6643...\n logger.go:42: 20:30:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203804 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:58 2025-10-13 20:41:20.203812 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.203820 | controller | \ logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.203828 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203836 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.203844 | controller | \ logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.203852 | controller | on port 3000...\n logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203860 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:00 2025-10-13 20:41:20.203868 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.203876 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203884 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203892 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.203900 | controller | 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.203908 | controller | 15671...\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203925 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:00 | 2025-10-13 20:41:20.203933 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.203941 | controller | \ logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.203949 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.203957 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.203965 | controller | 20:31:01 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.203973 | controller | 3306...\n logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.203981 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:02 | 2025-10-13 20:41:20.203989 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.203998 | controller | Ports: 3306)\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.204010 | controller | to openstack on port 3306...\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204018 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:02 2025-10-13 20:41:20.204026 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.204034 | controller | \ logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.204042 | controller | on port 1981\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.204050 | controller | on port 1981\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.204058 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204066 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.204074 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.204082 | controller | \ ]\n logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.204090 | controller | rotation of non API service certificates...\n logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204098 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.204116 | controller | \ logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.204128 | controller | on port 15691...\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204139 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204150 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204161 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:04 2025-10-13 20:41:20.204170 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.204178 | controller | 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.204186 | controller | match the secret.\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.204194 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.204202 | controller | \ logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.204210 | controller | on port 6642...\n logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204222 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:05 2025-10-13 20:41:20.204230 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.204238 | controller | \ logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.204246 | controller | on port 6644 match the secret.\n logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204255 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204263 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.204271 | controller | 20:31:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.204283 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204291 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204299 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.204307 | controller | 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.204315 | controller | 6643...\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204323 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:06 2025-10-13 20:41:20.204332 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.204340 | controller | \ logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.204348 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204356 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.204364 | controller | \ logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.204372 | controller | on port 3000...\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204380 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:08 2025-10-13 20:41:20.204388 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.204416 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204429 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204437 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.204445 | controller | 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.204453 | controller | 15671...\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204462 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:08 | 2025-10-13 20:41:20.204470 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.204478 | controller | \ logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.204486 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204494 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.204502 | controller | 20:31:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.204520 | controller | 3306...\n logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204537 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:10 | 2025-10-13 20:41:20.204553 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.204564 | controller | Ports: 3306)\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.204574 | controller | to openstack on port 3306...\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204582 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:10 2025-10-13 20:41:20.204590 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.204598 | controller | \ logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.204606 | controller | on port 1981\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.204614 | controller | on port 1981\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.204622 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204630 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.204638 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.204646 | controller | \ ]\n logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.204654 | controller | rotation of non API service certificates...\n logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204662 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.204671 | controller | \ logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.204679 | controller | on port 15691...\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204687 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204695 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204703 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:12 2025-10-13 20:41:20.204711 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.204719 | controller | 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.204727 | controller | match the secret.\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.204735 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.204743 | controller | \ logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.204751 | controller | on port 6642...\n logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204759 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:13 2025-10-13 20:41:20.204767 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.204775 | controller | \ logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.204783 | controller | on port 6644 match the secret.\n logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204792 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204800 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.204808 | controller | 20:31:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.204820 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204828 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204836 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.204844 | controller | 20:31:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.204852 | controller | 6643...\n logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204860 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:15 2025-10-13 20:41:20.204868 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.204876 | controller | \ logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.204884 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204903 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.204914 | controller | \ logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.204925 | controller | on port 3000...\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.204942 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:16 2025-10-13 20:41:20.204952 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.204960 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204968 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.204976 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.204984 | controller | 20:31:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.204992 | controller | 15671...\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205000 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:17 | 2025-10-13 20:41:20.205008 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.205017 | controller | \ logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.205025 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205033 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.205041 | controller | 20:31:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.205053 | controller | 3306...\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205061 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:18 | 2025-10-13 20:41:20.205069 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.205077 | controller | Ports: 3306)\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.205085 | controller | to openstack on port 3306...\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205093 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:18 2025-10-13 20:41:20.205101 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.205109 | controller | \ logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.205122 | controller | on port 1981\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.205130 | controller | on port 1981\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.205138 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205146 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.205154 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.205162 | controller | \ ]\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.205170 | controller | rotation of non API service certificates...\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205178 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.205186 | controller | \ logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.205194 | controller | on port 15691...\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205202 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205210 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205218 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:20 2025-10-13 20:41:20.205226 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.205234 | controller | 20:31:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.205242 | controller | match the secret.\n logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.205250 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.205258 | controller | \ logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.205267 | controller | on port 6642...\n logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205275 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:21 2025-10-13 20:41:20.205292 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.205304 | controller | \ logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.205315 | controller | on port 6644 match the secret.\n logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205326 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205337 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.205345 | controller | 20:31:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.205353 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205362 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205370 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.205378 | controller | 20:31:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.205386 | controller | 6643...\n logger.go:42: 20:31:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205398 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:23 2025-10-13 20:41:20.205427 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.205440 | controller | \ logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.205448 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205456 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.205464 | controller | \ logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.205472 | controller | on port 3000...\n logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205480 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:24 2025-10-13 20:41:20.205488 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.205496 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205504 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205512 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.205521 | controller | 20:31:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.205529 | controller | 15671...\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205537 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:26 | 2025-10-13 20:41:20.205549 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.205557 | controller | \ logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.205565 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205573 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.205581 | controller | 20:31:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.205589 | controller | 3306...\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205597 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:27 | 2025-10-13 20:41:20.205605 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.205613 | controller | Ports: 3306)\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.205622 | controller | to openstack on port 3306...\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205630 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:27 2025-10-13 20:41:20.205638 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.205646 | controller | \ logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.205654 | controller | on port 1981\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.205665 | controller | on port 1981\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.205673 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205681 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.205700 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.205711 | controller | \ ]\n logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.205723 | controller | rotation of non API service certificates...\n logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205739 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.205749 | controller | \ logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.205757 | controller | on port 15691...\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205765 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205773 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205781 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:29 2025-10-13 20:41:20.205790 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.205798 | controller | 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.205806 | controller | match the secret.\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.205814 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.205822 | controller | \ logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.205830 | controller | on port 6642...\n logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205838 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:30 2025-10-13 20:41:20.205846 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.205854 | controller | \ logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.205862 | controller | on port 6644 match the secret.\n logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205898 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205907 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.205917 | controller | 20:31:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.205926 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205935 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.205944 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.205953 | controller | 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.205962 | controller | 6643...\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.205971 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:31 2025-10-13 20:41:20.205980 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.205989 | controller | \ logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.205998 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206007 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.206016 | controller | \ logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.206025 | controller | on port 3000...\n logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206033 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:33 2025-10-13 20:41:20.206042 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.206055 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206064 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206073 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.206082 | controller | 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.206100 | controller | 15671...\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206109 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:33 | 2025-10-13 20:41:20.206118 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.206138 | controller | \ logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.206150 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206161 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.206172 | controller | 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.206183 | controller | 3306...\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206193 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:34 | 2025-10-13 20:41:20.206201 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.206209 | controller | Ports: 3306)\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.206217 | controller | to openstack on port 3306...\n logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206225 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:35 2025-10-13 20:41:20.206233 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.206241 | controller | \ logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.206249 | controller | on port 1981\n logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.206257 | controller | on port 1981\n logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.206265 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206273 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.206281 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.206289 | controller | \ ]\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.206297 | controller | rotation of non API service certificates...\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206305 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.206313 | controller | \ logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.206321 | controller | on port 15691...\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206329 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206342 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206350 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:37 2025-10-13 20:41:20.206358 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.206378 | controller | 20:31:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.206386 | controller | match the secret.\n logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.206394 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.206426 | controller | \ logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.206435 | controller | on port 6642...\n logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206443 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:38 2025-10-13 20:41:20.206451 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.206459 | controller | \ logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.206467 | controller | on port 6644 match the secret.\n logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206475 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206483 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.206491 | controller | 20:31:39 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.206499 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206507 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206516 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.206524 | controller | 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.206532 | controller | 6643...\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206551 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:39 2025-10-13 20:41:20.206563 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.206574 | controller | \ logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.206585 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206596 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.206605 | controller | \ logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.206613 | controller | on port 3000...\n logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206621 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:41 2025-10-13 20:41:20.206629 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.206638 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206651 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206659 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.206667 | controller | 20:31:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.206675 | controller | 15671...\n logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206683 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:42 | 2025-10-13 20:41:20.206691 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.206703 | controller | \ logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.206711 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206719 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.206727 | controller | 20:31:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.206735 | controller | 3306...\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206743 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:43 | 2025-10-13 20:41:20.206751 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.206759 | controller | Ports: 3306)\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.206767 | controller | to openstack on port 3306...\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206775 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:43 2025-10-13 20:41:20.206783 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.206792 | controller | \ logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.206800 | controller | on port 1981\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.206808 | controller | on port 1981\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.206816 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206824 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.206832 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.206840 | controller | \ ]\n logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.206848 | controller | rotation of non API service certificates...\n logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206856 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.206864 | controller | \ logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.206872 | controller | on port 15691...\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206880 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206888 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.206896 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:45 2025-10-13 20:41:20.206904 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.206912 | controller | 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.206931 | controller | match the secret.\n logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.206943 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.206954 | controller | \ logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.206964 | controller | on port 6642...\n logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.206975 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:46 2025-10-13 20:41:20.206984 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.206992 | controller | \ logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.207007 | controller | on port 6644 match the secret.\n logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207016 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207024 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.207031 | controller | 20:31:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.207039 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207048 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207055 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.207063 | controller | 20:31:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.207071 | controller | 6643...\n logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207079 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:48 2025-10-13 20:41:20.207087 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.207095 | controller | \ logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.207103 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207111 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.207123 | controller | \ logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.207131 | controller | on port 3000...\n logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207139 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:49 2025-10-13 20:41:20.207147 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.207155 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207163 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207171 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.207179 | controller | 20:31:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.207186 | controller | 15671...\n logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207194 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:50 | 2025-10-13 20:41:20.207202 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.207210 | controller | \ logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.207218 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207226 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.207234 | controller | 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.207242 | controller | 3306...\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207250 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:51 | 2025-10-13 20:41:20.207258 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.207269 | controller | Ports: 3306)\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.207277 | controller | to openstack on port 3306...\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207285 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:51 2025-10-13 20:41:20.207293 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.207311 | controller | \ logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.207323 | controller | on port 1981\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.207334 | controller | on port 1981\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.207345 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207355 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.207363 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.207371 | controller | \ ]\n logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.207379 | controller | rotation of non API service certificates...\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207387 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.207399 | controller | \ logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.207427 | controller | on port 15691...\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207435 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207443 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207451 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:53 2025-10-13 20:41:20.207459 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.207467 | controller | 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.207475 | controller | match the secret.\n logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.207483 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.207491 | controller | \ logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.207499 | controller | on port 6642...\n logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207507 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:54 2025-10-13 20:41:20.207515 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.207523 | controller | \ logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.207531 | controller | on port 6644 match the secret.\n logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207539 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207547 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.207555 | controller | 20:31:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.207563 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207575 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207587 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.207596 | controller | 20:31:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.207604 | controller | 6643...\n logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207612 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:56 2025-10-13 20:41:20.207623 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.207631 | controller | \ logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.207642 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207650 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.207658 | controller | \ logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.207666 | controller | on port 3000...\n logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207674 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:57 2025-10-13 20:41:20.207682 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.207690 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207698 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207719 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.207731 | controller | 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.207742 | controller | 15671...\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207753 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:58 | 2025-10-13 20:41:20.207764 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.207772 | controller | \ logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.207781 | controller | on port 15691 match the secret.\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207789 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.207796 | controller | 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.207804 | controller | 3306...\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207812 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:59 | 2025-10-13 20:41:20.207820 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.207828 | controller | Ports: 3306)\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.207836 | controller | to openstack on port 3306...\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207844 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:59 2025-10-13 20:41:20.207852 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.207860 | controller | \ logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.207868 | controller | on port 1981\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.207875 | controller | on port 1981\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.207883 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207896 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.207904 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.207912 | controller | \ ]\n logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.207920 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207927 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.207935 | controller | \ logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.207943 | controller | on port 15691...\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.207951 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207959 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.207967 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:01 2025-10-13 20:41:20.207975 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.207983 | controller | 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.207991 | controller | match the secret.\n logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.207999 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.208007 | controller | \ logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.208014 | controller | on port 6642...\n logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208022 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:02 2025-10-13 20:41:20.208030 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.208038 | controller | \ logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.208046 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208054 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208062 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.208070 | controller | 20:32:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.208088 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208099 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208110 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.208121 | controller | 20:32:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.208139 | controller | 6643...\n logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208148 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:04 2025-10-13 20:41:20.208156 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.208164 | controller | \ logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.208171 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208183 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.208191 | controller | \ logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.208199 | controller | on port 3000...\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208207 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:05 2025-10-13 20:41:20.208215 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.208223 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208231 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208239 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.208247 | controller | 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.208255 | controller | 15671...\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208263 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:05 | 2025-10-13 20:41:20.208271 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.208279 | controller | \ logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.208290 | controller | on port 15691 match the secret.\n logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208298 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.208306 | controller | 20:32:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.208314 | controller | 3306...\n logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208322 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:06 | 2025-10-13 20:41:20.208330 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.208338 | controller | Ports: 3306)\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.208346 | controller | to openstack on port 3306...\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208353 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:07 2025-10-13 20:41:20.208361 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.208369 | controller | \ logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.208377 | controller | on port 1981\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.208385 | controller | on port 1981\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.208397 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208433 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.208445 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.208453 | controller | \ ]\n logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.208461 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208469 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.208477 | controller | \ logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.208485 | controller | on port 15691...\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208498 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208516 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208528 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:09 2025-10-13 20:41:20.208539 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.208550 | controller | 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.208560 | controller | match the secret.\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.208570 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.208578 | controller | \ logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.208586 | controller | on port 6642...\n logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208594 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:10 2025-10-13 20:41:20.208602 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.208615 | controller | \ logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.208623 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208631 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208639 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.208647 | controller | 20:32:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.208655 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208663 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208671 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.208679 | controller | 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.208687 | controller | 6643...\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208695 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:11 2025-10-13 20:41:20.208703 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.208711 | controller | \ logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.208719 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208727 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.208735 | controller | \ logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.208743 | controller | on port 3000...\n logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208751 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:13 2025-10-13 20:41:20.208758 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.208766 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208774 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208787 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.208795 | controller | 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.208803 | controller | 15671...\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208811 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:13 | 2025-10-13 20:41:20.208819 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.208827 | controller | \ logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.208835 | controller | on port 15691 match the secret.\n logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208843 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.208851 | controller | 20:32:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.208859 | controller | 3306...\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.208867 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:15 | 2025-10-13 20:41:20.208875 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.208893 | controller | Ports: 3306)\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.208904 | controller | to openstack on port 3306...\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208915 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:15 2025-10-13 20:41:20.208925 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.208936 | controller | \ logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.208944 | controller | on port 1981\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.208952 | controller | on port 1981\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.208960 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.208968 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.208980 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.208988 | controller | \ ]\n logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.208996 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209004 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.209012 | controller | \ logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.209020 | controller | on port 15691...\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209027 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209035 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209043 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:17 2025-10-13 20:41:20.209051 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.209059 | controller | 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.209067 | controller | match the secret.\n logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.209075 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.209091 | controller | \ logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.209099 | controller | on port 6642...\n logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209106 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:18 2025-10-13 20:41:20.209114 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.209122 | controller | \ logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.209130 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209138 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209146 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.209154 | controller | 20:32:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.209162 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209170 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209178 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.209186 | controller | 20:32:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.209194 | controller | 6643...\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209202 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:20 2025-10-13 20:41:20.209210 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.209218 | controller | \ logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.209226 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209234 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.209241 | controller | \ logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.209249 | controller | on port 3000...\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209267 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:21 2025-10-13 20:41:20.209278 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.209289 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209300 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209310 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.209318 | controller | 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.209326 | controller | 15671...\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209334 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:22 | 2025-10-13 20:41:20.209342 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.209350 | controller | \ logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.209358 | controller | on port 15691 match the secret.\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209366 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.209378 | controller | 20:32:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.209386 | controller | 3306...\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209398 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:23 | 2025-10-13 20:41:20.209427 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.209435 | controller | Ports: 3306)\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.209443 | controller | to openstack on port 3306...\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209451 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:23 2025-10-13 20:41:20.209459 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.209467 | controller | \ logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.209475 | controller | on port 1981\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.209483 | controller | on port 1981\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.209491 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209499 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.209507 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.209515 | controller | \ ]\n logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.209523 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209531 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.209539 | controller | \ logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.209546 | controller | on port 15691...\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209554 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209562 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209570 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:25 2025-10-13 20:41:20.209578 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.209592 | controller | 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.209603 | controller | match the secret.\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.209611 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.209619 | controller | \ logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.209627 | controller | on port 6642...\n logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209635 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:26 2025-10-13 20:41:20.209643 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.209651 | controller | \ logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.209669 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209680 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209696 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.209707 | controller | 20:32:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.209717 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209725 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209733 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.209741 | controller | 20:32:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.209749 | controller | 6643...\n logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209757 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:28 2025-10-13 20:41:20.209764 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.209772 | controller | \ logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.209780 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209788 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.209796 | controller | \ logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.209804 | controller | on port 3000...\n logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209812 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:29 2025-10-13 20:41:20.209820 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.209828 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209836 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209843 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.209851 | controller | 20:32:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.209859 | controller | 15671...\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209867 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:30 | 2025-10-13 20:41:20.209875 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.209883 | controller | \ logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.209891 | controller | on port 15691 match the secret.\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209903 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.209943 | controller | 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.209951 | controller | 3306...\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.209959 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:31 | 2025-10-13 20:41:20.209967 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.209975 | controller | Ports: 3306)\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.209983 | controller | to openstack on port 3306...\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.209991 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:31 2025-10-13 20:41:20.210004 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.210011 | controller | \ logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.210019 | controller | on port 1981\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.210027 | controller | on port 1981\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.210035 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210043 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.210051 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.210059 | controller | \ ]\n logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.210082 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210093 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.210104 | controller | \ logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.210115 | controller | on port 15691...\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210126 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210135 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210143 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:33 2025-10-13 20:41:20.210151 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.210159 | controller | 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.210167 | controller | match the secret.\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.210175 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.210183 | controller | \ logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.210191 | controller | on port 6642...\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210198 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:34 2025-10-13 20:41:20.210206 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.210214 | controller | \ logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.210222 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210230 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210238 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.210254 | controller | 20:32:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.210263 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210271 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210279 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.210287 | controller | 20:32:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.210295 | controller | 6643...\n logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210306 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:36 2025-10-13 20:41:20.210314 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.210322 | controller | \ logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.210330 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210338 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.210346 | controller | \ logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.210354 | controller | on port 3000...\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210362 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:37 2025-10-13 20:41:20.210370 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.210378 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210386 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210394 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.210426 | controller | 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.210435 | controller | 15671...\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210443 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:37 | 2025-10-13 20:41:20.210451 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.210458 | controller | \ logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.210466 | controller | on port 15691 match the secret.\n logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210485 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.210496 | controller | 20:32:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.210507 | controller | 3306...\n logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210518 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:38 | 2025-10-13 20:41:20.210529 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.210538 | controller | Ports: 3306)\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.210546 | controller | to openstack on port 3306...\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210554 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:39 2025-10-13 20:41:20.210562 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.210570 | controller | \ logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.210578 | controller | on port 1981\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.210586 | controller | on port 1981\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.210594 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210601 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.210609 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.210622 | controller | \ ]\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.210634 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210642 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.210650 | controller | \ logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.210658 | controller | on port 15691...\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210666 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210674 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210682 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:41 2025-10-13 20:41:20.210690 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.210698 | controller | 20:32:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.210705 | controller | match the secret.\n logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.210713 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.210721 | controller | \ logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.210729 | controller | on port 6642...\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210737 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:42 2025-10-13 20:41:20.210745 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.210753 | controller | \ logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.210761 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210769 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210777 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.210785 | controller | 20:32:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.210793 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210801 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210809 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.210816 | controller | 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.210824 | controller | 6643...\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210832 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:43 2025-10-13 20:41:20.210840 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.210858 | controller | \ logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.210870 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210881 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.210892 | controller | \ logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.210906 | controller | on port 3000...\n logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210918 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:44 2025-10-13 20:41:20.210926 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.210934 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210942 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210950 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.210958 | controller | 20:32:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.210965 | controller | 15671...\n logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.210971 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:45 | 2025-10-13 20:41:20.210977 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.210983 | controller | \ logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.210988 | controller | on port 15691 match the secret.\n logger.go:42: 20:32:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.210994 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.211000 | controller | 20:32:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.211005 | controller | 3306...\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211011 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:47 | 2025-10-13 20:41:20.211017 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.211023 | controller | Ports: 3306)\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.211028 | controller | to openstack on port 3306...\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211034 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:47 2025-10-13 20:41:20.211040 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.211045 | controller | \ logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.211051 | controller | on port 1981\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.211057 | controller | on port 1981\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.211065 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211071 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.211076 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.211082 | controller | \ ]\n logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.211088 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211093 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.211099 | controller | \ logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.211105 | controller | on port 15691...\n logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211111 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211116 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211125 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:50 2025-10-13 20:41:20.211131 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.211136 | controller | 20:32:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.211142 | controller | match the secret.\n logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.211148 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.211154 | controller | \ logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.211167 | controller | on port 6642...\n logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211175 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:51 2025-10-13 20:41:20.211183 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.211191 | controller | \ logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.211198 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211204 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211210 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.211215 | controller | 20:32:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.211221 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211227 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211232 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.211238 | controller | 20:32:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.211244 | controller | 6643...\n logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211249 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:53 2025-10-13 20:41:20.211255 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.211261 | controller | \ logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.211267 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211272 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.211278 | controller | \ logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.211284 | controller | on port 3000...\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211289 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:54 2025-10-13 20:41:20.211295 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.211301 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211306 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211312 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.211318 | controller | 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.211323 | controller | 15671...\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211336 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:54 | 2025-10-13 20:41:20.211341 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.211347 | controller | \ logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.211353 | controller | on port 15691 match the secret.\n logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211358 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.211367 | controller | 20:32:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.211373 | controller | 3306...\n logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211379 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:56 | 2025-10-13 20:41:20.211384 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.211390 | controller | Ports: 3306)\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.211399 | controller | to openstack on port 3306...\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211420 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:56 2025-10-13 20:41:20.211426 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.211434 | controller | \ logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.211440 | controller | on port 1981\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.211446 | controller | on port 1981\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.211459 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211467 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.211475 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.211483 | controller | \ ]\n logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.211491 | controller | rotation of non API service certificates...\n logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211497 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.211503 | controller | \ logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.211508 | controller | on port 15691...\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211514 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211520 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211525 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:58 2025-10-13 20:41:20.211531 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.211537 | controller | 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.211542 | controller | match the secret.\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.211548 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.211554 | controller | \ logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.211560 | controller | on port 6642...\n logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211569 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:59 2025-10-13 20:41:20.211574 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.211580 | controller | \ logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.211586 | controller | on port 6644 match the secret.\n logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211592 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211597 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.211603 | controller | 20:33:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.211609 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211614 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211620 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.211626 | controller | 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.211631 | controller | 6643...\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211637 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:00 2025-10-13 20:41:20.211643 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.211649 | controller | \ logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.211654 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211660 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.211666 | controller | \ logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.211671 | controller | on port 3000...\n logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211677 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:02 2025-10-13 20:41:20.211683 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.211688 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211694 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211700 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.211706 | controller | 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.211711 | controller | 15671...\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211724 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:02 | 2025-10-13 20:41:20.211732 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.211740 | controller | \ logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.211748 | controller | on port 15691 match the secret.\n logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211755 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.211761 | controller | 20:33:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.211766 | controller | 3306...\n logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211775 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:04 | 2025-10-13 20:41:20.211781 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.211787 | controller | Ports: 3306)\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.211792 | controller | to openstack on port 3306...\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211801 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:04 2025-10-13 20:41:20.211807 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.211813 | controller | \ logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.211818 | controller | on port 1981\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.211824 | controller | on port 1981\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.211830 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211836 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.211841 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.211847 | controller | \ ]\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.211853 | controller | rotation of non API service certificates...\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211858 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.211866 | controller | \ logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.211873 | controller | on port 15691...\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211892 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211898 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211903 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:06 2025-10-13 20:41:20.211909 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.211915 | controller | 20:33:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.211920 | controller | match the secret.\n logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.211926 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.211932 | controller | \ logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.211938 | controller | on port 6642...\n logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.211944 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:07 2025-10-13 20:41:20.211950 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.211957 | controller | \ logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.211963 | controller | on port 6644 match the secret.\n logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211970 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.211980 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.211986 | controller | 20:33:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.211994 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212000 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212013 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.212021 | controller | 20:33:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.212029 | controller | 6643...\n logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212037 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:09 2025-10-13 20:41:20.212044 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.212050 | controller | \ logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.212055 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212061 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.212067 | controller | \ logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.212073 | controller | on port 3000...\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212078 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:11 2025-10-13 20:41:20.212084 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.212090 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212095 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212101 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.212107 | controller | 20:33:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.212112 | controller | 15671...\n logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212118 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:12 | 2025-10-13 20:41:20.212124 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.212129 | controller | \ logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.212135 | controller | on port 15691 match the secret.\n logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212141 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.212146 | controller | 20:33:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.212152 | controller | 3306...\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212158 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:13 | 2025-10-13 20:41:20.212163 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.212173 | controller | Ports: 3306)\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.212178 | controller | to openstack on port 3306...\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212184 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:13 2025-10-13 20:41:20.212190 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.212195 | controller | \ logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.212204 | controller | on port 1981\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.212210 | controller | on port 1981\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.212215 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212221 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.212227 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.212232 | controller | \ ]\n logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.212238 | controller | rotation of non API service certificates...\n logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212244 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.212250 | controller | \ logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.212255 | controller | on port 15691...\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212261 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212267 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212272 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:15 2025-10-13 20:41:20.212285 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.212293 | controller | 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.212301 | controller | match the secret.\n logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.212308 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.212316 | controller | \ logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.212322 | controller | on port 6642...\n logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212331 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:16 2025-10-13 20:41:20.212337 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.212343 | controller | \ logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.212348 | controller | on port 6644 match the secret.\n logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212354 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212360 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.212365 | controller | 20:33:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.212371 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212377 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212383 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.212388 | controller | 20:33:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.212397 | controller | 6643...\n logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212418 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:18 2025-10-13 20:41:20.212427 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.212436 | controller | \ logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.212442 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212448 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.212454 | controller | \ logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.212459 | controller | on port 3000...\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212465 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:19 2025-10-13 20:41:20.212471 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.212476 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212482 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212488 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.212493 | controller | 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.212499 | controller | 15671...\n logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212505 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:20 | 2025-10-13 20:41:20.212510 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.212516 | controller | \ logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.212522 | controller | on port 15691 match the secret.\n logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212527 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.212533 | controller | 20:33:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.212539 | controller | 3306...\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212547 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:21 | 2025-10-13 20:41:20.212553 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.212559 | controller | Ports: 3306)\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.212564 | controller | to openstack on port 3306...\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212577 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:21 2025-10-13 20:41:20.212586 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.212593 | controller | \ logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.212601 | controller | on port 1981\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.212609 | controller | on port 1981\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.212615 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212621 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.212626 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.212632 | controller | \ ]\n logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.212638 | controller | rotation of non API service certificates...\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212647 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.212652 | controller | \ logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.212658 | controller | on port 15691...\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212664 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212669 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212675 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:23 2025-10-13 20:41:20.212681 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.212686 | controller | 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.212692 | controller | match the secret.\n logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.212698 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.212703 | controller | \ logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.212709 | controller | on port 6642...\n logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212715 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:24 2025-10-13 20:41:20.212720 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.212726 | controller | \ logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.212732 | controller | on port 6644 match the secret.\n logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212737 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212743 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.212749 | controller | 20:33:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.212755 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212763 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212769 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.212775 | controller | 20:33:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.212781 | controller | 6643...\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212786 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:26 2025-10-13 20:41:20.212792 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.212798 | controller | \ logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.212803 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212809 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.212815 | controller | \ logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.212820 | controller | on port 3000...\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212826 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:27 2025-10-13 20:41:20.212832 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.212847 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212855 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212863 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.212871 | controller | 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.212878 | controller | 15671...\n logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212884 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:28 | 2025-10-13 20:41:20.212889 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.212898 | controller | \ logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.212904 | controller | on port 15691 match the secret.\n logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212910 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.212916 | controller | 20:33:28 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.212921 | controller | 3306...\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.212927 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:29 | 2025-10-13 20:41:20.212933 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.212938 | controller | Ports: 3306)\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.212944 | controller | to openstack on port 3306...\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212950 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:29 2025-10-13 20:41:20.212955 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.212961 | controller | \ logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.212967 | controller | on port 1981\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.212972 | controller | on port 1981\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.212978 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.212984 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.212990 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.212995 | controller | \ ]\n logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.213001 | controller | rotation of non API service certificates...\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213007 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.213012 | controller | \ logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.213018 | controller | on port 15691...\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213024 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213029 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213035 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:31 2025-10-13 20:41:20.213041 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.213049 | controller | 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.213055 | controller | match the secret.\n logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.213061 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.213067 | controller | \ logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.213072 | controller | on port 6642...\n logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213078 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:32 2025-10-13 20:41:20.213084 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.213089 | controller | \ logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.213095 | controller | on port 6644 match the secret.\n logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213101 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213114 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.213122 | controller | 20:33:33 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.213130 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213138 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213146 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.213151 | controller | 20:33:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.213157 | controller | 6643...\n logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213163 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:34 2025-10-13 20:41:20.213169 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.213175 | controller | \ logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.213180 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213186 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.213192 | controller | \ logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.213198 | controller | on port 3000...\n logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213203 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:35 2025-10-13 20:41:20.213209 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.213218 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213224 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213230 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.213236 | controller | 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.213241 | controller | 15671...\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213250 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:36 | 2025-10-13 20:41:20.213255 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.213267 | controller | \ logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.213272 | controller | on port 15691 match the secret.\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213278 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.213284 | controller | 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.213290 | controller | 3306...\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213296 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:37 | 2025-10-13 20:41:20.213301 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.213307 | controller | Ports: 3306)\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.213313 | controller | to openstack on port 3306...\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213319 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:37 2025-10-13 20:41:20.213324 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.213330 | controller | \ logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.213336 | controller | on port 1981\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.213342 | controller | on port 1981\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.213347 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213353 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.213359 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.213365 | controller | \ ]\n logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.213370 | controller | rotation of non API service certificates...\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213376 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.213382 | controller | \ logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.213396 | controller | on port 15691...\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213418 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213429 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213435 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:39 2025-10-13 20:41:20.213441 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.213447 | controller | 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.213453 | controller | match the secret.\n logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.213459 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.213464 | controller | \ logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.213470 | controller | on port 6642...\n logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213476 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:40 2025-10-13 20:41:20.213482 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.213488 | controller | \ logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.213497 | controller | on port 6644 match the secret.\n logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213503 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213509 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.213514 | controller | 20:33:41 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.213520 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213526 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213532 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.213538 | controller | 20:33:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.213543 | controller | 6643...\n logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213549 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:42 2025-10-13 20:41:20.213555 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.213561 | controller | \ logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.213566 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213572 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.213578 | controller | \ logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.213584 | controller | on port 3000...\n logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213589 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:43 2025-10-13 20:41:20.213595 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.213601 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213607 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213613 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.213621 | controller | 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.213627 | controller | 15671...\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213633 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:44 | 2025-10-13 20:41:20.213639 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.213644 | controller | \ logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.213650 | controller | on port 15691 match the secret.\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213656 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.213661 | controller | 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.213667 | controller | 3306...\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213681 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:45 | 2025-10-13 20:41:20.213689 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.213697 | controller | Ports: 3306)\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.213708 | controller | to openstack on port 3306...\n logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213716 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:46 2025-10-13 20:41:20.213721 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.213727 | controller | \ logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.213733 | controller | on port 1981\n logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.213739 | controller | on port 1981\n logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.213745 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213754 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.213759 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.213765 | controller | \ ]\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.213771 | controller | rotation of non API service certificates...\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213777 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.213782 | controller | \ logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.213788 | controller | on port 15691...\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213794 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213800 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213806 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:47 2025-10-13 20:41:20.213811 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.213817 | controller | 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.213823 | controller | match the secret.\n logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.213829 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.213834 | controller | \ logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.213840 | controller | on port 6642...\n logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213846 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:48 2025-10-13 20:41:20.213852 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.213858 | controller | \ logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.213863 | controller | on port 6644 match the secret.\n logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213869 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213875 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.213881 | controller | 20:33:49 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.213887 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213892 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213908 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.213913 | controller | 20:33:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.213919 | controller | 6643...\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213925 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:50 2025-10-13 20:41:20.213931 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.213953 | controller | \ logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.213959 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.213965 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.213981 | controller | \ logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.213989 | controller | on port 3000...\n logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.213997 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:51 2025-10-13 20:41:20.214005 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.214012 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214019 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214024 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.214030 | controller | 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.214036 | controller | 15671...\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214042 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:52 | 2025-10-13 20:41:20.214047 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.214053 | controller | \ logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.214059 | controller | on port 15691 match the secret.\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214064 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.214070 | controller | 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.214076 | controller | 3306...\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214081 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:53 | 2025-10-13 20:41:20.214087 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.214093 | controller | Ports: 3306)\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.214098 | controller | to openstack on port 3306...\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214104 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:53 2025-10-13 20:41:20.214110 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.214115 | controller | \ logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.214121 | controller | on port 1981\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.214127 | controller | on port 1981\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.214132 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214141 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.214147 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.214153 | controller | \ ]\n logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.214158 | controller | rotation of non API service certificates...\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214164 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.214170 | controller | \ logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.214175 | controller | on port 15691...\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214181 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214187 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214195 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:55 2025-10-13 20:41:20.214201 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.214207 | controller | 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.214213 | controller | match the secret.\n logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.214218 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.214224 | controller | \ logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.214230 | controller | on port 6642...\n logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214235 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:56 2025-10-13 20:41:20.214248 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.214256 | controller | \ logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.214264 | controller | on port 6644 match the secret.\n logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214272 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214279 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.214286 | controller | 20:33:57 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.214291 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214297 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214303 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.214309 | controller | 20:33:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.214314 | controller | 6643...\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214320 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:58 2025-10-13 20:41:20.214326 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.214335 | controller | \ logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.214340 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214349 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.214354 | controller | \ logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.214360 | controller | on port 3000...\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214366 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:59 2025-10-13 20:41:20.214371 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.214377 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214383 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214388 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.214394 | controller | 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.214415 | controller | 15671...\n logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214423 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:00 | 2025-10-13 20:41:20.214429 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.214435 | controller | \ logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.214441 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214446 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.214452 | controller | 20:34:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.214458 | controller | 3306...\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214463 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:01 | 2025-10-13 20:41:20.214469 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.214474 | controller | Ports: 3306)\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.214480 | controller | to openstack on port 3306...\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214486 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:01 2025-10-13 20:41:20.214491 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.214497 | controller | \ logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.214503 | controller | on port 1981\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.214508 | controller | on port 1981\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.214514 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214520 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.214533 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.214541 | controller | \ ]\n logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.214549 | controller | rotation of non API service certificates...\n logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214556 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.214564 | controller | \ logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.214571 | controller | on port 15691...\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214580 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214586 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214591 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:03 2025-10-13 20:41:20.214597 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.214603 | controller | 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.214608 | controller | match the secret.\n logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.214614 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.214620 | controller | \ logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.214625 | controller | on port 6642...\n logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214631 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:04 2025-10-13 20:41:20.214637 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.214642 | controller | \ logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.214648 | controller | on port 6644 match the secret.\n logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214657 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214663 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.214668 | controller | 20:34:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.214674 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214680 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214685 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.214691 | controller | 20:34:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.214697 | controller | 6643...\n logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214705 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:06 2025-10-13 20:41:20.214711 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.214716 | controller | \ logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.214722 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214728 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.214733 | controller | \ logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.214739 | controller | on port 3000...\n logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214745 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:07 2025-10-13 20:41:20.214750 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.214756 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214762 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214770 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.214776 | controller | 20:34:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.214781 | controller | 15671...\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214787 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:08 | 2025-10-13 20:41:20.214793 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.214805 | controller | \ logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.214814 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214821 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.214829 | controller | 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.214836 | controller | 3306...\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214842 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:09 | 2025-10-13 20:41:20.214848 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.214854 | controller | Ports: 3306)\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.214859 | controller | to openstack on port 3306...\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214865 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:09 2025-10-13 20:41:20.214871 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.214876 | controller | \ logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.214882 | controller | on port 1981\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.214888 | controller | on port 1981\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.214893 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214899 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.214905 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.214910 | controller | \ ]\n logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.214916 | controller | rotation of non API service certificates...\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214922 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.214927 | controller | \ logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.214933 | controller | on port 15691...\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214939 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214945 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.214950 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:11 2025-10-13 20:41:20.214956 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.214962 | controller | 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.214967 | controller | match the secret.\n logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.214973 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.214985 | controller | \ logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.214990 | controller | on port 6642...\n logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.214996 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:12 2025-10-13 20:41:20.215002 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.215007 | controller | \ logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.215013 | controller | on port 6644 match the secret.\n logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215019 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215025 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.215030 | controller | 20:34:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.215036 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215042 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215051 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.215059 | controller | 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.215064 | controller | 6643...\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215077 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:14 2025-10-13 20:41:20.215085 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.215093 | controller | \ logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.215101 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215111 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.215117 | controller | \ logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.215122 | controller | on port 3000...\n logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215128 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:16 2025-10-13 20:41:20.215134 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.215140 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215145 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215151 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.215157 | controller | 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.215162 | controller | 15671...\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215168 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:16 | 2025-10-13 20:41:20.215174 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.215179 | controller | \ logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.215185 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215191 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.215201 | controller | 20:34:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.215207 | controller | 3306...\n logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215213 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:17 | 2025-10-13 20:41:20.215218 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.215224 | controller | Ports: 3306)\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.215230 | controller | to openstack on port 3306...\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215235 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:18 2025-10-13 20:41:20.215241 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.215247 | controller | \ logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.215252 | controller | on port 1981\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.215258 | controller | on port 1981\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.215264 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215269 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.215275 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.215281 | controller | \ ]\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.215286 | controller | rotation of non API service certificates...\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215292 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.215298 | controller | \ logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.215303 | controller | on port 15691...\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215309 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215315 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215320 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:20 2025-10-13 20:41:20.215326 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.215332 | controller | 20:34:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.215337 | controller | match the secret.\n logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.215350 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.215362 | controller | \ logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.215370 | controller | on port 6642...\n logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215377 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:21 2025-10-13 20:41:20.215384 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.215390 | controller | \ logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.215399 | controller | on port 6644 match the secret.\n logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215419 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215429 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.215435 | controller | 20:34:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.215441 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215446 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215452 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.215458 | controller | 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.215463 | controller | 6643...\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215469 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:22 2025-10-13 20:41:20.215475 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.215480 | controller | \ logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.215486 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215492 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.215497 | controller | \ logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.215503 | controller | on port 3000...\n logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215509 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:24 2025-10-13 20:41:20.215514 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.215520 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215526 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215531 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.215537 | controller | 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.215543 | controller | 15671...\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215549 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:24 | 2025-10-13 20:41:20.215554 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.215560 | controller | \ logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.215566 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215574 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.215580 | controller | 20:34:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.215586 | controller | 3306...\n logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215591 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:25 | 2025-10-13 20:41:20.215597 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.215603 | controller | Ports: 3306)\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.215608 | controller | to openstack on port 3306...\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215614 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:26 2025-10-13 20:41:20.215623 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.215628 | controller | \ logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.215642 | controller | on port 1981\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.215650 | controller | on port 1981\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.215658 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215665 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.215673 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.215679 | controller | \ ]\n logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.215685 | controller | rotation of non API service certificates...\n logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215691 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.215697 | controller | \ logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.215702 | controller | on port 15691...\n logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215708 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215714 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215719 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:28 2025-10-13 20:41:20.215725 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.215731 | controller | 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.215737 | controller | match the secret.\n logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.215746 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.215751 | controller | \ logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.215757 | controller | on port 6642...\n logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215763 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:29 2025-10-13 20:41:20.215768 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.215774 | controller | \ logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.215780 | controller | on port 6644 match the secret.\n logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215785 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215791 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.215797 | controller | 20:34:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.215802 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215808 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215814 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.215820 | controller | 20:34:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.215825 | controller | 6643...\n logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215834 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:31 2025-10-13 20:41:20.215840 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.215846 | controller | \ logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.215851 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215857 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.215863 | controller | \ logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.215868 | controller | on port 3000...\n logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215874 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:32 2025-10-13 20:41:20.215880 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.215885 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215891 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215904 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.215912 | controller | 20:34:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.215920 | controller | 15671...\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215928 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:33 | 2025-10-13 20:41:20.215936 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.215941 | controller | \ logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.215947 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215954 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.215961 | controller | 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.215967 | controller | 3306...\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.215974 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:34 | 2025-10-13 20:41:20.215981 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.215986 | controller | Ports: 3306)\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.215992 | controller | to openstack on port 3306...\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.215998 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:34 2025-10-13 20:41:20.216003 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.216009 | controller | \ logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.216015 | controller | on port 1981\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.216020 | controller | on port 1981\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.216026 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216032 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.216037 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.216046 | controller | \ ]\n logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.216052 | controller | rotation of non API service certificates...\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216061 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.216066 | controller | \ logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.216072 | controller | on port 15691...\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216078 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216083 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216089 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:36 2025-10-13 20:41:20.216097 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.216103 | controller | 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.216109 | controller | match the secret.\n logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.216114 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.216120 | controller | \ logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.216126 | controller | on port 6642...\n logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216131 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:37 2025-10-13 20:41:20.216137 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.216143 | controller | \ logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.216148 | controller | on port 6644 match the secret.\n logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216154 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216160 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.216165 | controller | 20:34:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.216171 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216184 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216192 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.216200 | controller | 20:34:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.216208 | controller | 6643...\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216215 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:39 2025-10-13 20:41:20.216221 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.216227 | controller | \ logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.216232 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216243 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.216248 | controller | \ logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.216254 | controller | on port 3000...\n logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216265 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:40 2025-10-13 20:41:20.216271 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.216277 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216282 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216288 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.216294 | controller | 20:34:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.216299 | controller | 15671...\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216305 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:41 | 2025-10-13 20:41:20.216311 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.216317 | controller | \ logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.216322 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216328 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.216334 | controller | 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.216339 | controller | 3306...\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216345 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:42 | 2025-10-13 20:41:20.216351 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.216357 | controller | Ports: 3306)\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.216362 | controller | to openstack on port 3306...\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216368 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:42 2025-10-13 20:41:20.216374 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.216379 | controller | \ logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.216385 | controller | on port 1981\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.216391 | controller | on port 1981\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.216411 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216420 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.216426 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.216432 | controller | \ ]\n logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.216437 | controller | rotation of non API service certificates...\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216443 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.216452 | controller | \ logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.216458 | controller | on port 15691...\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216463 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216477 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216489 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:44 2025-10-13 20:41:20.216497 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.216504 | controller | 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.216511 | controller | match the secret.\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.216517 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.216522 | controller | \ logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.216531 | controller | on port 6642...\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216537 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:45 2025-10-13 20:41:20.216542 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.216548 | controller | \ logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.216554 | controller | on port 6644 match the secret.\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216560 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216565 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.216571 | controller | 20:34:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.216577 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216582 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216588 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.216594 | controller | 20:34:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.216599 | controller | 6643...\n logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216605 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:47 2025-10-13 20:41:20.216611 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.216616 | controller | \ logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.216622 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216628 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.216633 | controller | \ logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.216639 | controller | on port 3000...\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216645 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:48 2025-10-13 20:41:20.216650 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.216656 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216662 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216667 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.216673 | controller | 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.216679 | controller | 15671...\n logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216688 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:49 | 2025-10-13 20:41:20.216693 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.216699 | controller | \ logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.216705 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216711 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.216716 | controller | 20:34:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.216722 | controller | 3306...\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216728 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:50 | 2025-10-13 20:41:20.216733 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.216746 | controller | Ports: 3306)\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.216754 | controller | to openstack on port 3306...\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216762 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:50 2025-10-13 20:41:20.216769 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.216774 | controller | \ logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.216780 | controller | on port 1981\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.216786 | controller | on port 1981\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.216791 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216797 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.216803 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.216812 | controller | \ ]\n logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.216817 | controller | rotation of non API service certificates...\n logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216823 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.216829 | controller | \ logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.216835 | controller | on port 15691...\n logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216840 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216846 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216852 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:52 2025-10-13 20:41:20.216857 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.216863 | controller | 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.216869 | controller | match the secret.\n logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.216875 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.216880 | controller | \ logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.216886 | controller | on port 6642...\n logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216894 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:53 2025-10-13 20:41:20.216900 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.216906 | controller | \ logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.216912 | controller | on port 6644 match the secret.\n logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216917 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216923 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.216929 | controller | 20:34:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.216937 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216943 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216948 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.216954 | controller | 20:34:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.216960 | controller | 6643...\n logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.216965 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:55 2025-10-13 20:41:20.216971 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.216977 | controller | \ logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.216982 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.216988 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.216994 | controller | \ logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.217000 | controller | on port 3000...\n logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217012 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:56 2025-10-13 20:41:20.217020 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.217028 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217035 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217041 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.217046 | controller | 20:34:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.217052 | controller | 15671...\n logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217058 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:57 | 2025-10-13 20:41:20.217063 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.217069 | controller | \ logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.217074 | controller | on port 15691 match the secret.\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217080 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.217086 | controller | 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.217091 | controller | 3306...\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217100 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:58 | 2025-10-13 20:41:20.217106 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.217111 | controller | Ports: 3306)\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.217117 | controller | to openstack on port 3306...\n logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217123 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:59 2025-10-13 20:41:20.217128 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.217134 | controller | \ logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.217142 | controller | on port 1981\n logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.217148 | controller | on port 1981\n logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.217154 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217159 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.217165 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.217171 | controller | \ ]\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.217176 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217182 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.217187 | controller | \ logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.217193 | controller | on port 15691...\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217199 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217204 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217210 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:01 2025-10-13 20:41:20.217216 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.217221 | controller | 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.217227 | controller | match the secret.\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.217233 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.217238 | controller | \ logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.217244 | controller | on port 6642...\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217250 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:01 2025-10-13 20:41:20.217255 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.217261 | controller | \ logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.217267 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217279 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217287 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.217295 | controller | 20:35:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.217305 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217311 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217316 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.217322 | controller | 20:35:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.217328 | controller | 6643...\n logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217333 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:03 2025-10-13 20:41:20.217339 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.217345 | controller | \ logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.217350 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217356 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.217362 | controller | \ logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.217367 | controller | on port 3000...\n logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217376 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:04 2025-10-13 20:41:20.217382 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.217388 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217397 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217422 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.217430 | controller | 20:35:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.217438 | controller | 15671...\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217445 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:05 | 2025-10-13 20:41:20.217453 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.217459 | controller | \ logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.217465 | controller | on port 15691 match the secret.\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217470 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.217476 | controller | 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.217482 | controller | 3306...\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217487 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:06 | 2025-10-13 20:41:20.217493 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.217499 | controller | Ports: 3306)\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.217504 | controller | to openstack on port 3306...\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217510 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:06 2025-10-13 20:41:20.217519 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.217525 | controller | \ logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.217534 | controller | on port 1981\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.217540 | controller | on port 1981\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.217545 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217551 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.217557 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.217562 | controller | \ ]\n logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.217568 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217582 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.217590 | controller | \ logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.217598 | controller | on port 15691...\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217605 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217613 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217620 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:08 2025-10-13 20:41:20.217628 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.217635 | controller | 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.217641 | controller | match the secret.\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.217646 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.217652 | controller | \ logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.217658 | controller | on port 6642...\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217663 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:09 2025-10-13 20:41:20.217669 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.217675 | controller | \ logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.217680 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217686 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217692 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.217698 | controller | 20:35:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.217703 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217709 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217715 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.217720 | controller | 20:35:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.217726 | controller | 6643...\n logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217732 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:11 2025-10-13 20:41:20.217737 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.217746 | controller | \ logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.217752 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217758 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.217763 | controller | \ logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.217769 | controller | on port 3000...\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217775 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:12 2025-10-13 20:41:20.217780 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.217786 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217792 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217797 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.217803 | controller | 20:35:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.217809 | controller | 15671...\n logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217814 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:13 | 2025-10-13 20:41:20.217820 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.217826 | controller | \ logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.217831 | controller | on port 15691 match the secret.\n logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217844 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.217860 | controller | 20:35:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.217868 | controller | 3306...\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.217875 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:14 | 2025-10-13 20:41:20.217882 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.217889 | controller | Ports: 3306)\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.217899 | controller | to openstack on port 3306...\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217904 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:14 2025-10-13 20:41:20.217910 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.217916 | controller | \ logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.217921 | controller | on port 1981\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.217927 | controller | on port 1981\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.217933 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217938 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.217944 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.217950 | controller | \ ]\n logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.217955 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.217964 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.217988 | controller | \ logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.217995 | controller | on port 15691...\n logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218000 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218006 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218012 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:16 2025-10-13 20:41:20.218018 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.218023 | controller | 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.218029 | controller | match the secret.\n logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.218035 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.218040 | controller | \ logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.218046 | controller | on port 6642...\n logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218052 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:17 2025-10-13 20:41:20.218057 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.218063 | controller | \ logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.218069 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218074 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218080 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.218086 | controller | 20:35:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.218091 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218097 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218103 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.218109 | controller | 20:35:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.218114 | controller | 6643...\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218120 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:19 2025-10-13 20:41:20.218126 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.218131 | controller | \ logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.218145 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218153 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.218161 | controller | \ logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.218168 | controller | on port 3000...\n logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218176 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:20 2025-10-13 20:41:20.218183 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.218218 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218224 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218233 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.218239 | controller | 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.218244 | controller | 15671...\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218250 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:21 | 2025-10-13 20:41:20.218256 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.218261 | controller | \ logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.218267 | controller | on port 15691 match the secret.\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218273 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.218278 | controller | 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.218284 | controller | 3306...\n logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218290 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:22 | 2025-10-13 20:41:20.218298 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.218304 | controller | Ports: 3306)\n logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.218309 | controller | to openstack on port 3306...\n logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218315 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:23 2025-10-13 20:41:20.218321 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.218326 | controller | \ logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.218332 | controller | on port 1981\n logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.218338 | controller | on port 1981\n logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.218343 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218349 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.218355 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.218360 | controller | \ ]\n logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.218366 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218372 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.218377 | controller | \ logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.218383 | controller | on port 15691...\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218389 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218400 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218422 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:25 2025-10-13 20:41:20.218428 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.218436 | controller | 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.218442 | controller | match the secret.\n logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.218448 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.218454 | controller | \ logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.218467 | controller | on port 6642...\n logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218475 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:26 2025-10-13 20:41:20.218483 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.218491 | controller | \ logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.218499 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218506 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218511 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.218517 | controller | 20:35:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.218523 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218528 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218534 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.218543 | controller | 20:35:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.218549 | controller | 6643...\n logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218554 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:28 2025-10-13 20:41:20.218560 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.218566 | controller | \ logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.218571 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218577 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.218583 | controller | \ logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.218589 | controller | on port 3000...\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218594 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:29 2025-10-13 20:41:20.218600 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.218605 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218611 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218617 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.218623 | controller | 20:35:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.218628 | controller | 15671...\n logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218634 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:30 | 2025-10-13 20:41:20.218640 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.218648 | controller | \ logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.218654 | controller | on port 15691 match the secret.\n logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218660 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.218665 | controller | 20:35:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.218674 | controller | 3306...\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218679 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:31 | 2025-10-13 20:41:20.218685 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.218691 | controller | Ports: 3306)\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.218696 | controller | to openstack on port 3306...\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218702 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:31 2025-10-13 20:41:20.218707 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.218713 | controller | \ logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.218719 | controller | on port 1981\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.218724 | controller | on port 1981\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.218737 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218746 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.218753 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.218761 | controller | \ ]\n logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.218768 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218774 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.218780 | controller | \ logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.218785 | controller | on port 15691...\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218791 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218797 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218803 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:33 2025-10-13 20:41:20.218808 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.218814 | controller | 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.218820 | controller | match the secret.\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.218825 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.218831 | controller | \ logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.218837 | controller | on port 6642...\n logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218842 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:34 2025-10-13 20:41:20.218848 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.218854 | controller | \ logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.218866 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218872 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218877 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.218883 | controller | 20:35:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.218889 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218894 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218900 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.218906 | controller | 20:35:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.218911 | controller | 6643...\n logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218917 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:36 2025-10-13 20:41:20.218923 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.218928 | controller | \ logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.218934 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218940 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.218945 | controller | \ logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.218951 | controller | on port 3000...\n logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.218957 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:37 2025-10-13 20:41:20.218962 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.218968 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218974 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.218980 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.218985 | controller | 20:35:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.218991 | controller | 15671...\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219007 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:38 | 2025-10-13 20:41:20.219015 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.219022 | controller | \ logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.219030 | controller | on port 15691 match the secret.\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219038 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.219044 | controller | 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.219049 | controller | 3306...\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219055 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:39 | 2025-10-13 20:41:20.219061 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.219066 | controller | Ports: 3306)\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.219075 | controller | to openstack on port 3306...\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219081 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:39 2025-10-13 20:41:20.219087 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.219092 | controller | \ logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.219098 | controller | on port 1981\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.219104 | controller | on port 1981\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.219109 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219115 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.219121 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.219127 | controller | \ ]\n logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.219132 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219138 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.219144 | controller | \ logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.219149 | controller | on port 15691...\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219155 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219161 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219166 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:41 2025-10-13 20:41:20.219172 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.219178 | controller | 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.219183 | controller | match the secret.\n logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.219189 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.219195 | controller | \ logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.219200 | controller | on port 6642...\n logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219206 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:42 2025-10-13 20:41:20.219212 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.219217 | controller | \ logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.219223 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219229 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219236 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.219241 | controller | 20:35:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.219247 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219253 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219264 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.219276 | controller | 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.219285 | controller | 6643...\n logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219292 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:44 2025-10-13 20:41:20.219300 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.219307 | controller | \ logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.219316 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219322 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.219328 | controller | \ logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.219334 | controller | on port 3000...\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219340 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:45 2025-10-13 20:41:20.219346 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.219351 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219357 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219363 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.219368 | controller | 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.219377 | controller | 15671...\n logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219383 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:46 | 2025-10-13 20:41:20.219388 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.219397 | controller | \ logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.219415 | controller | on port 15691 match the secret.\n logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219425 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.219431 | controller | 20:35:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.219437 | controller | 3306...\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219442 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:47 | 2025-10-13 20:41:20.219448 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.219454 | controller | Ports: 3306)\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.219459 | controller | to openstack on port 3306...\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219465 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:47 2025-10-13 20:41:20.219471 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.219476 | controller | \ logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.219482 | controller | on port 1981\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.219488 | controller | on port 1981\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.219494 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219503 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.219509 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.219515 | controller | \ ]\n logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.219521 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219527 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.219533 | controller | \ logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.219538 | controller | on port 15691...\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219544 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219550 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219555 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:49 2025-10-13 20:41:20.219568 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.219576 | controller | 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.219584 | controller | match the secret.\n logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.219591 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.219599 | controller | \ logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.219606 | controller | on port 6642...\n logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219612 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:50 2025-10-13 20:41:20.219617 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.219623 | controller | \ logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.219629 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219634 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219640 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.219646 | controller | 20:35:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.219651 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219657 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219663 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.219669 | controller | 20:35:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.219674 | controller | 6643...\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219680 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:52 2025-10-13 20:41:20.219686 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.219691 | controller | \ logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.219697 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219706 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.219712 | controller | \ logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.219717 | controller | on port 3000...\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219723 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:53 2025-10-13 20:41:20.219729 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.219735 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219744 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219749 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.219755 | controller | 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.219761 | controller | 15671...\n logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219766 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:54 | 2025-10-13 20:41:20.219772 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.219778 | controller | \ logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.219786 | controller | on port 15691 match the secret.\n logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219791 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.219797 | controller | 20:35:54 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.219803 | controller | 3306...\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219808 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:55 | 2025-10-13 20:41:20.219814 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.219820 | controller | Ports: 3306)\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.219825 | controller | to openstack on port 3306...\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219831 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:55 2025-10-13 20:41:20.219844 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.219852 | controller | \ logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.219860 | controller | on port 1981\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.219868 | controller | on port 1981\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.219875 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219881 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.219887 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.219892 | controller | \ ]\n logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.219898 | controller | rotation of non API service certificates...\n logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219904 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.219910 | controller | \ logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.219915 | controller | on port 15691...\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219925 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219931 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219936 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:57 2025-10-13 20:41:20.219942 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.219948 | controller | 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.219953 | controller | match the secret.\n logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.219959 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.219965 | controller | \ logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.219970 | controller | on port 6642...\n logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.219976 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:59 2025-10-13 20:41:20.219982 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.219987 | controller | \ logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.219993 | controller | on port 6644 match the secret.\n logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.219999 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220004 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.220010 | controller | 20:36:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.220016 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220022 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220027 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.220033 | controller | 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.220039 | controller | 6643...\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220044 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:00 2025-10-13 20:41:20.220050 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.220056 | controller | \ logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.220061 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220067 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.220083 | controller | \ logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.220089 | controller | on port 3000...\n logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220095 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:02 2025-10-13 20:41:20.220100 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.220113 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220121 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220132 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.220140 | controller | 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.220147 | controller | 15671...\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220153 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:02 | 2025-10-13 20:41:20.220158 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.220164 | controller | \ logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.220170 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220175 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.220181 | controller | 20:36:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.220187 | controller | 3306...\n logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220192 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:03 | 2025-10-13 20:41:20.220198 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.220204 | controller | Ports: 3306)\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.220210 | controller | to openstack on port 3306...\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220215 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:04 2025-10-13 20:41:20.220221 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.220227 | controller | \ logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.220232 | controller | on port 1981\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.220238 | controller | on port 1981\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.220244 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220249 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.220258 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.220264 | controller | \ ]\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.220270 | controller | rotation of non API service certificates...\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220275 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.220281 | controller | \ logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.220287 | controller | on port 15691...\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220292 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220298 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220304 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:06 2025-10-13 20:41:20.220310 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.220315 | controller | 20:36:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.220321 | controller | match the secret.\n logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.220327 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.220335 | controller | \ logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.220341 | controller | on port 6642...\n logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220347 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:07 2025-10-13 20:41:20.220352 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.220358 | controller | \ logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.220364 | controller | on port 6644 match the secret.\n logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220369 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220375 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.220388 | controller | 20:36:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.220399 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220423 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220429 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.220435 | controller | 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.220440 | controller | 6643...\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220446 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:08 2025-10-13 20:41:20.220455 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.220461 | controller | \ logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.220466 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220472 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.220478 | controller | \ logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.220484 | controller | on port 3000...\n logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220489 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:10 2025-10-13 20:41:20.220495 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.220501 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220506 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220512 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.220518 | controller | 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.220523 | controller | 15671...\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220529 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:10 | 2025-10-13 20:41:20.220535 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.220541 | controller | \ logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.220546 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220552 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.220561 | controller | 20:36:11 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.220567 | controller | 3306...\n logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220573 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:11 | 2025-10-13 20:41:20.220578 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.220584 | controller | Ports: 3306)\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.220590 | controller | to openstack on port 3306...\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220595 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:12 2025-10-13 20:41:20.220601 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.220607 | controller | \ logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.220612 | controller | on port 1981\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.220618 | controller | on port 1981\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.220624 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220629 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.220635 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.220641 | controller | \ ]\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.220646 | controller | rotation of non API service certificates...\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220652 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.220658 | controller | \ logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.220671 | controller | on port 15691...\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220679 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220687 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220695 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:14 2025-10-13 20:41:20.220702 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.220711 | controller | 20:36:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.220717 | controller | match the secret.\n logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.220723 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.220728 | controller | \ logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.220734 | controller | on port 6642...\n logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220740 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:15 2025-10-13 20:41:20.220745 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.220751 | controller | \ logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.220757 | controller | on port 6644 match the secret.\n logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220762 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220774 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.220779 | controller | 20:36:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.220785 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220791 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220797 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.220802 | controller | 20:36:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.220811 | controller | 6643...\n logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220816 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:17 2025-10-13 20:41:20.220822 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.220828 | controller | \ logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.220833 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220839 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.220845 | controller | \ logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.220851 | controller | on port 3000...\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220856 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:18 2025-10-13 20:41:20.220862 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.220868 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220873 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220879 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.220885 | controller | 20:36:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.220890 | controller | 15671...\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220896 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:19 | 2025-10-13 20:41:20.220902 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.220907 | controller | \ logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.220913 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220919 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.220924 | controller | 20:36:19 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.220930 | controller | 3306...\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.220943 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:20 | 2025-10-13 20:41:20.220951 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.220959 | controller | Ports: 3306)\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.220967 | controller | to openstack on port 3306...\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.220974 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:20 2025-10-13 20:41:20.220983 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.220989 | controller | \ logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.220995 | controller | on port 1981\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.221001 | controller | on port 1981\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.221006 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221012 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.221018 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.221023 | controller | \ ]\n logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.221029 | controller | rotation of non API service certificates...\n logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221035 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.221040 | controller | \ logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.221046 | controller | on port 15691...\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221052 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221057 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221063 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:22 2025-10-13 20:41:20.221069 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.221075 | controller | 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.221080 | controller | match the secret.\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.221086 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.221092 | controller | \ logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.221097 | controller | on port 6642...\n logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221103 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:23 2025-10-13 20:41:20.221109 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.221117 | controller | \ logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.221123 | controller | on port 6644 match the secret.\n logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221129 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221134 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.221142 | controller | 20:36:24 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.221148 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221154 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221159 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.221165 | controller | 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.221171 | controller | 6643...\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221179 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:24 2025-10-13 20:41:20.221185 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.221191 | controller | \ logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.221196 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221202 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.221215 | controller | \ logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.221223 | controller | on port 3000...\n logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221231 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:25 2025-10-13 20:41:20.221239 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.221247 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221252 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221258 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.221264 | controller | 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.221270 | controller | 15671...\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221275 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:26 | 2025-10-13 20:41:20.221281 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.221287 | controller | \ logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.221293 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221298 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.221304 | controller | 20:36:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.221310 | controller | 3306...\n logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221315 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:27 | 2025-10-13 20:41:20.221321 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.221327 | controller | Ports: 3306)\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.221332 | controller | to openstack on port 3306...\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221338 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:28 2025-10-13 20:41:20.221344 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.221350 | controller | \ logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.221355 | controller | on port 1981\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.221361 | controller | on port 1981\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.221367 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221372 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.221378 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.221387 | controller | \ ]\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.221396 | controller | rotation of non API service certificates...\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221414 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.221422 | controller | \ logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.221428 | controller | on port 15691...\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221434 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221440 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221445 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:30 2025-10-13 20:41:20.221451 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.221457 | controller | 20:36:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.221463 | controller | match the secret.\n logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.221468 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.221477 | controller | \ logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.221483 | controller | on port 6642...\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221489 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:31 2025-10-13 20:41:20.221494 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.221508 | controller | \ logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.221516 | controller | on port 6644 match the secret.\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221524 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221535 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.221542 | controller | 20:36:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.221547 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221553 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221559 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.221565 | controller | 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.221570 | controller | 6643...\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221576 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:32 2025-10-13 20:41:20.221582 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.221587 | controller | \ logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.221593 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221599 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.221605 | controller | \ logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.221613 | controller | on port 3000...\n logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221621 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:33 2025-10-13 20:41:20.221627 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.221633 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221639 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221644 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.221650 | controller | 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.221656 | controller | 15671...\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221661 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:34 | 2025-10-13 20:41:20.221667 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.221673 | controller | \ logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.221679 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221684 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.221690 | controller | 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.221696 | controller | 3306...\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221701 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:35 | 2025-10-13 20:41:20.221707 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.221713 | controller | Ports: 3306)\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.221718 | controller | to openstack on port 3306...\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221724 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:35 2025-10-13 20:41:20.221730 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.221736 | controller | \ logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.221741 | controller | on port 1981\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.221747 | controller | on port 1981\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.221753 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221758 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.221764 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.221777 | controller | \ ]\n logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.221785 | controller | rotation of non API service certificates...\n logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221792 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.221800 | controller | \ logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.221807 | controller | on port 15691...\n logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221814 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221822 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221832 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:37 2025-10-13 20:41:20.221839 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.221846 | controller | 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.221855 | controller | match the secret.\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.221861 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.221866 | controller | \ logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.221872 | controller | on port 6642...\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221878 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:38 2025-10-13 20:41:20.221883 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.221889 | controller | \ logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.221895 | controller | on port 6644 match the secret.\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221900 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221906 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.221912 | controller | 20:36:39 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.221917 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221923 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221929 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.221934 | controller | 20:36:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.221940 | controller | 6643...\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221946 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:40 2025-10-13 20:41:20.221952 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.221957 | controller | \ logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.221963 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.221969 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.221974 | controller | \ logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.221980 | controller | on port 3000...\n logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.221986 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:41 2025-10-13 20:41:20.221991 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.221997 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222006 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222026 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.222032 | controller | 20:36:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.222038 | controller | 15671...\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222046 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:42 | 2025-10-13 20:41:20.222052 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.222058 | controller | \ logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.222071 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222079 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.222090 | controller | 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.222098 | controller | 3306...\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222105 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:43 | 2025-10-13 20:41:20.222111 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.222117 | controller | Ports: 3306)\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.222122 | controller | to openstack on port 3306...\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222128 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:43 2025-10-13 20:41:20.222134 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.222139 | controller | \ logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.222145 | controller | on port 1981\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.222151 | controller | on port 1981\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.222156 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222162 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.222168 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.222173 | controller | \ ]\n logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.222179 | controller | rotation of non API service certificates...\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222185 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.222190 | controller | \ logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.222202 | controller | on port 15691...\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222207 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222213 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222219 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:45 2025-10-13 20:41:20.222224 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.222230 | controller | 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.222236 | controller | match the secret.\n logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.222241 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.222247 | controller | \ logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.222253 | controller | on port 6642...\n logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222261 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:46 2025-10-13 20:41:20.222267 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.222273 | controller | \ logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.222278 | controller | on port 6644 match the secret.\n logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222284 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222290 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.222295 | controller | 20:36:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.222301 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222307 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222312 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.222318 | controller | 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.222324 | controller | 6643...\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222330 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:48 2025-10-13 20:41:20.222343 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.222351 | controller | \ logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.222358 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222366 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.222373 | controller | \ logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.222379 | controller | on port 3000...\n logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222385 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:49 2025-10-13 20:41:20.222391 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.222399 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222420 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222426 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.222432 | controller | 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.222437 | controller | 15671...\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222443 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:50 | 2025-10-13 20:41:20.222449 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.222454 | controller | \ logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.222460 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222466 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.222471 | controller | 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.222477 | controller | 3306...\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222486 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:51 | 2025-10-13 20:41:20.222492 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.222498 | controller | Ports: 3306)\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.222504 | controller | to openstack on port 3306...\n logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222509 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:52 2025-10-13 20:41:20.222515 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.222521 | controller | \ logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.222526 | controller | on port 1981\n logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.222532 | controller | on port 1981\n logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.222538 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222543 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.222549 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.222555 | controller | \ ]\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.222564 | controller | rotation of non API service certificates...\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222569 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.222575 | controller | \ logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.222581 | controller | on port 15691...\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222589 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222594 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222600 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:53 2025-10-13 20:41:20.222606 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.222611 | controller | 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.222617 | controller | match the secret.\n logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.222630 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.222639 | controller | \ logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.222646 | controller | on port 6642...\n logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222654 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:54 2025-10-13 20:41:20.222662 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.222668 | controller | \ logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.222673 | controller | on port 6644 match the secret.\n logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222679 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222685 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.222690 | controller | 20:36:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.222699 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222705 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222711 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.222716 | controller | 20:36:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.222722 | controller | 6643...\n logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222728 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:56 2025-10-13 20:41:20.222733 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.222739 | controller | \ logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.222745 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222751 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.222756 | controller | \ logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.222762 | controller | on port 3000...\n logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222768 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:57 2025-10-13 20:41:20.222773 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.222779 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222785 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222790 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.222796 | controller | 20:36:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.222802 | controller | 15671...\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222807 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:58 | 2025-10-13 20:41:20.222813 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.222819 | controller | \ logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.222824 | controller | on port 15691 match the secret.\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222830 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.222836 | controller | 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.222841 | controller | 3306...\n logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222847 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:59 | 2025-10-13 20:41:20.222853 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.222858 | controller | Ports: 3306)\n logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.222864 | controller | to openstack on port 3306...\n logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222870 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:00 2025-10-13 20:41:20.222875 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.222881 | controller | \ logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.222899 | controller | on port 1981\n logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.222908 | controller | on port 1981\n logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.222916 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222924 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.222931 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.222937 | controller | \ ]\n logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.222942 | controller | rotation of non API service certificates...\n logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222948 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.222954 | controller | \ logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.222959 | controller | on port 15691...\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.222965 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222970 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.222976 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:02 2025-10-13 20:41:20.222982 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.222987 | controller | 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.222993 | controller | match the secret.\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.222999 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.223005 | controller | \ logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.223010 | controller | on port 6642...\n logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223019 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:03 2025-10-13 20:41:20.223025 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.223030 | controller | \ logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.223036 | controller | on port 6644 match the secret.\n logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223042 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223047 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.223053 | controller | 20:37:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.223059 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223064 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223070 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.223076 | controller | 20:37:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.223081 | controller | 6643...\n logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223087 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:05 2025-10-13 20:41:20.223093 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.223102 | controller | \ logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.223107 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223113 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.223119 | controller | \ logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.223125 | controller | on port 3000...\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223130 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:06 2025-10-13 20:41:20.223136 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.223142 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223147 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223153 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.223165 | controller | 20:37:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.223173 | controller | 15671...\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223181 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:07 | 2025-10-13 20:41:20.223189 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.223196 | controller | \ logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.223202 | controller | on port 15691 match the secret.\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223208 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.223214 | controller | 20:37:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.223219 | controller | 3306...\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223225 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:08 | 2025-10-13 20:41:20.223231 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.223236 | controller | Ports: 3306)\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.223242 | controller | to openstack on port 3306...\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223248 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:08 2025-10-13 20:41:20.223253 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.223262 | controller | \ logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.223268 | controller | on port 1981\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.223273 | controller | on port 1981\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.223279 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223285 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.223291 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.223296 | controller | \ ]\n logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.223302 | controller | rotation of non API service certificates...\n logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223310 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.223316 | controller | \ logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.223322 | controller | on port 15691...\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223327 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223333 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223339 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:10 2025-10-13 20:41:20.223344 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.223350 | controller | 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.223356 | controller | match the secret.\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.223361 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.223367 | controller | \ logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.223373 | controller | on port 6642...\n logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223379 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:11 2025-10-13 20:41:20.223384 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.223390 | controller | \ logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.223399 | controller | on port 6644 match the secret.\n logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223420 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223426 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.223431 | controller | 20:37:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.223437 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223453 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223461 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.223469 | controller | 20:37:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.223476 | controller | 6643...\n logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223484 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:13 2025-10-13 20:41:20.223490 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.223496 | controller | \ logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.223502 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223508 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.223513 | controller | \ logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.223519 | controller | on port 3000...\n logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223525 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:14 2025-10-13 20:41:20.223530 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.223539 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223545 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223551 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.223556 | controller | 20:37:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.223562 | controller | 15671...\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223568 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:15 | 2025-10-13 20:41:20.223573 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.223579 | controller | \ logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.223585 | controller | on port 15691 match the secret.\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223591 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.223596 | controller | 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.223602 | controller | 3306...\n logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223608 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:16 | 2025-10-13 20:41:20.223613 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.223619 | controller | Ports: 3306)\n logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.223625 | controller | to openstack on port 3306...\n logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223634 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:17 2025-10-13 20:41:20.223640 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.223646 | controller | \ logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.223651 | controller | on port 1981\n logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.223657 | controller | on port 1981\n logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.223663 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223669 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.223674 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.223680 | controller | \ ]\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.223686 | controller | rotation of non API service certificates...\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223691 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.223697 | controller | \ logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.223703 | controller | on port 15691...\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223708 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223721 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223729 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:19 2025-10-13 20:41:20.223737 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.223752 | controller | 20:37:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.223758 | controller | match the secret.\n logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.223764 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.223770 | controller | \ logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.223775 | controller | on port 6642...\n logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223781 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:20 2025-10-13 20:41:20.223787 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.223792 | controller | \ logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.223798 | controller | on port 6644 match the secret.\n logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223804 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223810 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.223815 | controller | 20:37:21 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.223821 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223827 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223832 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.223838 | controller | 20:37:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.223844 | controller | 6643...\n logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223849 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:22 2025-10-13 20:41:20.223855 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.223861 | controller | \ logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.223867 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223872 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.223878 | controller | \ logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.223884 | controller | on port 3000...\n logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223889 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:23 2025-10-13 20:41:20.223895 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.223904 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223910 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223916 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.223922 | controller | 20:37:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.223927 | controller | 15671...\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223933 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:24 | 2025-10-13 20:41:20.223939 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.223947 | controller | \ logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.223953 | controller | on port 15691 match the secret.\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.223959 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.223964 | controller | 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.223970 | controller | 3306...\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.223976 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:25 | 2025-10-13 20:41:20.223981 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.223995 | controller | Ports: 3306)\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.224008 | controller | to openstack on port 3306...\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224016 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:25 2025-10-13 20:41:20.224024 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.224032 | controller | \ logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.224040 | controller | on port 1981\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.224045 | controller | on port 1981\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.224051 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224057 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.224062 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.224068 | controller | \ ]\n logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.224074 | controller | rotation of non API service certificates...\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224080 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.224085 | controller | \ logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.224091 | controller | on port 15691...\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224097 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224102 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224108 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:27 2025-10-13 20:41:20.224114 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.224119 | controller | 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.224125 | controller | match the secret.\n logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.224131 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.224136 | controller | \ logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.224142 | controller | on port 6642...\n logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224148 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:28 2025-10-13 20:41:20.224154 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.224159 | controller | \ logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.224168 | controller | on port 6644 match the secret.\n logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224174 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224180 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.224186 | controller | 20:37:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.224191 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224197 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224203 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.224208 | controller | 20:37:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.224214 | controller | 6643...\n logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224220 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:30 2025-10-13 20:41:20.224225 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.224231 | controller | \ logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.224237 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224242 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.224248 | controller | \ logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.224254 | controller | on port 3000...\n logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224267 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:31 2025-10-13 20:41:20.224275 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.224283 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224290 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224298 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.224304 | controller | 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.224309 | controller | 15671...\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224315 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:32 | 2025-10-13 20:41:20.224321 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.224327 | controller | \ logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.224332 | controller | on port 15691 match the secret.\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224338 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.224344 | controller | 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.224349 | controller | 3306...\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224359 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:33 | 2025-10-13 20:41:20.224365 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.224370 | controller | Ports: 3306)\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.224379 | controller | to openstack on port 3306...\n logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224385 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:34 2025-10-13 20:41:20.224390 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.224399 | controller | \ logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.224421 | controller | on port 1981\n logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.224427 | controller | on port 1981\n logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.224432 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224441 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.224447 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.224453 | controller | \ ]\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.224458 | controller | rotation of non API service certificates...\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224464 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.224470 | controller | \ logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.224476 | controller | on port 15691...\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224481 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224487 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224493 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:36 2025-10-13 20:41:20.224498 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.224504 | controller | 20:37:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.224510 | controller | match the secret.\n logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.224516 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.224521 | controller | \ logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.224527 | controller | on port 6642...\n logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224533 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:37 2025-10-13 20:41:20.224538 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.224544 | controller | \ logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.224550 | controller | on port 6644 match the secret.\n logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224563 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224571 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.224579 | controller | 20:37:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.224587 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224594 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224606 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.224612 | controller | 20:37:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.224618 | controller | 6643...\n logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224624 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:39 2025-10-13 20:41:20.224629 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.224635 | controller | \ logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.224641 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224646 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.224652 | controller | \ logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.224658 | controller | on port 3000...\n logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224663 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:40 2025-10-13 20:41:20.224669 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.224675 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224680 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224686 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.224692 | controller | 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.224698 | controller | 15671...\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224703 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:40 | 2025-10-13 20:41:20.224709 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.224717 | controller | \ logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.224723 | controller | on port 15691 match the secret.\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224728 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.224734 | controller | 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.224740 | controller | 3306...\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224746 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:41 | 2025-10-13 20:41:20.224751 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.224757 | controller | Ports: 3306)\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.224763 | controller | to openstack on port 3306...\n logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224768 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:42 2025-10-13 20:41:20.224774 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.224780 | controller | \ logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.224785 | controller | on port 1981\n logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.224791 | controller | on port 1981\n logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.224797 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224806 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.224811 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.224817 | controller | \ ]\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.224823 | controller | rotation of non API service certificates...\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224836 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.224844 | controller | \ logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.224852 | controller | on port 15691...\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224859 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224867 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224876 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:44 2025-10-13 20:41:20.224881 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.224890 | controller | 20:37:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.224895 | controller | match the secret.\n logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.224901 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.224907 | controller | \ logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.224912 | controller | on port 6642...\n logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224918 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:45 2025-10-13 20:41:20.224924 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.224929 | controller | \ logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.224935 | controller | on port 6644 match the secret.\n logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224941 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224947 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.224953 | controller | 20:37:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.224960 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224966 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.224973 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.224980 | controller | 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.224986 | controller | 6643...\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.224992 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:46 2025-10-13 20:41:20.224997 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.225003 | controller | \ logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.225009 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225017 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.225023 | controller | \ logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.225029 | controller | on port 3000...\n logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225035 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:48 2025-10-13 20:41:20.225040 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.225046 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225052 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225058 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.225064 | controller | 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.225069 | controller | 15671...\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225080 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:48 | 2025-10-13 20:41:20.225086 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.225092 | controller | \ logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.225097 | controller | on port 15691 match the secret.\n logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225103 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.225119 | controller | 20:37:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.225128 | controller | 3306...\n logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225136 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:49 | 2025-10-13 20:41:20.225144 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.225151 | controller | Ports: 3306)\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.225157 | controller | to openstack on port 3306...\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225162 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:50 2025-10-13 20:41:20.225168 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.225174 | controller | \ logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.225180 | controller | on port 1981\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.225186 | controller | on port 1981\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.225191 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225197 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.225203 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.225209 | controller | \ ]\n logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.225214 | controller | rotation of non API service certificates...\n logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225220 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.225226 | controller | \ logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.225232 | controller | on port 15691...\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225240 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225246 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225252 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:52 2025-10-13 20:41:20.225258 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.225263 | controller | 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.225269 | controller | match the secret.\n logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.225275 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.225281 | controller | \ logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.225286 | controller | on port 6642...\n logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225292 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:53 2025-10-13 20:41:20.225298 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.225304 | controller | \ logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.225309 | controller | on port 6644 match the secret.\n logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225318 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225324 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.225330 | controller | 20:37:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.225335 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225341 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225347 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.225353 | controller | 20:37:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.225359 | controller | 6643...\n logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225364 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:55 2025-10-13 20:41:20.225370 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.225376 | controller | \ logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.225389 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225416 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.225424 | controller | \ logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.225430 | controller | on port 3000...\n logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225436 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:56 2025-10-13 20:41:20.225442 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.225448 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225454 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225463 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.225472 | controller | 20:37:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.225478 | controller | 15671...\n logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225484 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:57 | 2025-10-13 20:41:20.225489 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.225495 | controller | \ logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.225501 | controller | on port 15691 match the secret.\n logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225507 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.225512 | controller | 20:37:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.225518 | controller | 3306...\n logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225524 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:58 | 2025-10-13 20:41:20.225530 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.225536 | controller | Ports: 3306)\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.225541 | controller | to openstack on port 3306...\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225547 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:59 2025-10-13 20:41:20.225553 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.225559 | controller | \ logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.225564 | controller | on port 1981\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.225570 | controller | on port 1981\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.225576 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225582 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.225588 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.225593 | controller | \ ]\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.225599 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225605 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.225611 | controller | \ logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.225616 | controller | on port 15691...\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225622 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225628 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225634 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:01 2025-10-13 20:41:20.225640 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.225645 | controller | 20:38:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.225651 | controller | match the secret.\n logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.225657 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.225665 | controller | \ logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.225678 | controller | on port 6642...\n logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225687 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:02 2025-10-13 20:41:20.225695 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.225703 | controller | \ logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.225710 | controller | on port 6644 match the secret.\n logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225716 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225722 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.225728 | controller | 20:38:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.225734 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225739 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225745 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.225751 | controller | 20:38:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.225757 | controller | 6643...\n logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225762 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:04 2025-10-13 20:41:20.225768 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.225774 | controller | \ logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.225780 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225789 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.225794 | controller | \ logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.225800 | controller | on port 3000...\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225806 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:05 2025-10-13 20:41:20.225814 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.225820 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225826 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225831 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.225837 | controller | 20:38:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.225843 | controller | 15671...\n logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225849 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:06 | 2025-10-13 20:41:20.225854 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.225860 | controller | \ logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.225866 | controller | on port 15691 match the secret.\n logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225872 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.225880 | controller | 20:38:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.225886 | controller | 3306...\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.225892 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:07 | 2025-10-13 20:41:20.225897 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.225903 | controller | Ports: 3306)\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.225909 | controller | to openstack on port 3306...\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225915 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:07 2025-10-13 20:41:20.225920 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.225926 | controller | \ logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.225932 | controller | on port 1981\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.225937 | controller | on port 1981\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.225943 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225956 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.225964 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.225972 | controller | \ ]\n logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.225980 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.225988 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.225994 | controller | \ logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.226000 | controller | on port 15691...\n logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226005 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226011 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226017 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:09 2025-10-13 20:41:20.226023 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.226028 | controller | 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.226034 | controller | match the secret.\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.226054 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.226061 | controller | \ logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.226068 | controller | on port 6642...\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226074 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:10 2025-10-13 20:41:20.226081 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.226088 | controller | \ logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.226095 | controller | on port 6644 match the secret.\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226102 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226113 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.226120 | controller | 20:38:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.226127 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226134 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226141 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.226149 | controller | 20:38:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.226156 | controller | 6643...\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226163 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:12 2025-10-13 20:41:20.226170 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.226189 | controller | \ logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.226196 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226203 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.226210 | controller | \ logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.226217 | controller | on port 3000...\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226224 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:13 2025-10-13 20:41:20.226231 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.226238 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226245 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226252 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.226259 | controller | 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.226266 | controller | 15671...\n logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226281 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:14 | 2025-10-13 20:41:20.226288 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.226295 | controller | \ logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.226302 | controller | on port 15691 match the secret.\n logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226312 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.226319 | controller | 20:38:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.226326 | controller | 3306...\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226333 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:15 | 2025-10-13 20:41:20.226340 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.226347 | controller | Ports: 3306)\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.226354 | controller | to openstack on port 3306...\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226361 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:15 2025-10-13 20:41:20.226372 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.226379 | controller | \ logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.226386 | controller | on port 1981\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.226393 | controller | on port 1981\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.226416 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226427 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.226434 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.226441 | controller | \ ]\n logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.226448 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226455 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.226462 | controller | \ logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.226469 | controller | on port 15691...\n logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226476 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226483 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226490 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:18 2025-10-13 20:41:20.226497 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.226504 | controller | 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.226511 | controller | match the secret.\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.226518 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.226525 | controller | \ logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.226532 | controller | on port 6642...\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226539 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:18 2025-10-13 20:41:20.226546 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.226553 | controller | \ logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.226560 | controller | on port 6644 match the secret.\n logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226567 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226574 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.226581 | controller | 20:38:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.226588 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226595 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226602 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.226615 | controller | 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.226622 | controller | 6643...\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226639 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:20 2025-10-13 20:41:20.226646 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.226653 | controller | \ logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.226660 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226667 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.226674 | controller | \ logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.226681 | controller | on port 3000...\n logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226688 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:22 2025-10-13 20:41:20.226695 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.226702 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226709 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226716 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.226723 | controller | 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.226730 | controller | 15671...\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226737 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:22 | 2025-10-13 20:41:20.226744 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.226751 | controller | \ logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.226758 | controller | on port 15691 match the secret.\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226765 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.226772 | controller | 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.226779 | controller | 3306...\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226786 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:23 | 2025-10-13 20:41:20.226793 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.226800 | controller | Ports: 3306)\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.226807 | controller | to openstack on port 3306...\n logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226814 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:24 2025-10-13 20:41:20.226821 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.226828 | controller | \ logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.226835 | controller | on port 1981\n logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.226842 | controller | on port 1981\n logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.226849 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226856 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.226863 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.226874 | controller | \ ]\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.226881 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226891 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.226898 | controller | \ logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.226905 | controller | on port 15691...\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226912 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226919 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.226926 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:26 2025-10-13 20:41:20.226933 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.226944 | controller | 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.226951 | controller | match the secret.\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.226958 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.226965 | controller | \ logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.226972 | controller | on port 6642...\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.226979 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:26 2025-10-13 20:41:20.226986 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.226993 | controller | \ logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.227000 | controller | on port 6644 match the secret.\n logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227007 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227014 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.227021 | controller | 20:38:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.227028 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227035 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227042 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.227053 | controller | 20:38:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.227060 | controller | 6643...\n logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227067 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:28 2025-10-13 20:41:20.227074 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.227081 | controller | \ logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.227088 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227095 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.227102 | controller | \ logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.227109 | controller | on port 3000...\n logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227119 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:29 2025-10-13 20:41:20.227126 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.227133 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227140 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227147 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.227154 | controller | 20:38:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.227161 | controller | 15671...\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227168 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:30 | 2025-10-13 20:41:20.227175 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.227182 | controller | \ logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.227189 | controller | on port 15691 match the secret.\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227196 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.227203 | controller | 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.227210 | controller | 3306...\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227217 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:31 | 2025-10-13 20:41:20.227224 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.227231 | controller | Ports: 3306)\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.227238 | controller | to openstack on port 3306...\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227245 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:31 2025-10-13 20:41:20.227256 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.227263 | controller | \ logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.227270 | controller | on port 1981\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.227277 | controller | on port 1981\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.227284 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227291 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.227298 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.227305 | controller | \ ]\n logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.227312 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227319 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.227326 | controller | \ logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.227333 | controller | on port 15691...\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227340 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227348 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227358 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:33 2025-10-13 20:41:20.227365 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.227372 | controller | 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.227379 | controller | match the secret.\n logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.227386 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.227397 | controller | \ logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.227424 | controller | on port 6642...\n logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227432 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:34 2025-10-13 20:41:20.227442 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.227449 | controller | \ logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.227457 | controller | on port 6644 match the secret.\n logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227464 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227471 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.227478 | controller | 20:38:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.227486 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227493 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227500 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.227507 | controller | 20:38:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.227515 | controller | 6643...\n logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227522 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:36 2025-10-13 20:41:20.227529 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.227536 | controller | \ logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.227543 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227551 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.227558 | controller | \ logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.227565 | controller | on port 3000...\n logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227572 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:37 2025-10-13 20:41:20.227579 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.227587 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227598 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227605 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.227612 | controller | 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.227620 | controller | 15671...\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227630 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:38 | 2025-10-13 20:41:20.227638 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.227645 | controller | \ logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.227652 | controller | on port 15691 match the secret.\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227659 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.227666 | controller | 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.227673 | controller | 3306...\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227681 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:39 | 2025-10-13 20:41:20.227688 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.227695 | controller | Ports: 3306)\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.227702 | controller | to openstack on port 3306...\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227709 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:39 2025-10-13 20:41:20.227716 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.227724 | controller | \ logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.227731 | controller | on port 1981\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.227738 | controller | on port 1981\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.227745 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227752 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.227759 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.227767 | controller | \ ]\n logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.227774 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227781 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.227788 | controller | \ logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.227795 | controller | on port 15691...\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227803 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227810 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227817 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:41 2025-10-13 20:41:20.227824 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.227831 | controller | 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.227839 | controller | match the secret.\n logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.227849 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.227856 | controller | \ logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.227864 | controller | on port 6642...\n logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227874 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:42 2025-10-13 20:41:20.227882 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.227889 | controller | \ logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.227896 | controller | on port 6644 match the secret.\n logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227903 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227910 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.227921 | controller | 20:38:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.227932 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227939 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227946 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.227954 | controller | 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.227961 | controller | 6643...\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.227968 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:44 2025-10-13 20:41:20.227975 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.227983 | controller | \ logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.227990 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.227997 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.228004 | controller | \ logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.228011 | controller | on port 3000...\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228019 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:46 2025-10-13 20:41:20.228026 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.228033 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228040 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228051 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.228058 | controller | 20:38:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.228065 | controller | 15671...\n logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228072 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:47 | 2025-10-13 20:41:20.228080 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.228087 | controller | \ logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.228094 | controller | on port 15691 match the secret.\n logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228101 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.228108 | controller | 20:38:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.228115 | controller | 3306...\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228126 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:48 | 2025-10-13 20:41:20.228133 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.228140 | controller | Ports: 3306)\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.228147 | controller | to openstack on port 3306...\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228155 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:48 2025-10-13 20:41:20.228162 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.228169 | controller | \ logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.228176 | controller | on port 1981\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.228183 | controller | on port 1981\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.228191 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228198 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.228205 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.228212 | controller | \ ]\n logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.228220 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228227 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.228234 | controller | \ logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.228241 | controller | on port 15691...\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228255 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228263 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228270 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:50 2025-10-13 20:41:20.228277 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.228284 | controller | 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.228292 | controller | match the secret.\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.228299 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.228306 | controller | \ logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.228313 | controller | on port 6642...\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228320 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:51 2025-10-13 20:41:20.228328 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.228335 | controller | \ logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.228342 | controller | on port 6644 match the secret.\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228349 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228356 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.228364 | controller | 20:38:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.228377 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228384 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228395 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.228414 | controller | 20:38:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.228425 | controller | 6643...\n logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228433 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:53 2025-10-13 20:41:20.228441 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.228448 | controller | \ logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.228456 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228464 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.228471 | controller | \ logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.228477 | controller | on port 3000...\n logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228486 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:54 2025-10-13 20:41:20.228492 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.228497 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228503 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228509 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.228515 | controller | 20:38:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.228520 | controller | 15671...\n logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228526 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:55 | 2025-10-13 20:41:20.228532 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.228537 | controller | \ logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.228543 | controller | on port 15691 match the secret.\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228549 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.228555 | controller | 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.228560 | controller | 3306...\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228566 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:56 | 2025-10-13 20:41:20.228581 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.228589 | controller | Ports: 3306)\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.228597 | controller | to openstack on port 3306...\n logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228605 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:57 2025-10-13 20:41:20.228613 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.228620 | controller | \ logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.228630 | controller | on port 1981\n logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.228636 | controller | on port 1981\n logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.228642 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228648 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.228654 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.228659 | controller | \ ]\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.228665 | controller | rotation of non API service certificates...\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228671 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.228680 | controller | \ logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.228685 | controller | on port 15691...\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228691 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228697 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228703 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:58 2025-10-13 20:41:20.228708 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.228714 | controller | 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.228720 | controller | match the secret.\n logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.228725 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.228731 | controller | \ logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.228737 | controller | on port 6642...\n logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228742 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:59 2025-10-13 20:41:20.228748 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.228754 | controller | \ logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.228760 | controller | on port 6644 match the secret.\n logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228765 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228771 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.228777 | controller | 20:39:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.228783 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228788 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228794 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.228800 | controller | 20:39:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.228806 | controller | 6643...\n logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228814 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:01 2025-10-13 20:41:20.228819 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.228828 | controller | \ logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.228833 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228839 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.228852 | controller | \ logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.228861 | controller | on port 3000...\n logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228869 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:02 2025-10-13 20:41:20.228877 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.228885 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228891 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228896 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.228902 | controller | 20:39:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.228908 | controller | 15671...\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228914 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:03 | 2025-10-13 20:41:20.228919 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.228925 | controller | \ logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.228931 | controller | on port 15691 match the secret.\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228937 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.228942 | controller | 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.228948 | controller | 3306...\n logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.228954 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:04 | 2025-10-13 20:41:20.228960 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.228965 | controller | Ports: 3306)\n logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.228971 | controller | to openstack on port 3306...\n logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.228977 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:05 2025-10-13 20:41:20.228983 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.228988 | controller | \ logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.228994 | controller | on port 1981\n logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.229003 | controller | on port 1981\n logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.229009 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229015 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.229020 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.229029 | controller | \ ]\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.229034 | controller | rotation of non API service certificates...\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229043 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.229049 | controller | \ logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.229054 | controller | on port 15691...\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229060 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229066 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229072 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:07 2025-10-13 20:41:20.229078 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.229083 | controller | 20:39:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.229089 | controller | match the secret.\n logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.229095 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.229100 | controller | \ logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.229106 | controller | on port 6642...\n logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229112 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:08 2025-10-13 20:41:20.229118 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.229131 | controller | \ logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.229140 | controller | on port 6644 match the secret.\n logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229148 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229156 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.229163 | controller | 20:39:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.229170 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229175 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229181 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.229187 | controller | 20:39:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.229193 | controller | 6643...\n logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229199 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:10 2025-10-13 20:41:20.229204 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.229210 | controller | \ logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.229216 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229221 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.229227 | controller | \ logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.229233 | controller | on port 3000...\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229239 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:11 2025-10-13 20:41:20.229244 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.229253 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229259 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229265 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.229271 | controller | 20:39:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.229276 | controller | 15671...\n logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229282 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:12 | 2025-10-13 20:41:20.229288 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.229294 | controller | \ logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.229299 | controller | on port 15691 match the secret.\n logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229305 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.229311 | controller | 20:39:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.229317 | controller | 3306...\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229322 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:13 | 2025-10-13 20:41:20.229328 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.229334 | controller | Ports: 3306)\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.229339 | controller | to openstack on port 3306...\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229345 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:13 2025-10-13 20:41:20.229351 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.229357 | controller | \ logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.229365 | controller | on port 1981\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.229371 | controller | on port 1981\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.229377 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229382 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.229388 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.229418 | controller | \ ]\n logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.229432 | controller | rotation of non API service certificates...\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229439 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.229445 | controller | \ logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.229451 | controller | on port 15691...\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229457 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229466 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229472 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:15 2025-10-13 20:41:20.229478 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.229486 | controller | 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.229492 | controller | match the secret.\n logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.229498 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.229503 | controller | \ logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.229509 | controller | on port 6642...\n logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229515 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:16 2025-10-13 20:41:20.229521 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.229526 | controller | \ logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.229532 | controller | on port 6644 match the secret.\n logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229538 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229544 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.229549 | controller | 20:39:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.229555 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229561 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229567 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.229573 | controller | 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.229578 | controller | 6643...\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229584 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:18 2025-10-13 20:41:20.229590 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.229596 | controller | \ logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.229601 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229607 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.229613 | controller | \ logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.229619 | controller | on port 3000...\n logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229624 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:20 2025-10-13 20:41:20.229630 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.229636 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229642 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229649 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.229657 | controller | 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.229664 | controller | 15671...\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229672 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:20 | 2025-10-13 20:41:20.229679 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.229689 | controller | \ logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.229702 | controller | on port 15691 match the secret.\n logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229710 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.229716 | controller | 20:39:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.229723 | controller | 3306...\n logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229730 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:21 | 2025-10-13 20:41:20.229737 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.229744 | controller | Ports: 3306)\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.229751 | controller | to openstack on port 3306...\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229758 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:22 2025-10-13 20:41:20.229769 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.229777 | controller | \ logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.229785 | controller | on port 1981\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.229792 | controller | on port 1981\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.229799 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229805 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.229811 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.229817 | controller | \ ]\n logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.229822 | controller | rotation of non API service certificates...\n logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229828 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.229834 | controller | \ logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.229839 | controller | on port 15691...\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229845 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229851 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229856 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:24 2025-10-13 20:41:20.229862 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.229868 | controller | 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.229873 | controller | match the secret.\n logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.229879 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.229885 | controller | \ logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.229890 | controller | on port 6642...\n logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229896 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:25 2025-10-13 20:41:20.229902 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.229908 | controller | \ logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.229922 | controller | on port 6644 match the secret.\n logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229928 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229933 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.229939 | controller | 20:39:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.229945 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229950 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.229956 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.229962 | controller | 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.229968 | controller | 6643...\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.229973 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:27 2025-10-13 20:41:20.229988 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.229996 | controller | \ logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.230003 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230011 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.230018 | controller | \ logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.230025 | controller | on port 3000...\n logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230030 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:29 2025-10-13 20:41:20.230036 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.230042 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230047 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230053 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.230059 | controller | 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.230064 | controller | 15671...\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230070 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:29 | 2025-10-13 20:41:20.230094 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.230100 | controller | \ logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.230106 | controller | on port 15691 match the secret.\n logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230112 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.230117 | controller | 20:39:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.230123 | controller | 3306...\n logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230129 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:31 | 2025-10-13 20:41:20.230134 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.230140 | controller | Ports: 3306)\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.230152 | controller | to openstack on port 3306...\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230158 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:31 2025-10-13 20:41:20.230164 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.230169 | controller | \ logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.230175 | controller | on port 1981\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.230181 | controller | on port 1981\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.230186 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230192 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.230198 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.230203 | controller | \ ]\n logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.230209 | controller | rotation of non API service certificates...\n logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230215 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.230220 | controller | \ logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.230226 | controller | on port 15691...\n logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230232 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230237 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230243 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:33 2025-10-13 20:41:20.230249 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.230254 | controller | 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.230260 | controller | match the secret.\n logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.230273 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.230281 | controller | \ logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.230289 | controller | on port 6642...\n logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230297 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:34 2025-10-13 20:41:20.230302 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.230308 | controller | \ logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.230314 | controller | on port 6644 match the secret.\n logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230320 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230325 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.230331 | controller | 20:39:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.230337 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230342 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230351 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.230357 | controller | 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.230363 | controller | 6643...\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230369 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:36 2025-10-13 20:41:20.230374 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.230380 | controller | \ logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.230389 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230395 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.230419 | controller | \ logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.230431 | controller | on port 3000...\n logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230439 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:38 2025-10-13 20:41:20.230447 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.230454 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230461 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230468 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.230474 | controller | 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.230480 | controller | 15671...\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230486 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:38 | 2025-10-13 20:41:20.230491 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.230497 | controller | \ logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.230503 | controller | on port 15691 match the secret.\n logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230508 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.230514 | controller | 20:39:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.230520 | controller | 3306...\n logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230525 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:40 | 2025-10-13 20:41:20.230535 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.230540 | controller | Ports: 3306)\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.230546 | controller | to openstack on port 3306...\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230552 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:40 2025-10-13 20:41:20.230557 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.230563 | controller | \ logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.230569 | controller | on port 1981\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.230583 | controller | on port 1981\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.230591 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230602 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.230610 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.230617 | controller | \ ]\n logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.230625 | controller | rotation of non API service certificates...\n logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230632 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.230639 | controller | \ logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.230644 | controller | on port 15691...\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230650 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230656 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230661 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:42 2025-10-13 20:41:20.230667 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.230673 | controller | 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.230678 | controller | match the secret.\n logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.230684 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.230690 | controller | \ logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.230695 | controller | on port 6642...\n logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230701 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:43 2025-10-13 20:41:20.230707 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.230712 | controller | \ logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.230718 | controller | on port 6644 match the secret.\n logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230724 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230729 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.230735 | controller | 20:39:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.230741 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230746 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230752 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.230758 | controller | 20:39:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.230763 | controller | 6643...\n logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230769 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:45 2025-10-13 20:41:20.230775 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.230780 | controller | \ logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.230786 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230795 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.230801 | controller | \ logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.230806 | controller | on port 3000...\n logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230812 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:46 2025-10-13 20:41:20.230818 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.230823 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230829 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230835 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.230847 | controller | 20:39:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.230855 | controller | 15671...\n logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230863 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:47 | 2025-10-13 20:41:20.230870 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.230876 | controller | \ logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.230885 | controller | on port 15691 match the secret.\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230891 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.230896 | controller | 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.230904 | controller | 3306...\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.230910 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:48 | 2025-10-13 20:41:20.230916 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.230922 | controller | Ports: 3306)\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.230927 | controller | to openstack on port 3306...\n logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230933 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:49 2025-10-13 20:41:20.230939 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.230944 | controller | \ logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.230950 | controller | on port 1981\n logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.230956 | controller | on port 1981\n logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.230961 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230967 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.230973 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.230978 | controller | \ ]\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.230984 | controller | rotation of non API service certificates...\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.230989 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.230995 | controller | \ logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.231001 | controller | on port 15691...\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231009 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231015 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231021 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:51 2025-10-13 20:41:20.231027 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.231032 | controller | 20:39:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.231038 | controller | match the secret.\n logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.231044 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.231049 | controller | \ logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.231055 | controller | on port 6642...\n logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231061 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:52 2025-10-13 20:41:20.231066 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.231072 | controller | \ logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.231078 | controller | on port 6644 match the secret.\n logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231083 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231089 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.231095 | controller | 20:39:53 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.231100 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231113 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231121 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.231129 | controller | 20:39:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.231137 | controller | 6643...\n logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231144 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:54 2025-10-13 20:41:20.231151 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.231157 | controller | \ logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.231162 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231168 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.231174 | controller | \ logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.231179 | controller | on port 3000...\n logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231185 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:55 2025-10-13 20:41:20.231191 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.231196 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231202 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231211 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.231217 | controller | 20:39:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.231223 | controller | 15671...\n logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231228 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:56 | 2025-10-13 20:41:20.231237 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.231243 | controller | \ logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.231248 | controller | on port 15691 match the secret.\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231254 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.231260 | controller | 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.231265 | controller | 3306...\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231271 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:57 | 2025-10-13 20:41:20.231277 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.231283 | controller | Ports: 3306)\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.231288 | controller | to openstack on port 3306...\n logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231294 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:58 2025-10-13 20:41:20.231300 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.231305 | controller | \ logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.231311 | controller | on port 1981\n logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.231317 | controller | on port 1981\n logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.231322 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231328 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.231336 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.231342 | controller | \ ]\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.231348 | controller | rotation of non API service certificates...\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231354 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.231360 | controller | \ logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.231366 | controller | on port 15691...\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231371 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231377 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231390 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:00 2025-10-13 20:41:20.231415 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.231427 | controller | 20:40:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.231435 | controller | match the secret.\n logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.231442 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.231455 | controller | \ logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.231461 | controller | on port 6642...\n logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231467 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:01 2025-10-13 20:41:20.231472 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.231478 | controller | \ logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.231484 | controller | on port 6644 match the secret.\n logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231490 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231498 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.231504 | controller | 20:40:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.231510 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231516 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231521 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.231527 | controller | 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.231533 | controller | 6643...\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231538 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:02 2025-10-13 20:41:20.231544 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.231550 | controller | \ logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.231556 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231561 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.231567 | controller | \ logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.231573 | controller | on port 3000...\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231578 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:04 2025-10-13 20:41:20.231584 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.231590 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231595 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231601 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.231607 | controller | 20:40:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.231615 | controller | 15671...\n logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231621 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:05 | 2025-10-13 20:41:20.231626 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.231632 | controller | \ logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.231638 | controller | on port 15691 match the secret.\n logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231643 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.231652 | controller | 20:40:05 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.231658 | controller | 3306...\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231663 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:06 | 2025-10-13 20:41:20.231669 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.231675 | controller | Ports: 3306)\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.231689 | controller | to openstack on port 3306...\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231697 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:06 2025-10-13 20:41:20.231705 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.231712 | controller | \ logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.231718 | controller | on port 1981\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.231723 | controller | on port 1981\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.231729 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231735 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.231740 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.231746 | controller | \ ]\n logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.231752 | controller | rotation of non API service certificates...\n logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231757 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.231763 | controller | \ logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.231769 | controller | on port 15691...\n logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231774 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231780 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231786 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:09 2025-10-13 20:41:20.231792 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.231800 | controller | 20:40:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.231806 | controller | match the secret.\n logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.231812 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.231817 | controller | \ logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.231823 | controller | on port 6642...\n logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231829 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:10 2025-10-13 20:41:20.231835 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.231840 | controller | \ logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.231846 | controller | on port 6644 match the secret.\n logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231852 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231860 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.231866 | controller | 20:40:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.231872 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231877 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231883 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.231889 | controller | 20:40:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.231895 | controller | 6643...\n logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231900 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:12 2025-10-13 20:41:20.231906 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.231911 | controller | \ logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.231917 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231923 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.231928 | controller | \ logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.231934 | controller | on port 3000...\n logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231940 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:13 2025-10-13 20:41:20.231955 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.231963 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231971 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.231978 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.231983 | controller | 20:40:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.231989 | controller | 15671...\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.231995 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:14 | 2025-10-13 20:41:20.232000 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.232006 | controller | \ logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.232012 | controller | on port 15691 match the secret.\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232017 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.232023 | controller | 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.232028 | controller | 3306...\n logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232034 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:15 | 2025-10-13 20:41:20.232040 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.232045 | controller | Ports: 3306)\n logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.232051 | controller | to openstack on port 3306...\n logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232057 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:16 2025-10-13 20:41:20.232065 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.232071 | controller | \ logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.232077 | controller | on port 1981\n logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.232082 | controller | on port 1981\n logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.232088 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232094 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.232099 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.232105 | controller | \ ]\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.232111 | controller | rotation of non API service certificates...\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232116 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.232122 | controller | \ logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.232128 | controller | on port 15691...\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232133 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232139 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232145 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:18 2025-10-13 20:41:20.232150 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.232156 | controller | 20:40:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.232161 | controller | match the secret.\n logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.232167 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.232173 | controller | \ logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.232178 | controller | on port 6642...\n logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232184 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:19 2025-10-13 20:41:20.232190 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.232195 | controller | \ logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.232201 | controller | on port 6644 match the secret.\n logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232213 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232221 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.232233 | controller | 20:40:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.232239 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232245 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232250 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.232256 | controller | 20:40:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.232262 | controller | 6643...\n logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232271 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:21 2025-10-13 20:41:20.232277 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.232283 | controller | \ logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.232288 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232294 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.232302 | controller | \ logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.232308 | controller | on port 3000...\n logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232314 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:22 2025-10-13 20:41:20.232319 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.232325 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232331 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232336 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.232342 | controller | 20:40:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.232348 | controller | 15671...\n logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232353 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:23 | 2025-10-13 20:41:20.232359 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.232365 | controller | \ logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.232370 | controller | on port 15691 match the secret.\n logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232376 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.232382 | controller | 20:40:24 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.232387 | controller | 3306...\n logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232397 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:24 | 2025-10-13 20:41:20.232418 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.232430 | controller | Ports: 3306)\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.232437 | controller | to openstack on port 3306...\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232442 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:25 2025-10-13 20:41:20.232448 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.232454 | controller | \ logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.232460 | controller | on port 1981\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.232465 | controller | on port 1981\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.232471 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232477 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.232482 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.232491 | controller | \ ]\n logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.232497 | controller | rotation of non API service certificates...\n logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232503 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.232516 | controller | \ logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.232524 | controller | on port 15691...\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232532 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232540 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232547 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:27 2025-10-13 20:41:20.232554 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.232561 | controller | 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.232566 | controller | match the secret.\n logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.232572 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.232578 | controller | \ logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.232584 | controller | on port 6642...\n logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232590 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:28 2025-10-13 20:41:20.232595 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.232601 | controller | \ logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.232607 | controller | on port 6644 match the secret.\n logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232612 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232618 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.232624 | controller | 20:40:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.232629 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232635 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232641 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.232646 | controller | 20:40:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.232652 | controller | 6643...\n logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232658 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:30 2025-10-13 20:41:20.232667 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.232672 | controller | \ logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.232678 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232684 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.232690 | controller | \ logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.232697 | controller | on port 3000...\n logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232714 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:31 2025-10-13 20:41:20.232719 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.232725 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232731 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232736 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.232742 | controller | 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.232748 | controller | 15671...\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232753 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:32 | 2025-10-13 20:41:20.232759 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.232765 | controller | \ logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.232770 | controller | on port 15691 match the secret.\n logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232776 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.232788 | controller | 20:40:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.232796 | controller | 3306...\n logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232804 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:33 | 2025-10-13 20:41:20.232811 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.232817 | controller | Ports: 3306)\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.232823 | controller | to openstack on port 3306...\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232828 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:34 2025-10-13 20:41:20.232834 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.232840 | controller | \ logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.232845 | controller | on port 1981\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.232851 | controller | on port 1981\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.232857 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232862 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.232868 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.232874 | controller | \ ]\n logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.232879 | controller | rotation of non API service certificates...\n logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232885 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.232891 | controller | \ logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.232896 | controller | on port 15691...\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232902 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232908 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232919 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:36 2025-10-13 20:41:20.232925 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.232930 | controller | 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.232936 | controller | match the secret.\n logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.232942 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.232947 | controller | \ logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.232953 | controller | on port 6642...\n logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.232959 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:37 2025-10-13 20:41:20.232964 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.232970 | controller | \ logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.232976 | controller | on port 6644 match the secret.\n logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232981 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.232987 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.232993 | controller | 20:40:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.232999 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233004 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233010 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.233016 | controller | 20:40:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.233024 | controller | 6643...\n logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233030 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:39 2025-10-13 20:41:20.233036 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.233041 | controller | \ logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.233054 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233062 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.233069 | controller | \ logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.233076 | controller | on port 3000...\n logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233082 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:40 2025-10-13 20:41:20.233088 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.233093 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233099 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233104 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.233110 | controller | 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.233116 | controller | 15671...\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233125 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:41 | 2025-10-13 20:41:20.233130 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.233136 | controller | \ logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.233142 | controller | on port 15691 match the secret.\n logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233147 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.233156 | controller | 20:40:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.233161 | controller | 3306...\n logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233167 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:42 | 2025-10-13 20:41:20.233173 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.233178 | controller | Ports: 3306)\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.233184 | controller | to openstack on port 3306...\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233190 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:43 2025-10-13 20:41:20.233195 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.233201 | controller | \ logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.233207 | controller | on port 1981\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.233212 | controller | on port 1981\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.233218 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233224 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.233229 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.233235 | controller | \ ]\n logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.233241 | controller | rotation of non API service certificates...\n logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233246 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.233252 | controller | \ logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.233258 | controller | on port 15691...\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233263 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233269 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233275 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:45 2025-10-13 20:41:20.233280 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.233286 | controller | 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.233292 | controller | match the secret.\n logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.233297 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.233303 | controller | \ logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.233309 | controller | on port 6642...\n logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233323 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:46 2025-10-13 20:41:20.233331 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.233343 | controller | \ logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.233349 | controller | on port 6644 match the secret.\n logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233354 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233360 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.233366 | controller | 20:40:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.233371 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233377 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233383 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.233389 | controller | 20:40:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.233398 | controller | 6643...\n logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233425 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:48 2025-10-13 20:41:20.233434 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.233441 | controller | \ logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.233448 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233453 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.233459 | controller | \ logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.233465 | controller | on port 3000...\n logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233470 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:49 2025-10-13 20:41:20.233476 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.233482 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233487 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233493 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.233499 | controller | 20:40:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.233504 | controller | 15671...\n logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233510 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:50 | 2025-10-13 20:41:20.233516 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.233521 | controller | \ logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.233527 | controller | on port 15691 match the secret.\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233533 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.233538 | controller | 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.233544 | controller | 3306...\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233553 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:51 | 2025-10-13 20:41:20.233559 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.233565 | controller | Ports: 3306)\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.233570 | controller | to openstack on port 3306...\n logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233576 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:52 2025-10-13 20:41:20.233582 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.233587 | controller | \ logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.233593 | controller | on port 1981\n logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.233599 | controller | on port 1981\n logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.233604 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233618 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.233626 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.233634 | controller | \ ]\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.233641 | controller | rotation of non API service certificates...\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233648 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.233656 | controller | \ logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.233662 | controller | on port 15691...\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233671 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233677 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233683 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:54 2025-10-13 20:41:20.233688 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.233694 | controller | 20:40:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.233700 | controller | match the secret.\n logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.233705 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.233714 | controller | \ logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.233719 | controller | on port 6642...\n logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233725 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:55 2025-10-13 20:41:20.233731 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.233736 | controller | \ logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.233742 | controller | on port 6644 match the secret.\n logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233748 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233754 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.233760 | controller | 20:40:56 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.233769 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233775 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233780 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.233786 | controller | 20:40:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.233792 | controller | 6643...\n logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233797 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:57 2025-10-13 20:41:20.233803 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.233809 | controller | \ logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.233814 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233820 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.233826 | controller | \ logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.233832 | controller | on port 3000...\n logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233837 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:58 2025-10-13 20:41:20.233843 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.233849 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233854 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233860 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.233866 | controller | 20:40:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.233871 | controller | 15671...\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233877 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:59 | 2025-10-13 20:41:20.233889 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.233897 | controller | \ logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.233905 | controller | on port 15691 match the secret.\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233912 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.233918 | controller | 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.233923 | controller | 3306...\n logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.233929 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:41:00 | 2025-10-13 20:41:20.233935 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.233940 | controller | Ports: 3306)\n logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.233946 | controller | to openstack on port 3306...\n logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233951 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:41:01 2025-10-13 20:41:20.233957 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.233963 | controller | \ logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.233971 | controller | on port 1981\n logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.233977 | controller | on port 1981\n logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.233983 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.233989 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.233994 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.234000 | controller | \ ]\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.234005 | controller | rotation of non API service certificates...\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234011 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.234017 | controller | \ logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.234023 | controller | on port 15691...\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234028 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234034 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234040 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:41:03 2025-10-13 20:41:20.234045 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.234051 | controller | 20:41:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.234060 | controller | match the secret.\n logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.234065 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.234071 | controller | \ logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.234077 | controller | on port 6642...\n logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234085 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:41:04 2025-10-13 20:41:20.234090 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.234096 | controller | \ logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.234102 | controller | on port 6644 match the secret.\n logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234111 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234131 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.234137 | controller | 20:41:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.234143 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234148 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234154 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.234160 | controller | 20:41:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.234172 | controller | 6643...\n logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234180 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:41:06 2025-10-13 20:41:20.234188 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.234199 | controller | \ logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.234204 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234210 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.234216 | controller | \ logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.234221 | controller | on port 3000...\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234227 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:41:07 2025-10-13 20:41:20.234233 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.234238 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234244 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234250 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.234256 | controller | 20:41:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.234261 | controller | 15671...\n logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234267 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:41:08 | 2025-10-13 20:41:20.234273 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.234278 | controller | \ logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.234284 | controller | on port 15691 match the secret.\n logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234290 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.234295 | controller | 20:41:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.234301 | controller | 3306...\n logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234307 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:41:09 | 2025-10-13 20:41:20.234312 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.234318 | controller | Ports: 3306)\n logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.234324 | controller | to openstack on port 3306...\n logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234330 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:41:10 2025-10-13 20:41:20.234335 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.234341 | controller | \ logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.234347 | controller | on port 1981\n logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.234352 | controller | on port 1981\n logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.234358 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234364 | controller | | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n 2025-10-13 20:41:20.234369 | controller | \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n 2025-10-13 20:41:20.234375 | controller | \ ]\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Checking 2025-10-13 20:41:20.234381 | controller | rotation of non API service certificates...\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234389 | controller | | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n 2025-10-13 20:41:20.234395 | controller | \ logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.234433 | controller | on port 15691...\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234441 | controller | for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234449 | controller | | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234455 | controller | | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:41:12 2025-10-13 20:41:20.234461 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 2025-10-13 20:41:20.234475 | controller | 20:41:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 2025-10-13 20:41:20.234483 | controller | match the secret.\n logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | 2025-10-13 20:41:20.234491 | controller | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n 2025-10-13 20:41:20.234498 | controller | \ logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.234506 | controller | on port 6642...\n logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234513 | controller | for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:41:13 2025-10-13 20:41:20.234520 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n 2025-10-13 20:41:20.234526 | controller | \ logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.234532 | controller | on port 6644 match the secret.\n logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234537 | controller | | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234543 | controller | | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 2025-10-13 20:41:20.234549 | controller | 20:41:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 2025-10-13 20:41:20.234555 | controller | 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234564 | controller | | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234572 | controller | | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 2025-10-13 20:41:20.234577 | controller | 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 2025-10-13 20:41:20.234583 | controller | 6643...\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234589 | controller | for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:41:14 2025-10-13 20:41:20.234594 | controller | | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n 2025-10-13 20:41:20.234600 | controller | \ logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.234606 | controller | on port 1981 DO NOT match the secret.\n logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234611 | controller | | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n 2025-10-13 20:41:20.234617 | controller | \ logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.234623 | controller | on port 3000...\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234628 | controller | for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:41:16 2025-10-13 20:41:20.234634 | controller | | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, 2025-10-13 20:41:20.234643 | controller | Ports: 5671 15671 15691)\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234649 | controller | | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234654 | controller | | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 2025-10-13 20:41:20.234660 | controller | 20:41:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 2025-10-13 20:41:20.234666 | controller | 15671...\n logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234671 | controller | for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:41:17 | 2025-10-13 20:41:20.234677 | controller | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n 2025-10-13 20:41:20.234683 | controller | \ logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.234688 | controller | on port 15691 match the secret.\n logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234694 | controller | | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 2025-10-13 20:41:20.234700 | controller | 20:41:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 2025-10-13 20:41:20.234706 | controller | 3306...\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Certificates 2025-10-13 20:41:20.234711 | controller | for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:41:18 | 2025-10-13 20:41:20.234717 | controller | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, 2025-10-13 20:41:20.234722 | controller | Ports: 3306)\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Connecting 2025-10-13 20:41:20.234728 | controller | to openstack on port 3306...\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234734 | controller | | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:41:18 2025-10-13 20:41:20.234740 | controller | | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n 2025-10-13 20:41:20.234753 | controller | \ logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.234761 | controller | on port 1981\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.234769 | controller | on port 1981\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | command 2025-10-13 20:41:20.234776 | controller | failure, skipping 2 additional commands\n logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation/4- 2025-10-13 20:41:20.234784 | controller | | test step failed 4-\n case.go:396: failed in step 4-\n case.go:398: command 2025-10-13 20:41:20.234790 | controller | \"echo \\\"Checking rotation of non API service certificates...\\\"\\\\n NAMES...\" 2025-10-13 20:41:20.234799 | controller | failed, exit status 1\n logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation | 2025-10-13 20:41:20.234805 | controller | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests 2025-10-13 20:41:20.234811 | controller | finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: 2025-10-13 20:41:20.234816 | controller | \"\"\n--- FAIL: kuttl (1314.18s)\n --- FAIL: kuttl/harness (0.00s)\n --- 2025-10-13 20:41:20.234822 | controller | FAIL: kuttl/harness/ctlplane-tls-cert-rotation (1312.57s)\nFAIL\nmake[1]: *** [Makefile:2080: 2025-10-13 20:41:20.234828 | controller | openstack_kuttl_run] Error 1\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake: 2025-10-13 20:41:20.234834 | controller | *** [Makefile:2102: openstack_kuttl] Error 2\n" 2025-10-13 20:41:20.234840 | controller | stdout_lines: 2025-10-13 20:41:20.234846 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls ~/ci-framework-data/artifacts 2025-10-13 20:41:20.234851 | controller | - 'error: the server doesn''t have a resource type "openstackversion"' 2025-10-13 20:41:20.234857 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.234868 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.234874 | controller | - + '[' -z openstack-kuttl-tests ']' 2025-10-13 20:41:20.234880 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests 2025-10-13 20:41:20.234885 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests 2025-10-13 20:41:20.234891 | controller | ']' 2025-10-13 20:41:20.234897 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests 2025-10-13 20:41:20.234903 | controller | - + cat 2025-10-13 20:41:20.234908 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/namespace.yaml 2025-10-13 20:41:20.234914 | controller | - namespace/openstack-kuttl-tests created 2025-10-13 20:41:20.234920 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io openstack-kuttl-tests); 2025-10-13 20:41:20.234926 | controller | do sleep 1; done" 2025-10-13 20:41:20.234931 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.234937 | controller | - openstack-kuttl-tests Active 2025-10-13 20:41:20.234943 | controller | - oc project openstack-kuttl-tests 2025-10-13 20:41:20.234949 | controller | - Now using project "openstack-kuttl-tests" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.234955 | controller | - bash scripts/gen-input-kustomize.sh 2025-10-13 20:41:20.234960 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.234966 | controller | - + '[' -z openstack-kuttl-tests ']' 2025-10-13 20:41:20.234972 | controller | - + '[' -z osp-secret ']' 2025-10-13 20:41:20.234978 | controller | - + '[' -z 12345678 ']' 2025-10-13 20:41:20.234983 | controller | - + '[' -z 1234567842 ']' 2025-10-13 20:41:20.234989 | controller | - + '[' -z 767c3ed056cbaa3b9dfedb8c6f825bf0 ']' 2025-10-13 20:41:20.234995 | controller | - + '[' -z sEFmdFjDUqRM2VemYslV5yGNWjokioJXsg8Nrlc3drU= ']' 2025-10-13 20:41:20.235001 | controller | - + '[' -z COX8bmlKAWn56XCGMrKQJj7dgHNAOl6f ']' 2025-10-13 20:41:20.235007 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.235015 | controller | - + '[' -z libvirt-secret ']' 2025-10-13 20:41:20.235021 | controller | - + DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.235039 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.235046 | controller | ']' 2025-10-13 20:41:20.235051 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.235057 | controller | - + pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.235063 | controller | - ~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.235068 | controller | - + cat 2025-10-13 20:41:20.235074 | controller | - oc get secret/osp-secret || oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input 2025-10-13 20:41:20.235080 | controller | | oc apply -f - 2025-10-13 20:41:20.235086 | controller | - 'Error from server (NotFound): secrets "osp-secret" not found' 2025-10-13 20:41:20.235094 | controller | - secret/libvirt-secret created 2025-10-13 20:41:20.235100 | controller | - secret/octavia-ca-passphrase created 2025-10-13 20:41:20.235105 | controller | - secret/osp-secret created 2025-10-13 20:41:20.235111 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr 2025-10-13 20:41:20.235117 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235123 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr'' 2025-10-13 20:41:20.235129 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila: 2025-10-13 20:41:20.235135 | controller | no such file or directory' 2025-10-13 20:41:20.235148 | controller | - No resources found 2025-10-13 20:41:20.235157 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator 2025-10-13 20:41:20.235168 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr 2025-10-13 20:41:20.235176 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235183 | controller | drop database if exists manila;" || true 2025-10-13 20:41:20.235188 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235194 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr 2025-10-13 20:41:20.235200 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235206 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr'' 2025-10-13 20:41:20.235212 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat: 2025-10-13 20:41:20.235217 | controller | no such file or directory' 2025-10-13 20:41:20.235223 | controller | - No resources found 2025-10-13 20:41:20.235229 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr 2025-10-13 20:41:20.235235 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr 2025-10-13 20:41:20.235241 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235247 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr'' 2025-10-13 20:41:20.235252 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon: 2025-10-13 20:41:20.235258 | controller | no such file or directory' 2025-10-13 20:41:20.235264 | controller | - No resources found 2025-10-13 20:41:20.235269 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator 2025-10-13 20:41:20.235275 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr 2025-10-13 20:41:20.235281 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr 2025-10-13 20:41:20.235286 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235292 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr'' 2025-10-13 20:41:20.235298 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova: 2025-10-13 20:41:20.235304 | controller | no such file or directory' 2025-10-13 20:41:20.235309 | controller | - No resources found 2025-10-13 20:41:20.235315 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/nova-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr 2025-10-13 20:41:20.235321 | controller | - oc rsh openstack-galera-0 mysql -u root --password=12345678 -ss -e "show databases 2025-10-13 20:41:20.235327 | controller | like 'nova_%';" | xargs -I '{}' oc rsh openstack-galera-0 mysql -u root --password=12345678 2025-10-13 20:41:20.235332 | controller | -ss -e "flush tables; drop database if exists {};" 2025-10-13 20:41:20.235338 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235344 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr 2025-10-13 20:41:20.235349 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235355 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr'' 2025-10-13 20:41:20.235361 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis: 2025-10-13 20:41:20.235367 | controller | no such file or directory' 2025-10-13 20:41:20.235373 | controller | - No resources found 2025-10-13 20:41:20.235381 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator-redis 2025-10-13 20:41:20.235387 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr 2025-10-13 20:41:20.235396 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr 2025-10-13 20:41:20.235418 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235430 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr'' 2025-10-13 20:41:20.235437 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia: 2025-10-13 20:41:20.235443 | controller | no such file or directory' 2025-10-13 20:41:20.235448 | controller | - No resources found 2025-10-13 20:41:20.235454 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator 2025-10-13 20:41:20.235460 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr 2025-10-13 20:41:20.235466 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235471 | controller | drop database if exists octavia;" || true 2025-10-13 20:41:20.235484 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235497 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr 2025-10-13 20:41:20.235505 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235513 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr'' 2025-10-13 20:41:20.235520 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate: 2025-10-13 20:41:20.235527 | controller | no such file or directory' 2025-10-13 20:41:20.235533 | controller | - No resources found 2025-10-13 20:41:20.235539 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator 2025-10-13 20:41:20.235545 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr 2025-10-13 20:41:20.235550 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235559 | controller | drop database if exists designate;" || true 2025-10-13 20:41:20.235565 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235571 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr 2025-10-13 20:41:20.235576 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235583 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr'' 2025-10-13 20:41:20.235588 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron: 2025-10-13 20:41:20.235594 | controller | no such file or directory' 2025-10-13 20:41:20.235600 | controller | - No resources found 2025-10-13 20:41:20.235605 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator 2025-10-13 20:41:20.235611 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr 2025-10-13 20:41:20.235617 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235622 | controller | drop database if exists neutron;" || true 2025-10-13 20:41:20.235628 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235634 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr 2025-10-13 20:41:20.235639 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235645 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr'' 2025-10-13 20:41:20.235655 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn: 2025-10-13 20:41:20.235661 | controller | no such file or directory' 2025-10-13 20:41:20.235667 | controller | - No resources found 2025-10-13 20:41:20.235672 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr 2025-10-13 20:41:20.235679 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr 2025-10-13 20:41:20.235684 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235690 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr'' 2025-10-13 20:41:20.235696 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic: 2025-10-13 20:41:20.235701 | controller | no such file or directory' 2025-10-13 20:41:20.235707 | controller | - No resources found 2025-10-13 20:41:20.235713 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator 2025-10-13 20:41:20.235718 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr 2025-10-13 20:41:20.235724 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235730 | controller | drop database if exists ironic;" || true 2025-10-13 20:41:20.235735 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235741 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235747 | controller | drop database if exists ironic_inspector;" || true 2025-10-13 20:41:20.235753 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235758 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr 2025-10-13 20:41:20.235769 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235775 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr'' 2025-10-13 20:41:20.235783 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder: 2025-10-13 20:41:20.235789 | controller | no such file or directory' 2025-10-13 20:41:20.235794 | controller | - No resources found 2025-10-13 20:41:20.235800 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator 2025-10-13 20:41:20.235806 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr 2025-10-13 20:41:20.235819 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235827 | controller | drop database if exists cinder;" || true 2025-10-13 20:41:20.235835 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235843 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr 2025-10-13 20:41:20.235850 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235856 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr'' 2025-10-13 20:41:20.235862 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance: 2025-10-13 20:41:20.235868 | controller | no such file or directory' 2025-10-13 20:41:20.235873 | controller | - No resources found 2025-10-13 20:41:20.235879 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator 2025-10-13 20:41:20.235885 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr 2025-10-13 20:41:20.235890 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235899 | controller | drop database if exists glance;" || true 2025-10-13 20:41:20.235905 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235911 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr 2025-10-13 20:41:20.235916 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235922 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr'' 2025-10-13 20:41:20.235928 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement: 2025-10-13 20:41:20.235934 | controller | no such file or directory' 2025-10-13 20:41:20.235939 | controller | - No resources found 2025-10-13 20:41:20.235945 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator 2025-10-13 20:41:20.235951 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr 2025-10-13 20:41:20.235957 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.235962 | controller | drop database if exists placement;" || true 2025-10-13 20:41:20.235968 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.235974 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr 2025-10-13 20:41:20.235980 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.235988 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr'' 2025-10-13 20:41:20.235994 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift: 2025-10-13 20:41:20.236000 | controller | no such file or directory' 2025-10-13 20:41:20.236006 | controller | - No resources found 2025-10-13 20:41:20.236012 | controller | - rm -Rf -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator 2025-10-13 20:41:20.236018 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr 2025-10-13 20:41:20.236023 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr 2025-10-13 20:41:20.236029 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.236035 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr'' 2025-10-13 20:41:20.236041 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican: 2025-10-13 20:41:20.236047 | controller | no such file or directory' 2025-10-13 20:41:20.236052 | controller | - No resources found 2025-10-13 20:41:20.236058 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator 2025-10-13 20:41:20.236064 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr 2025-10-13 20:41:20.236069 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.236075 | controller | drop database if exists barbican;" || true 2025-10-13 20:41:20.236081 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.236086 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr 2025-10-13 20:41:20.236092 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.236098 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr'' 2025-10-13 20:41:20.236104 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone: 2025-10-13 20:41:20.236109 | controller | no such file or directory' 2025-10-13 20:41:20.236115 | controller | - No resources found 2025-10-13 20:41:20.236123 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator 2025-10-13 20:41:20.236129 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr 2025-10-13 20:41:20.236144 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.236152 | controller | drop database if exists keystone;" || true 2025-10-13 20:41:20.236160 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.236168 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr 2025-10-13 20:41:20.236176 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.236182 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr'' 2025-10-13 20:41:20.236187 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb: 2025-10-13 20:41:20.236193 | controller | no such file or directory' 2025-10-13 20:41:20.236199 | controller | - No resources found 2025-10-13 20:41:20.236204 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator 2025-10-13 20:41:20.236210 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr 2025-10-13 20:41:20.236216 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr 2025-10-13 20:41:20.236222 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.236227 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr'' 2025-10-13 20:41:20.236233 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry: 2025-10-13 20:41:20.236239 | controller | no such file or directory' 2025-10-13 20:41:20.236244 | controller | - No resources found 2025-10-13 20:41:20.236250 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator 2025-10-13 20:41:20.236256 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr 2025-10-13 20:41:20.236262 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ceilometer-operator 2025-10-13 20:41:20.236267 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr 2025-10-13 20:41:20.236273 | controller | - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; 2025-10-13 20:41:20.236279 | controller | drop database if exists aodh;" || true 2025-10-13 20:41:20.236284 | controller | - 'Error from server (NotFound): pods "openstack-galera-0" not found' 2025-10-13 20:41:20.236290 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr 2025-10-13 20:41:20.236296 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.236302 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr'' 2025-10-13 20:41:20.236307 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: 2025-10-13 20:41:20.236313 | controller | no such file or directory' 2025-10-13 20:41:20.236319 | controller | - No resources found 2025-10-13 20:41:20.236325 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator 2025-10-13 20:41:20.236330 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr 2025-10-13 20:41:20.236336 | controller | - if oc get RabbitmqCluster; then oc delete --ignore-not-found=true RabbitmqCluster 2025-10-13 20:41:20.236342 | controller | --all; fi 2025-10-13 20:41:20.236347 | controller | - 'error: the server doesn''t have a resource type "RabbitmqCluster"' 2025-10-13 20:41:20.236353 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/rabbitmq-operator 2025-10-13 20:41:20.236362 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/rabbitmq/cr 2025-10-13 20:41:20.236368 | controller | - bash scripts/validate-marketplace.sh 2025-10-13 20:41:20.236374 | controller | - + '[' -z 500s ']' 2025-10-13 20:41:20.236379 | controller | - + OPERATOR_NAMESPACE=openshift-marketplace 2025-10-13 20:41:20.236385 | controller | - ++ oc get pods --no-headers -n openshift-marketplace 2025-10-13 20:41:20.236391 | controller | - ++ grep -viE 'running|completed' 2025-10-13 20:41:20.236411 | controller | - + not_running_pods= 2025-10-13 20:41:20.236421 | controller | - + '[' -z '' ']' 2025-10-13 20:41:20.236427 | controller | - + echo 'All openshift-marketplace pods seems to me fine' 2025-10-13 20:41:20.236433 | controller | - All openshift-marketplace pods seems to me fine 2025-10-13 20:41:20.236438 | controller | - + OPERATORS='openshift-cert-manager-operator kubernetes-nmstate-operator metallb-operator' 2025-10-13 20:41:20.236444 | controller | - + for operator in $OPERATORS 2025-10-13 20:41:20.236450 | controller | - + n=0 2025-10-13 20:41:20.236456 | controller | - + retries=20 2025-10-13 20:41:20.236461 | controller | - + true 2025-10-13 20:41:20.236467 | controller | - + grep openshift-cert-manager-operator 2025-10-13 20:41:20.236473 | controller | - + oc get packagemanifests -n openshift-marketplace 2025-10-13 20:41:20.236478 | controller | - openshift-cert-manager-operator Red Hat Operators 232d 2025-10-13 20:41:20.236484 | controller | - + '[' 0 -eq 0 ']' 2025-10-13 20:41:20.236490 | controller | - + break 2025-10-13 20:41:20.236496 | controller | - + for operator in $OPERATORS 2025-10-13 20:41:20.236501 | controller | - + n=0 2025-10-13 20:41:20.236507 | controller | - + retries=20 2025-10-13 20:41:20.236513 | controller | - + true 2025-10-13 20:41:20.236518 | controller | - + oc get packagemanifests -n openshift-marketplace 2025-10-13 20:41:20.236524 | controller | - + grep kubernetes-nmstate-operator 2025-10-13 20:41:20.236530 | controller | - kubernetes-nmstate-operator Red Hat Operators 232d 2025-10-13 20:41:20.236536 | controller | - + '[' 0 -eq 0 ']' 2025-10-13 20:41:20.236541 | controller | - + break 2025-10-13 20:41:20.236547 | controller | - + for operator in $OPERATORS 2025-10-13 20:41:20.236553 | controller | - + n=0 2025-10-13 20:41:20.236558 | controller | - + retries=20 2025-10-13 20:41:20.236564 | controller | - + true 2025-10-13 20:41:20.236570 | controller | - + grep metallb-operator 2025-10-13 20:41:20.236583 | controller | - + oc get packagemanifests -n openshift-marketplace 2025-10-13 20:41:20.236591 | controller | - metallb-operator Red Hat Operators 232d 2025-10-13 20:41:20.236599 | controller | - + '[' 0 -eq 0 ']' 2025-10-13 20:41:20.236607 | controller | - + break 2025-10-13 20:41:20.236614 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.236620 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.236626 | controller | - + '[' -z openshift-nmstate ']' 2025-10-13 20:41:20.236632 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate 2025-10-13 20:41:20.236638 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate 2025-10-13 20:41:20.236644 | controller | ']' 2025-10-13 20:41:20.236649 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate 2025-10-13 20:41:20.236655 | controller | - + cat 2025-10-13 20:41:20.236661 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/namespace.yaml 2025-10-13 20:41:20.236666 | controller | - namespace/openshift-nmstate created 2025-10-13 20:41:20.236672 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io openshift-nmstate); 2025-10-13 20:41:20.236678 | controller | do sleep 1; done" 2025-10-13 20:41:20.236683 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.236689 | controller | - openshift-nmstate Active 2025-10-13 20:41:20.236695 | controller | - bash scripts/gen-olm-nmstate.sh 2025-10-13 20:41:20.236700 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.236706 | controller | ']' 2025-10-13 20:41:20.236712 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.236721 | controller | ']' 2025-10-13 20:41:20.236727 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.236732 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.236738 | controller | ']' 2025-10-13 20:41:20.236744 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.236749 | controller | ']' 2025-10-13 20:41:20.236755 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.236761 | controller | - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.236766 | controller | - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.236772 | controller | - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.236778 | controller | - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.236783 | controller | - + cat 2025-10-13 20:41:20.236789 | controller | - + cat 2025-10-13 20:41:20.236795 | controller | - + cat 2025-10-13 20:41:20.236801 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op 2025-10-13 20:41:20.236806 | controller | - operatorgroup.operators.coreos.com/openshift-nmstate-tn6k8 created 2025-10-13 20:41:20.236812 | controller | - subscription.operators.coreos.com/kubernetes-nmstate-operator created 2025-10-13 20:41:20.236818 | controller | - timeout 500s bash -c "while ! (oc get deployments/nmstate-operator -n openshift-nmstate); 2025-10-13 20:41:20.236823 | controller | do sleep 10; done" 2025-10-13 20:41:20.236829 | controller | - 'Error from server (NotFound): deployments.apps "nmstate-operator" not found' 2025-10-13 20:41:20.236835 | controller | - 'Error from server (NotFound): deployments.apps "nmstate-operator" not found' 2025-10-13 20:41:20.236840 | controller | - NAME READY UP-TO-DATE AVAILABLE AGE 2025-10-13 20:41:20.236846 | controller | - nmstate-operator 1/1 1 1 7s 2025-10-13 20:41:20.236852 | controller | - oc wait deployments/nmstate-operator -n openshift-nmstate --for condition=Available 2025-10-13 20:41:20.236858 | controller | --timeout=500s 2025-10-13 20:41:20.236863 | controller | - deployment.apps/nmstate-operator condition met 2025-10-13 20:41:20.236869 | controller | - timeout 500s bash -c "while ! (oc wait pod -n openshift-apiserver -l apiserver=true 2025-10-13 20:41:20.236875 | controller | --for condition=Ready); do sleep 10; done" 2025-10-13 20:41:20.236881 | controller | - pod/apiserver-76f77b778f-h75w4 condition met 2025-10-13 20:41:20.236886 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr 2025-10-13 20:41:20.236892 | controller | - nmstate.nmstate.io/nmstate created 2025-10-13 20:41:20.236898 | controller | - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l component=kubernetes-nmstate-handler 2025-10-13 20:41:20.236903 | controller | -n openshift-nmstate| grep nmstate-handler); do sleep 10; done" 2025-10-13 20:41:20.236909 | controller | - No resources found in openshift-nmstate namespace. 2025-10-13 20:41:20.236915 | controller | - nmstate-handler-bdw24 0/1 Running 0 10s 2025-10-13 20:41:20.236921 | controller | - oc wait pod -n openshift-nmstate -l component=kubernetes-nmstate-handler --for condition=Ready 2025-10-13 20:41:20.236926 | controller | --timeout=500s 2025-10-13 20:41:20.236932 | controller | - pod/nmstate-handler-bdw24 condition met 2025-10-13 20:41:20.236938 | controller | - timeout 500s bash -c "while ! (oc get deployments/nmstate-webhook -n openshift-nmstate); 2025-10-13 20:41:20.236944 | controller | do sleep 10; done" 2025-10-13 20:41:20.236950 | controller | - NAME READY UP-TO-DATE AVAILABLE AGE 2025-10-13 20:41:20.236955 | controller | - nmstate-webhook 0/1 1 0 11s 2025-10-13 20:41:20.236965 | controller | - oc wait deployments/nmstate-webhook -n openshift-nmstate --for condition=Available 2025-10-13 20:41:20.236984 | controller | --timeout=500s 2025-10-13 20:41:20.236993 | controller | - deployment.apps/nmstate-webhook condition met 2025-10-13 20:41:20.236999 | controller | - WORKERS='crc' \ 2025-10-13 20:41:20.237005 | controller | - bash scripts/gen-nncp.sh 2025-10-13 20:41:20.237018 | controller | - + check_var_set DEPLOY_DIR 2025-10-13 20:41:20.237026 | controller | - + [[ ! -v DEPLOY_DIR ]] 2025-10-13 20:41:20.237034 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr 2025-10-13 20:41:20.237042 | controller | ']' 2025-10-13 20:41:20.237050 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr 2025-10-13 20:41:20.237055 | controller | - + check_var_set WORKERS 2025-10-13 20:41:20.237061 | controller | - + [[ ! -v WORKERS ]] 2025-10-13 20:41:20.237067 | controller | - + check_var_set INTERFACE 2025-10-13 20:41:20.237073 | controller | - + [[ ! -v INTERFACE ]] 2025-10-13 20:41:20.237078 | controller | - + check_var_set BRIDGE_NAME 2025-10-13 20:41:20.237084 | controller | - + [[ ! -v BRIDGE_NAME ]] 2025-10-13 20:41:20.237090 | controller | - + check_var_set INTERFACE_MTU 2025-10-13 20:41:20.237096 | controller | - + [[ ! -v INTERFACE_MTU ]] 2025-10-13 20:41:20.237101 | controller | - + check_var_set VLAN_START 2025-10-13 20:41:20.237107 | controller | - + [[ ! -v VLAN_START ]] 2025-10-13 20:41:20.237113 | controller | - + check_var_set VLAN_STEP 2025-10-13 20:41:20.237118 | controller | - + [[ ! -v VLAN_STEP ]] 2025-10-13 20:41:20.237124 | controller | - + check_var_set VLAN_STEP 2025-10-13 20:41:20.237130 | controller | - + [[ ! -v VLAN_STEP ]] 2025-10-13 20:41:20.237135 | controller | - + check_var_set INTERNALAPI_PREFIX 2025-10-13 20:41:20.237141 | controller | - + [[ ! -v INTERNALAPI_PREFIX ]] 2025-10-13 20:41:20.237147 | controller | - + check_var_set STORAGE_PREFIX 2025-10-13 20:41:20.237153 | controller | - + [[ ! -v STORAGE_PREFIX ]] 2025-10-13 20:41:20.237158 | controller | - + check_var_set STORAGEMGMT_PREFIX 2025-10-13 20:41:20.237164 | controller | - + [[ ! -v STORAGEMGMT_PREFIX ]] 2025-10-13 20:41:20.237170 | controller | - + check_var_set TENANT_PREFIX 2025-10-13 20:41:20.237175 | controller | - + [[ ! -v TENANT_PREFIX ]] 2025-10-13 20:41:20.237181 | controller | - + check_var_set DESIGNATE_PREFIX 2025-10-13 20:41:20.237187 | controller | - + [[ ! -v DESIGNATE_PREFIX ]] 2025-10-13 20:41:20.237192 | controller | - + check_var_set DESIGNATE_EXT_PREFIX 2025-10-13 20:41:20.237198 | controller | - + [[ ! -v DESIGNATE_EXT_PREFIX ]] 2025-10-13 20:41:20.237204 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237209 | controller | - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr 2025-10-13 20:41:20.237215 | controller | - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr 2025-10-13 20:41:20.237224 | controller | - + echo WORKERS crc 2025-10-13 20:41:20.237230 | controller | - WORKERS crc 2025-10-13 20:41:20.237236 | controller | - + echo INTERFACE ens7 2025-10-13 20:41:20.237241 | controller | - INTERFACE ens7 2025-10-13 20:41:20.237247 | controller | - + echo BRIDGE_NAME ospbr 2025-10-13 20:41:20.237253 | controller | - BRIDGE_NAME ospbr 2025-10-13 20:41:20.237259 | controller | - + echo INTERFACE_BGP_1 2025-10-13 20:41:20.237264 | controller | - INTERFACE_BGP_1 2025-10-13 20:41:20.237270 | controller | - + echo INTERFACE_BGP_2 2025-10-13 20:41:20.237276 | controller | - INTERFACE_BGP_2 2025-10-13 20:41:20.237281 | controller | - + echo INTERFACE_MTU 1500 2025-10-13 20:41:20.237287 | controller | - INTERFACE_MTU 1500 2025-10-13 20:41:20.237293 | controller | - + echo VLAN_START 20 2025-10-13 20:41:20.237298 | controller | - VLAN_START 20 2025-10-13 20:41:20.237304 | controller | - + echo VLAN_STEP 1 2025-10-13 20:41:20.237310 | controller | - VLAN_STEP 1 2025-10-13 20:41:20.237319 | controller | - + echo STORAGE_MACVLAN 2025-10-13 20:41:20.237324 | controller | - STORAGE_MACVLAN 2025-10-13 20:41:20.237330 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237336 | controller | - + echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 2025-10-13 20:41:20.237341 | controller | - CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 2025-10-13 20:41:20.237347 | controller | - + echo CTLPLANE_IP_ADDRESS_SUFFIX 10 2025-10-13 20:41:20.237353 | controller | - CTLPLANE_IP_ADDRESS_SUFFIX 10 2025-10-13 20:41:20.237358 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237364 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237370 | controller | - + IP_ADDRESS_SUFFIX=5 2025-10-13 20:41:20.237376 | controller | - + IPV6_ADDRESS_SUFFIX=5 2025-10-13 20:41:20.237385 | controller | - + rm --force '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/*_nncp.yaml' 2025-10-13 20:41:20.237390 | controller | - + internalapi_vlan_id=20 2025-10-13 20:41:20.237399 | controller | - + storage_vlan_id=21 2025-10-13 20:41:20.237427 | controller | - + tenant_vlan_id=22 2025-10-13 20:41:20.237435 | controller | - + storagemgmt_vlan_id=23 2025-10-13 20:41:20.237443 | controller | - + octavia_vlan_id=24 2025-10-13 20:41:20.237450 | controller | - + designate_vlan_id=25 2025-10-13 20:41:20.237456 | controller | - + designate_ext_vlan_id=26 2025-10-13 20:41:20.237466 | controller | - + for WORKER in ${WORKERS} 2025-10-13 20:41:20.237472 | controller | - + cat 2025-10-13 20:41:20.237478 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237483 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237489 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237495 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237500 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237506 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237512 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237517 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237523 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237529 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237534 | controller | - + cat 2025-10-13 20:41:20.237540 | controller | - + cat 2025-10-13 20:41:20.237546 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237552 | controller | - + cat 2025-10-13 20:41:20.237559 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237565 | controller | - + cat 2025-10-13 20:41:20.237571 | controller | - + cat 2025-10-13 20:41:20.237577 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237582 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237588 | controller | - + cat 2025-10-13 20:41:20.237594 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237599 | controller | - + cat 2025-10-13 20:41:20.237605 | controller | - + cat 2025-10-13 20:41:20.237611 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237617 | controller | - + cat 2025-10-13 20:41:20.237622 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237628 | controller | - + cat 2025-10-13 20:41:20.237634 | controller | - + cat 2025-10-13 20:41:20.237640 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237645 | controller | - + cat 2025-10-13 20:41:20.237651 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237657 | controller | - + cat 2025-10-13 20:41:20.237663 | controller | - + cat 2025-10-13 20:41:20.237668 | controller | - + cat 2025-10-13 20:41:20.237674 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237680 | controller | - + cat 2025-10-13 20:41:20.237685 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237691 | controller | - + cat 2025-10-13 20:41:20.237697 | controller | - + cat 2025-10-13 20:41:20.237703 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237708 | controller | - + cat 2025-10-13 20:41:20.237714 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237720 | controller | - + cat 2025-10-13 20:41:20.237726 | controller | - + cat 2025-10-13 20:41:20.237731 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.237737 | controller | - + cat 2025-10-13 20:41:20.237743 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237749 | controller | - + cat 2025-10-13 20:41:20.237754 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.237760 | controller | - + cat 2025-10-13 20:41:20.237766 | controller | - + IP_ADDRESS_SUFFIX=6 2025-10-13 20:41:20.237772 | controller | - + IPV6_ADDRESS_SUFFIX=6 2025-10-13 20:41:20.237777 | controller | - + CTLPLANE_IP_ADDRESS_SUFFIX=11 2025-10-13 20:41:20.237783 | controller | - + CTLPLANE_IPV6_ADDRESS_SUFFIX=1 2025-10-13 20:41:20.237789 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/ 2025-10-13 20:41:20.237795 | controller | - nodenetworkconfigurationpolicy.nmstate.io/ens7-crc created 2025-10-13 20:41:20.237801 | controller | - timeout 240s bash -c "while ! (oc wait nncp -l osp/interface=ens7 --for jsonpath='{.status.conditions[0].reason}'=SuccessfullyConfigured); 2025-10-13 20:41:20.237807 | controller | do sleep 10; done" 2025-10-13 20:41:20.237813 | controller | - nodenetworkconfigurationpolicy.nmstate.io/ens7-crc condition met 2025-10-13 20:41:20.237818 | controller | - if test -n "192.168.122.10"; then oc patch dns.operator/default --type merge -p 2025-10-13 20:41:20.237832 | controller | '{"spec":{"upstreamResolvers":{"policy":"Sequential","upstreams":[{"type":"Network","address":"'192.168.122.10'","port":53},{"type":"SystemResolvConf"}]}}}'; 2025-10-13 20:41:20.237840 | controller | fi 2025-10-13 20:41:20.237856 | controller | - dns.operator.openshift.io/default patched 2025-10-13 20:41:20.237863 | controller | - timeout 240s bash -c "while ! (oc wait dns.operator/default --for condition=available); 2025-10-13 20:41:20.237869 | controller | do sleep 10; done" 2025-10-13 20:41:20.237875 | controller | - dns.operator.openshift.io/default condition met 2025-10-13 20:41:20.237881 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.237887 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.237892 | controller | - + '[' -z metallb-system ']' 2025-10-13 20:41:20.237898 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/metallb-system 2025-10-13 20:41:20.237904 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system ']' 2025-10-13 20:41:20.237910 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system 2025-10-13 20:41:20.237915 | controller | - + cat 2025-10-13 20:41:20.237921 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/namespace.yaml 2025-10-13 20:41:20.237927 | controller | - namespace/metallb-system created 2025-10-13 20:41:20.237932 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io metallb-system); 2025-10-13 20:41:20.237938 | controller | do sleep 1; done" 2025-10-13 20:41:20.237944 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.237950 | controller | - metallb-system Active 2025-10-13 20:41:20.237955 | controller | - bash scripts/gen-olm-metallb.sh 2025-10-13 20:41:20.237961 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.237967 | controller | ']' 2025-10-13 20:41:20.237972 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.237978 | controller | ']' 2025-10-13 20:41:20.237984 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.237990 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.237995 | controller | ']' 2025-10-13 20:41:20.238001 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.238007 | controller | ']' 2025-10-13 20:41:20.238013 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.238018 | controller | - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.238024 | controller | - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.238030 | controller | - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.238035 | controller | - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.238041 | controller | - + echo INTERFACE 2025-10-13 20:41:20.238047 | controller | - INTERFACE 2025-10-13 20:41:20.238053 | controller | - + cat 2025-10-13 20:41:20.238058 | controller | - + cat 2025-10-13 20:41:20.238064 | controller | - + cat 2025-10-13 20:41:20.238070 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op 2025-10-13 20:41:20.238076 | controller | - operatorgroup.operators.coreos.com/metallb-operator created 2025-10-13 20:41:20.238081 | controller | - subscription.operators.coreos.com/metallb-operator-sub created 2025-10-13 20:41:20.238087 | controller | - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l control-plane=controller-manager 2025-10-13 20:41:20.238093 | controller | -n metallb-system| grep metallb-operator-controller); do sleep 10; done" 2025-10-13 20:41:20.238098 | controller | - No resources found in metallb-system namespace. 2025-10-13 20:41:20.238104 | controller | - No resources found in metallb-system namespace. 2025-10-13 20:41:20.238110 | controller | - metallb-operator-controller-manager-b7789ff7f-4dz47 0/1 ContainerCreating 0 3s 2025-10-13 20:41:20.238116 | controller | - oc wait pod -n metallb-system --for condition=Ready -l control-plane=controller-manager 2025-10-13 20:41:20.238124 | controller | --timeout=500s 2025-10-13 20:41:20.238130 | controller | - pod/metallb-operator-controller-manager-b7789ff7f-4dz47 condition met 2025-10-13 20:41:20.238136 | controller | - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l component=webhook-server 2025-10-13 20:41:20.238145 | controller | -n metallb-system| grep metallb-operator-webhook); do sleep 10; done" 2025-10-13 20:41:20.238163 | controller | - metallb-operator-webhook-server-86869d57c5-28vf7 1/1 Running 0 41s 2025-10-13 20:41:20.238169 | controller | - oc wait pod -n metallb-system --for condition=Ready -l component=webhook-server 2025-10-13 20:41:20.238175 | controller | --timeout=500s 2025-10-13 20:41:20.238181 | controller | - pod/metallb-operator-webhook-server-86869d57c5-28vf7 condition met 2025-10-13 20:41:20.238186 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/deploy_operator.yaml 2025-10-13 20:41:20.238192 | controller | - metallb.metallb.io/metallb created 2025-10-13 20:41:20.238198 | controller | - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l component=speaker 2025-10-13 20:41:20.238204 | controller | -n metallb-system | grep speaker); do sleep 10; done" 2025-10-13 20:41:20.238209 | controller | - No resources found in metallb-system namespace. 2025-10-13 20:41:20.238215 | controller | - speaker-lqgwl 1/2 Running 0 10s 2025-10-13 20:41:20.238221 | controller | - oc wait pod -n metallb-system -l component=speaker --for condition=Ready --timeout=500s 2025-10-13 20:41:20.238226 | controller | - pod/speaker-lqgwl condition met 2025-10-13 20:41:20.238232 | controller | - make operator_namespace 2025-10-13 20:41:20.238238 | controller | - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.238251 | controller | - 'error: the server doesn''t have a resource type "openstackversion"' 2025-10-13 20:41:20.238259 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.238267 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.238275 | controller | - + '[' -z cert-manager-operator ']' 2025-10-13 20:41:20.238282 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator 2025-10-13 20:41:20.238289 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator 2025-10-13 20:41:20.238295 | controller | ']' 2025-10-13 20:41:20.238301 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator 2025-10-13 20:41:20.238307 | controller | - + cat 2025-10-13 20:41:20.238312 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/namespace.yaml 2025-10-13 20:41:20.238318 | controller | - namespace/cert-manager-operator created 2025-10-13 20:41:20.238324 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io cert-manager-operator); 2025-10-13 20:41:20.238329 | controller | do sleep 1; done" 2025-10-13 20:41:20.238335 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.238341 | controller | - cert-manager-operator Active 2025-10-13 20:41:20.238347 | controller | - oc project cert-manager-operator 2025-10-13 20:41:20.238352 | controller | - Now using project "cert-manager-operator" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.238358 | controller | - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.238364 | controller | - bash scripts/gen-olm-cert-manager.sh 2025-10-13 20:41:20.238370 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.238375 | controller | ']' 2025-10-13 20:41:20.238381 | controller | - + '[' -z cert-manager-operator ']' 2025-10-13 20:41:20.238387 | controller | - + '[' -z stable-v1 ']' 2025-10-13 20:41:20.238393 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.238401 | controller | ']' 2025-10-13 20:41:20.238422 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.238428 | controller | - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.238438 | controller | - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.238443 | controller | - + echo OPERATOR_NAMESPACE cert-manager-operator 2025-10-13 20:41:20.238449 | controller | - OPERATOR_NAMESPACE cert-manager-operator 2025-10-13 20:41:20.238455 | controller | - + echo CHANNEL stable-v1 2025-10-13 20:41:20.238461 | controller | - CHANNEL stable-v1 2025-10-13 20:41:20.238466 | controller | - + cat 2025-10-13 20:41:20.238472 | controller | - + cat 2025-10-13 20:41:20.238478 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op 2025-10-13 20:41:20.238484 | controller | - operatorgroup.operators.coreos.com/cert-manager-operator-bccwx created 2025-10-13 20:41:20.238489 | controller | - subscription.operators.coreos.com/openshift-cert-manager-operator created 2025-10-13 20:41:20.238495 | controller | - while ! (oc get pod --no-headers=true -l name=cert-manager-operator -n cert-manager-operator| 2025-10-13 20:41:20.238501 | controller | grep "cert-manager-operator"); do sleep 10; done 2025-10-13 20:41:20.238506 | controller | - No resources found in cert-manager-operator namespace. 2025-10-13 20:41:20.238512 | controller | - No resources found in cert-manager-operator namespace. 2025-10-13 20:41:20.238518 | controller | - cert-manager-operator-controller-manager-57cd46d6d-t9wrm 0/1 ContainerCreating 0 6s 2025-10-13 20:41:20.238524 | controller | - oc wait pod -n cert-manager-operator --for condition=Ready -l name=cert-manager-operator 2025-10-13 20:41:20.238529 | controller | --timeout=300s 2025-10-13 20:41:20.238535 | controller | - pod/cert-manager-operator-controller-manager-57cd46d6d-t9wrm condition met 2025-10-13 20:41:20.238541 | controller | - while ! (oc get pod --no-headers=true -l app=cainjector -n cert-manager | grep "cert-manager-cainjector"); 2025-10-13 20:41:20.238546 | controller | do sleep 10; done 2025-10-13 20:41:20.238552 | controller | - No resources found in cert-manager namespace. 2025-10-13 20:41:20.238558 | controller | - cert-manager-cainjector-7d9f95dbf-866gz 1/1 Running 0 4s 2025-10-13 20:41:20.238564 | controller | - oc wait pod -n cert-manager -l app=cainjector --for condition=Ready --timeout=300s 2025-10-13 20:41:20.238569 | controller | - pod/cert-manager-cainjector-7d9f95dbf-866gz condition met 2025-10-13 20:41:20.238575 | controller | - while ! (oc get pod --no-headers=true -l app=webhook -n cert-manager | grep "cert-manager-webhook"); 2025-10-13 20:41:20.238581 | controller | do sleep 10; done 2025-10-13 20:41:20.238586 | controller | - cert-manager-webhook-d969966f-qjpx9 0/1 Running 0 8s 2025-10-13 20:41:20.238592 | controller | - oc wait pod -n cert-manager -l app=webhook --for condition=Ready --timeout=300s 2025-10-13 20:41:20.238598 | controller | - pod/cert-manager-webhook-d969966f-qjpx9 condition met 2025-10-13 20:41:20.238604 | controller | - while ! (oc get pod --no-headers=true -l app=cert-manager -n cert-manager | grep 2025-10-13 20:41:20.238609 | controller | "cert-manager"); do sleep 10; done 2025-10-13 20:41:20.238615 | controller | - No resources found in cert-manager namespace. 2025-10-13 20:41:20.238621 | controller | - cert-manager-7d4cc89fcb-452pc 1/1 Running 0 2s 2025-10-13 20:41:20.238626 | controller | - oc wait pod -n cert-manager -l app=cert-manager --for condition=Ready --timeout=300s 2025-10-13 20:41:20.238632 | controller | - pod/cert-manager-7d4cc89fcb-452pc condition met 2025-10-13 20:41:20.238638 | controller | - bash scripts/gen-netatt.sh 2025-10-13 20:41:20.238644 | controller | - + check_var_set DEPLOY_DIR 2025-10-13 20:41:20.238649 | controller | - + [[ ! -v DEPLOY_DIR ]] 2025-10-13 20:41:20.238655 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr 2025-10-13 20:41:20.238668 | controller | ']' 2025-10-13 20:41:20.238676 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr 2025-10-13 20:41:20.238684 | controller | - + check_var_set INTERFACE 2025-10-13 20:41:20.238692 | controller | - + [[ ! -v INTERFACE ]] 2025-10-13 20:41:20.238700 | controller | - + check_var_set BRIDGE_NAME 2025-10-13 20:41:20.238706 | controller | - + [[ ! -v BRIDGE_NAME ]] 2025-10-13 20:41:20.238716 | controller | - + check_var_set VLAN_START 2025-10-13 20:41:20.238724 | controller | - + [[ ! -v VLAN_START ]] 2025-10-13 20:41:20.238730 | controller | - + check_var_set VLAN_STEP 2025-10-13 20:41:20.238736 | controller | - + [[ ! -v VLAN_STEP ]] 2025-10-13 20:41:20.238742 | controller | - + '[' -z true ']' 2025-10-13 20:41:20.238750 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.238756 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.238762 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.238768 | controller | - + check_var_set INTERNALAPI_PREFIX 2025-10-13 20:41:20.238773 | controller | - + [[ ! -v INTERNALAPI_PREFIX ]] 2025-10-13 20:41:20.238779 | controller | - + check_var_set STORAGE_PREFIX 2025-10-13 20:41:20.238785 | controller | - + [[ ! -v STORAGE_PREFIX ]] 2025-10-13 20:41:20.238790 | controller | - + check_var_set STORAGEMGMT_PREFIX 2025-10-13 20:41:20.238796 | controller | - + [[ ! -v STORAGEMGMT_PREFIX ]] 2025-10-13 20:41:20.238802 | controller | - + check_var_set TENANT_PREFIX 2025-10-13 20:41:20.238807 | controller | - + [[ ! -v TENANT_PREFIX ]] 2025-10-13 20:41:20.238813 | controller | - + check_var_set DESIGNATE_PREFIX 2025-10-13 20:41:20.238819 | controller | - + [[ ! -v DESIGNATE_PREFIX ]] 2025-10-13 20:41:20.238824 | controller | - + check_var_set DESIGNATE_EXT_PREFIX 2025-10-13 20:41:20.238830 | controller | - + [[ ! -v DESIGNATE_EXT_PREFIX ]] 2025-10-13 20:41:20.238836 | controller | - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr 2025-10-13 20:41:20.238841 | controller | - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr 2025-10-13 20:41:20.238847 | controller | - + echo INTERFACE ens7 2025-10-13 20:41:20.238853 | controller | - INTERFACE ens7 2025-10-13 20:41:20.238859 | controller | - + echo VLAN_START 20 2025-10-13 20:41:20.238864 | controller | - VLAN_START 20 2025-10-13 20:41:20.238870 | controller | - + echo VLAN_STEP 1 2025-10-13 20:41:20.238876 | controller | - VLAN_STEP 1 2025-10-13 20:41:20.238881 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.238887 | controller | - + echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 2025-10-13 20:41:20.238893 | controller | - CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 2025-10-13 20:41:20.238898 | controller | - + echo CTLPLANE_IP_ADDRESS_SUFFIX 10 2025-10-13 20:41:20.238904 | controller | - CTLPLANE_IP_ADDRESS_SUFFIX 10 2025-10-13 20:41:20.238910 | controller | - + echo 'INTERNALAPI_PREFIX 172.17.0' 2025-10-13 20:41:20.238915 | controller | - INTERNALAPI_PREFIX 172.17.0 2025-10-13 20:41:20.238921 | controller | - + echo 'STORAGE_PREFIX 172.18.0' 2025-10-13 20:41:20.238927 | controller | - STORAGE_PREFIX 172.18.0 2025-10-13 20:41:20.238932 | controller | - + echo 'STORAGEMGMT_PREFIX 172.20.0' 2025-10-13 20:41:20.238938 | controller | - STORAGEMGMT_PREFIX 172.20.0 2025-10-13 20:41:20.238944 | controller | - + echo 'TENANT_PREFIX 172.19.0' 2025-10-13 20:41:20.238949 | controller | - TENANT_PREFIX 172.19.0 2025-10-13 20:41:20.238955 | controller | - + echo 'DESIGNATE_PREFIX 172.28.0' 2025-10-13 20:41:20.238961 | controller | - DESIGNATE_PREFIX 172.28.0 2025-10-13 20:41:20.238966 | controller | - + echo 'DESIGNATE_PREFIX 172.50.0' 2025-10-13 20:41:20.238972 | controller | - DESIGNATE_PREFIX 172.50.0 2025-10-13 20:41:20.238981 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.238986 | controller | - + cat 2025-10-13 20:41:20.238992 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.238998 | controller | - + cat 2025-10-13 20:41:20.239004 | controller | - + cat 2025-10-13 20:41:20.239010 | controller | - + cat 2025-10-13 20:41:20.239015 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239021 | controller | - + cat 2025-10-13 20:41:20.239027 | controller | - + cat 2025-10-13 20:41:20.239033 | controller | - + cat 2025-10-13 20:41:20.239038 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239044 | controller | - + cat 2025-10-13 20:41:20.239050 | controller | - + cat 2025-10-13 20:41:20.239056 | controller | - + cat 2025-10-13 20:41:20.239061 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239067 | controller | - + cat 2025-10-13 20:41:20.239073 | controller | - + cat 2025-10-13 20:41:20.239079 | controller | - + cat 2025-10-13 20:41:20.239084 | controller | - + cat 2025-10-13 20:41:20.239090 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239096 | controller | - + cat 2025-10-13 20:41:20.239102 | controller | - + cat 2025-10-13 20:41:20.239107 | controller | - + cat 2025-10-13 20:41:20.239113 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239119 | controller | - + cat 2025-10-13 20:41:20.239127 | controller | - + cat 2025-10-13 20:41:20.239133 | controller | - + cat 2025-10-13 20:41:20.239139 | controller | - + cat 2025-10-13 20:41:20.239144 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.239150 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.239156 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/ 2025-10-13 20:41:20.239162 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/ctlplane created 2025-10-13 20:41:20.239168 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/datacentre created 2025-10-13 20:41:20.239173 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/designate created 2025-10-13 20:41:20.239181 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/designateext created 2025-10-13 20:41:20.239187 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/internalapi created 2025-10-13 20:41:20.239193 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/octavia created 2025-10-13 20:41:20.239199 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/storage created 2025-10-13 20:41:20.239204 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/storagemgmt created 2025-10-13 20:41:20.239210 | controller | - networkattachmentdefinition.k8s.cni.cncf.io/tenant created 2025-10-13 20:41:20.239216 | controller | - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml 2025-10-13 20:41:20.239222 | controller | - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml" 2025-10-13 20:41:20.239227 | controller | does not exist' 2025-10-13 20:41:20.239233 | controller | - 'make: [Makefile:2546: metallb_config_cleanup] Error 1 (ignored)' 2025-10-13 20:41:20.239239 | controller | - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml 2025-10-13 20:41:20.239245 | controller | - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml" 2025-10-13 20:41:20.239250 | controller | does not exist' 2025-10-13 20:41:20.239256 | controller | - 'make: [Makefile:2547: metallb_config_cleanup] Error 1 (ignored)' 2025-10-13 20:41:20.239262 | controller | - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml 2025-10-13 20:41:20.239268 | controller | - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml" 2025-10-13 20:41:20.239273 | controller | does not exist' 2025-10-13 20:41:20.239287 | controller | - 'make: [Makefile:2548: metallb_config_cleanup] Error 1 (ignored)' 2025-10-13 20:41:20.239295 | controller | - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml 2025-10-13 20:41:20.239303 | controller | - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml" 2025-10-13 20:41:20.239311 | controller | does not exist' 2025-10-13 20:41:20.239318 | controller | - 'make: [Makefile:2549: metallb_config_cleanup] Error 1 (ignored)' 2025-10-13 20:41:20.239324 | controller | - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml 2025-10-13 20:41:20.239333 | controller | - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml" 2025-10-13 20:41:20.239339 | controller | does not exist' 2025-10-13 20:41:20.239345 | controller | - 'make: [Makefile:2550: metallb_config_cleanup] Error 1 (ignored)' 2025-10-13 20:41:20.239350 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml 2025-10-13 20:41:20.239356 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml 2025-10-13 20:41:20.239364 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml 2025-10-13 20:41:20.239370 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml 2025-10-13 20:41:20.239379 | controller | /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml 2025-10-13 20:41:20.239385 | controller | - bash scripts/gen-metallb-config.sh 2025-10-13 20:41:20.239395 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.239414 | controller | ']' 2025-10-13 20:41:20.239423 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.239429 | controller | ']' 2025-10-13 20:41:20.239435 | controller | - + '[' -z ens7 ']' 2025-10-13 20:41:20.239441 | controller | - + '[' -z ospbr ']' 2025-10-13 20:41:20.239447 | controller | - + '[' -z 64999 ']' 2025-10-13 20:41:20.239452 | controller | - + '[' -z 64999 ']' 2025-10-13 20:41:20.239458 | controller | - + '[' -z 100.65.4.1 ']' 2025-10-13 20:41:20.239464 | controller | - + '[' -z 100.64.4.1 ']' 2025-10-13 20:41:20.239469 | controller | - + '[' -z 172.30.4.2 ']' 2025-10-13 20:41:20.239475 | controller | - + '[' -z true ']' 2025-10-13 20:41:20.239481 | controller | - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.239487 | controller | - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr 2025-10-13 20:41:20.239492 | controller | - + echo INTERFACE ens7 2025-10-13 20:41:20.239498 | controller | - INTERFACE ens7 2025-10-13 20:41:20.239504 | controller | - + echo CTLPLANE_METALLB_POOL 192.168.122.80-192.168.122.90 2025-10-13 20:41:20.239510 | controller | - CTLPLANE_METALLB_POOL 192.168.122.80-192.168.122.90 2025-10-13 20:41:20.239515 | controller | - + echo CTLPLANE_METALLB_IPV6_POOL fd00:aaaa::80-fd00:aaaa::90 2025-10-13 20:41:20.239521 | controller | - CTLPLANE_METALLB_IPV6_POOL fd00:aaaa::80-fd00:aaaa::90 2025-10-13 20:41:20.239527 | controller | - + cat 2025-10-13 20:41:20.239533 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239538 | controller | - + cat 2025-10-13 20:41:20.239544 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.239550 | controller | - + cat 2025-10-13 20:41:20.239556 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239561 | controller | - + cat 2025-10-13 20:41:20.239567 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.239573 | controller | - + cat 2025-10-13 20:41:20.239579 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239584 | controller | - + cat 2025-10-13 20:41:20.239590 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.239596 | controller | - + cat 2025-10-13 20:41:20.239602 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239607 | controller | - + cat 2025-10-13 20:41:20.239613 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.239619 | controller | - + cat 2025-10-13 20:41:20.239625 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.239630 | controller | - + cat 2025-10-13 20:41:20.239636 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.239642 | controller | - + cat 2025-10-13 20:41:20.239647 | controller | - + cat 2025-10-13 20:41:20.239653 | controller | - + cat 2025-10-13 20:41:20.239659 | controller | - + cat 2025-10-13 20:41:20.239665 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml 2025-10-13 20:41:20.239671 | controller | - ipaddresspool.metallb.io/ctlplane created 2025-10-13 20:41:20.239676 | controller | - ipaddresspool.metallb.io/internalapi created 2025-10-13 20:41:20.239682 | controller | - ipaddresspool.metallb.io/storage created 2025-10-13 20:41:20.239688 | controller | - ipaddresspool.metallb.io/tenant created 2025-10-13 20:41:20.239694 | controller | - ipaddresspool.metallb.io/designateext created 2025-10-13 20:41:20.239700 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml 2025-10-13 20:41:20.239705 | controller | - l2advertisement.metallb.io/ctlplane created 2025-10-13 20:41:20.239711 | controller | - l2advertisement.metallb.io/internalapi created 2025-10-13 20:41:20.239717 | controller | - l2advertisement.metallb.io/storage created 2025-10-13 20:41:20.239722 | controller | - l2advertisement.metallb.io/tenant created 2025-10-13 20:41:20.239728 | controller | - l2advertisement.metallb.io/designateext created 2025-10-13 20:41:20.239734 | controller | - bash scripts/gen-olm.sh 2025-10-13 20:41:20.239740 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.239745 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.239751 | controller | - + '[' -z quay.io/openstack-k8s-operators/openstack-operator-index:latest ']' 2025-10-13 20:41:20.239760 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.239765 | controller | ']' 2025-10-13 20:41:20.239771 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.239777 | controller | ']' 2025-10-13 20:41:20.239783 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.239788 | controller | - + OPERATOR_CHANNEL=alpha 2025-10-13 20:41:20.239794 | controller | - + OPERATOR_SOURCE=openstack-operator-index 2025-10-13 20:41:20.239800 | controller | - + OPERATOR_SOURCE_NAMESPACE=openstack-operators 2025-10-13 20:41:20.239805 | controller | - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.239818 | controller | - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.239826 | controller | - + echo OPERATOR_CHANNEL alpha 2025-10-13 20:41:20.239834 | controller | - OPERATOR_CHANNEL alpha 2025-10-13 20:41:20.239842 | controller | - + echo OPERATOR_SOURCE openstack-operator-index 2025-10-13 20:41:20.239850 | controller | - OPERATOR_SOURCE openstack-operator-index 2025-10-13 20:41:20.239857 | controller | - + echo OPERATOR_SOURCE_NAMESPACE openstack-operators 2025-10-13 20:41:20.239862 | controller | - OPERATOR_SOURCE_NAMESPACE openstack-operators 2025-10-13 20:41:20.239868 | controller | - + cat 2025-10-13 20:41:20.239874 | controller | - + cat 2025-10-13 20:41:20.239880 | controller | - + cat 2025-10-13 20:41:20.239885 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.239891 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.239897 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.239903 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-operators 2025-10-13 20:41:20.239908 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators 2025-10-13 20:41:20.239914 | controller | ']' 2025-10-13 20:41:20.239920 | controller | - + cat 2025-10-13 20:41:20.239925 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/namespace.yaml 2025-10-13 20:41:20.239931 | controller | - 'Warning: resource namespaces/openstack-operators is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.239937 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.239942 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.239948 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.239954 | controller | - namespace/openstack-operators configured 2025-10-13 20:41:20.239959 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io openstack-operators); 2025-10-13 20:41:20.239965 | controller | do sleep 1; done" 2025-10-13 20:41:20.239971 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.239977 | controller | - openstack-operators Active 2025-10-13 20:41:20.239982 | controller | - oc project openstack-operators 2025-10-13 20:41:20.239988 | controller | - Now using project "openstack-operators" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.239994 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.239999 | controller | - catalogsource.operators.coreos.com/openstack-operator-index created 2025-10-13 20:41:20.240005 | controller | - operatorgroup.operators.coreos.com/openstack created 2025-10-13 20:41:20.240011 | controller | - subscription.operators.coreos.com/openstack-operator created 2025-10-13 20:41:20.240017 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr 2025-10-13 20:41:20.240022 | controller | | oc delete --ignore-not-found=true -f - 2025-10-13 20:41:20.240028 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr'' 2025-10-13 20:41:20.240037 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: 2025-10-13 20:41:20.240043 | controller | no such file or directory' 2025-10-13 20:41:20.240048 | controller | - No resources found 2025-10-13 20:41:20.240054 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator 2025-10-13 20:41:20.240060 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr 2025-10-13 20:41:20.240066 | controller | - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.240071 | controller | | oc delete --ignore-not-found=true -f - || true 2025-10-13 20:41:20.240077 | controller | - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr'' 2025-10-13 20:41:20.240083 | controller | : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack: 2025-10-13 20:41:20.240088 | controller | no such file or directory' 2025-10-13 20:41:20.240100 | controller | - No resources found 2025-10-13 20:41:20.240106 | controller | - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator 2025-10-13 20:41:20.240111 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.240117 | controller | - mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op 2025-10-13 20:41:20.240123 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.240128 | controller | - bash -c "test -d /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator 2025-10-13 20:41:20.240134 | controller | || CHECKOUT_FROM_OPENSTACK_REF=false scripts/clone-operator-repo.sh" 2025-10-13 20:41:20.240140 | controller | - 'Cloning repo: git clone -b main https://github.com/openstack-k8s-operators/openstack-operator.git 2025-10-13 20:41:20.240146 | controller | openstack-operator' 2025-10-13 20:41:20.240151 | controller | - Cloning into 'openstack-operator'... 2025-10-13 20:41:20.240157 | controller | - cp /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml 2025-10-13 20:41:20.240163 | controller | /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.240168 | controller | - bash scripts/gen-service-kustomize.sh 2025-10-13 20:41:20.240174 | controller | - +++ dirname scripts/gen-service-kustomize.sh 2025-10-13 20:41:20.240187 | controller | - ++ cd scripts 2025-10-13 20:41:20.240195 | controller | - ++ pwd -P 2025-10-13 20:41:20.240203 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.240211 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/common.sh 2025-10-13 20:41:20.240218 | controller | --source-only 2025-10-13 20:41:20.240224 | controller | - ++ set -e 2025-10-13 20:41:20.240230 | controller | - + '[' -z openstack-kuttl-tests ']' 2025-10-13 20:41:20.240235 | controller | - + '[' -z OpenStackControlPlane ']' 2025-10-13 20:41:20.240241 | controller | - + '[' -z osp-secret ']' 2025-10-13 20:41:20.240247 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.240253 | controller | ']' 2025-10-13 20:41:20.240260 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.240266 | controller | - + REPLACEMENTS= 2025-10-13 20:41:20.240272 | controller | - + IMAGE=unused 2025-10-13 20:41:20.240277 | controller | - + IMAGE_PATH=containerImage 2025-10-13 20:41:20.240283 | controller | - + STORAGE_REQUEST=10G 2025-10-13 20:41:20.240292 | controller | - + INTERFACE_MTU=1500 2025-10-13 20:41:20.240297 | controller | - + VLAN_START=20 2025-10-13 20:41:20.240303 | controller | - + VLAN_STEP=1 2025-10-13 20:41:20.240309 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.240315 | controller | ']' 2025-10-13 20:41:20.240320 | controller | - + pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr 2025-10-13 20:41:20.240337 | controller | - ~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.240343 | controller | - + cat 2025-10-13 20:41:20.240348 | controller | - + [[ OpenStackControlPlane == \O\p\e\n\S\t\a\c\k\C\o\n\t\r\o\l\P\l\a\n\e ]] 2025-10-13 20:41:20.240354 | controller | - + [[ '' != '' ]] 2025-10-13 20:41:20.240360 | controller | - + IFS=, 2025-10-13 20:41:20.240366 | controller | - + read -ra IMAGES 2025-10-13 20:41:20.240371 | controller | - + IFS=, 2025-10-13 20:41:20.240377 | controller | - + read -ra IMAGE_PATHS 2025-10-13 20:41:20.240383 | controller | - + '[' 1 '!=' 1 ']' 2025-10-13 20:41:20.240388 | controller | - + (( i=0 )) 2025-10-13 20:41:20.240398 | controller | - + (( i < 1 )) 2025-10-13 20:41:20.240418 | controller | - + SPEC_PATH=containerImage 2025-10-13 20:41:20.240424 | controller | - + SPEC_VALUE=unused 2025-10-13 20:41:20.240430 | controller | - + '[' unused '!=' unused ']' 2025-10-13 20:41:20.240435 | controller | - + (( i++ )) 2025-10-13 20:41:20.240441 | controller | - + (( i < 1 )) 2025-10-13 20:41:20.240447 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.240453 | controller | - + '[' OpenStackControlPlane == OpenStackControlPlane ']' 2025-10-13 20:41:20.240458 | controller | - + cat 2025-10-13 20:41:20.240464 | controller | - + '[' OpenStackControlPlane == Galera ']' 2025-10-13 20:41:20.240470 | controller | - + '[' OpenStackControlPlane == NetConfig ']' 2025-10-13 20:41:20.240475 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.240481 | controller | - + [[ OpenStackControlPlane == \O\p\e\n\S\t\a\c\k\C\o\n\t\r\o\l\P\l\a\n\e ]] 2025-10-13 20:41:20.240487 | controller | - + [[ true == \t\r\u\e ]] 2025-10-13 20:41:20.240493 | controller | - + cat 2025-10-13 20:41:20.240498 | controller | - + [[ OpenStackControlPlane == \O\p\e\n\S\t\a\c\k\C\o\n\t\r\o\l\P\l\a\n\e ]] 2025-10-13 20:41:20.240504 | controller | - + '[' -z true ']' 2025-10-13 20:41:20.240510 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.240515 | controller | - + '[' -z true ']' 2025-10-13 20:41:20.240521 | controller | - + '[' -n true ']' 2025-10-13 20:41:20.240527 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.240532 | controller | - + '[' -n '' ']' 2025-10-13 20:41:20.240538 | controller | - + kustomization_add_resources 2025-10-13 20:41:20.240544 | controller | - + echo merge config dir 2025-10-13 20:41:20.240549 | controller | - merge config dir 2025-10-13 20:41:20.240555 | controller | - ++ find . -type f -name '*.yaml' 2025-10-13 20:41:20.240561 | controller | - ++ grep -v kustomization 2025-10-13 20:41:20.240567 | controller | - + yamls=./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml 2025-10-13 20:41:20.240572 | controller | - + for y in ${yamls[@]} 2025-10-13 20:41:20.240578 | controller | - + kustomize edit add resource ./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml 2025-10-13 20:41:20.240584 | controller | - + popd 2025-10-13 20:41:20.240590 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.240595 | controller | - '# Wait until OLM installs openstack CRDs' 2025-10-13 20:41:20.240601 | controller | - timeout 500s bash -c "while ! (oc get crd openstacks.operator.openstack.org); do 2025-10-13 20:41:20.240607 | controller | sleep 1; done" 2025-10-13 20:41:20.240613 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240618 | controller | not found' 2025-10-13 20:41:20.240624 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240630 | controller | not found' 2025-10-13 20:41:20.240636 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240641 | controller | not found' 2025-10-13 20:41:20.240647 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240653 | controller | not found' 2025-10-13 20:41:20.240658 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240664 | controller | not found' 2025-10-13 20:41:20.240670 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240679 | controller | not found' 2025-10-13 20:41:20.240685 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240691 | controller | not found' 2025-10-13 20:41:20.240697 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240702 | controller | not found' 2025-10-13 20:41:20.240708 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240714 | controller | not found' 2025-10-13 20:41:20.240720 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240725 | controller | not found' 2025-10-13 20:41:20.240734 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240740 | controller | not found' 2025-10-13 20:41:20.240753 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240761 | controller | not found' 2025-10-13 20:41:20.240769 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240777 | controller | not found' 2025-10-13 20:41:20.240784 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240790 | controller | not found' 2025-10-13 20:41:20.240796 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240801 | controller | not found' 2025-10-13 20:41:20.240807 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240813 | controller | not found' 2025-10-13 20:41:20.240819 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240824 | controller | not found' 2025-10-13 20:41:20.240830 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240836 | controller | not found' 2025-10-13 20:41:20.240841 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240847 | controller | not found' 2025-10-13 20:41:20.240853 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240859 | controller | not found' 2025-10-13 20:41:20.240864 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240870 | controller | not found' 2025-10-13 20:41:20.240876 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240881 | controller | not found' 2025-10-13 20:41:20.240887 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240893 | controller | not found' 2025-10-13 20:41:20.240898 | controller | - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" 2025-10-13 20:41:20.240904 | controller | not found' 2025-10-13 20:41:20.240910 | controller | - NAME CREATED AT 2025-10-13 20:41:20.240916 | controller | - openstacks.operator.openstack.org 2025-10-13T19:38:15Z 2025-10-13 20:41:20.240921 | controller | - make openstack_init 2025-10-13 20:41:20.240927 | controller | - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.240933 | controller | - 'error: the server doesn''t have a resource type "openstackversion"' 2025-10-13 20:41:20.240942 | controller | - '# call make_openstack if it isn''t already' 2025-10-13 20:41:20.240948 | controller | - bash -c '(oc get subscription -n openstack-operators openstack-operator || make 2025-10-13 20:41:20.240954 | controller | openstack) || true' 2025-10-13 20:41:20.240960 | controller | - NAME PACKAGE SOURCE CHANNEL 2025-10-13 20:41:20.240965 | controller | - openstack-operator openstack-operator openstack-operator-index alpha 2025-10-13 20:41:20.240971 | controller | - timeout 500s bash -c 'until $(oc get csv -l operators.coreos.com/openstack-operator.openstack-operators 2025-10-13 20:41:20.240977 | controller | -n openstack-operators | grep -q Succeeded); do sleep 1; done' 2025-10-13 20:41:20.240982 | controller | - No resources found in openstack-operators namespace. 2025-10-13 20:41:20.240988 | controller | - bash -c 'test -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml 2025-10-13 20:41:20.240994 | controller | || make openstack_repo' 2025-10-13 20:41:20.241000 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml 2025-10-13 20:41:20.241006 | controller | - openstack.operator.openstack.org/openstack created 2025-10-13 20:41:20.241011 | controller | - '# FIXME: Ugly hack to prevent OpenStack Baremetal operator from crashing when BMO 2025-10-13 20:41:20.241017 | controller | is not installed' 2025-10-13 20:41:20.241023 | controller | - if ! echo "" | grep -q "baremetalhosts.metal3.io"; then \ 2025-10-13 20:41:20.241029 | controller | - "\tcurl -o /tmp/bmh_crd.yaml --retry-all-errors --retry 5 --retry-delay 10 https://raw.githubusercontent.com/metal3-io/baremetal-operator/refs/heads/main/config/base/crds/bases/metal3.io_baremetalhosts.yaml; 2025-10-13 20:41:20.241035 | controller | \\" 2025-10-13 20:41:20.241041 | controller | - "\toc apply -f /tmp/bmh_crd.yaml; \\" 2025-10-13 20:41:20.241046 | controller | - "\trm -f /tmp/bmh_crd.yaml; \\" 2025-10-13 20:41:20.241052 | controller | - fi 2025-10-13 20:41:20.241058 | controller | - ' % Total % Received % Xferd Average Speed Time Time Time Current' 2025-10-13 20:41:20.241064 | controller | - ' Dload Upload Total Spent Left Speed' 2025-10-13 20:41:20.241069 | controller | - '' 2025-10-13 20:41:20.241075 | controller | - ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0' 2025-10-13 20:41:20.241081 | controller | - 100 61353 100 61353 0 0 624k 0 --:--:-- --:--:-- --:--:-- 624k 2025-10-13 20:41:20.241089 | controller | - customresourcedefinition.apiextensions.k8s.io/baremetalhosts.metal3.io created 2025-10-13 20:41:20.241095 | controller | - oc wait openstack/openstack -n openstack-operators --for condition=Ready --timeout=500s 2025-10-13 20:41:20.241108 | controller | - openstack.operator.openstack.org/openstack condition met 2025-10-13 20:41:20.241116 | controller | - timeout 500s bash -c "while ! (oc get services -n openstack-operators | grep -E 2025-10-13 20:41:20.241124 | controller | '^(openstack|openstack-baremetal|infra)-operator-webhook-service' | wc -l | grep 2025-10-13 20:41:20.241131 | controller | -q -e 3); do sleep 5; done" 2025-10-13 20:41:20.241137 | controller | - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241143 | controller | - make wait 2025-10-13 20:41:20.241148 | controller | - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241154 | controller | - bash scripts/operator-wait.sh 2025-10-13 20:41:20.241160 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.241165 | controller | - +++ dirname scripts/operator-wait.sh 2025-10-13 20:41:20.241171 | controller | - ++ cd scripts 2025-10-13 20:41:20.241177 | controller | - ++ pwd -P 2025-10-13 20:41:20.241182 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241188 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241194 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241200 | controller | - + '[' openstack = rabbitmq ']' 2025-10-13 20:41:20.241205 | controller | - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241214 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241220 | controller | - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" 2025-10-13 20:41:20.241226 | controller | ]; do sleep 5; done' 2025-10-13 20:41:20.241231 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241237 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241243 | controller | - + '[' openstack = rabbitmq-cluster ']' 2025-10-13 20:41:20.241248 | controller | - + DEPL_NAME=openstack-operator-controller-manager 2025-10-13 20:41:20.241254 | controller | - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager 2025-10-13 20:41:20.241260 | controller | -o json 2025-10-13 20:41:20.241266 | controller | - ++ jq -e .status.availableReplicas 2025-10-13 20:41:20.241271 | controller | - + REPLICAS=1 2025-10-13 20:41:20.241277 | controller | - + '[' 1 '!=' 1 ']' 2025-10-13 20:41:20.241285 | controller | - + echo Succeeded 2025-10-13 20:41:20.241291 | controller | - + exit 0 2025-10-13 20:41:20.241297 | controller | - + rc=0 2025-10-13 20:41:20.241302 | controller | - + popd 2025-10-13 20:41:20.241308 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241314 | controller | - + exit 0 2025-10-13 20:41:20.241320 | controller | - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241325 | controller | - make wait 2025-10-13 20:41:20.241331 | controller | - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241337 | controller | - bash scripts/operator-wait.sh 2025-10-13 20:41:20.241342 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.241348 | controller | - +++ dirname scripts/operator-wait.sh 2025-10-13 20:41:20.241354 | controller | - ++ cd scripts 2025-10-13 20:41:20.241359 | controller | - ++ pwd -P 2025-10-13 20:41:20.241365 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241371 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241376 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241382 | controller | - + '[' openstack = rabbitmq ']' 2025-10-13 20:41:20.241388 | controller | - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241397 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241426 | controller | - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" 2025-10-13 20:41:20.241434 | controller | ]; do sleep 5; done' 2025-10-13 20:41:20.241442 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241449 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241455 | controller | - + '[' openstack = rabbitmq-cluster ']' 2025-10-13 20:41:20.241460 | controller | - + DEPL_NAME=openstack-operator-controller-manager 2025-10-13 20:41:20.241466 | controller | - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager 2025-10-13 20:41:20.241472 | controller | -o json 2025-10-13 20:41:20.241477 | controller | - ++ jq -e .status.availableReplicas 2025-10-13 20:41:20.241483 | controller | - + REPLICAS=1 2025-10-13 20:41:20.241489 | controller | - + '[' 1 '!=' 1 ']' 2025-10-13 20:41:20.241495 | controller | - + echo Succeeded 2025-10-13 20:41:20.241500 | controller | - + exit 0 2025-10-13 20:41:20.241506 | controller | - + rc=0 2025-10-13 20:41:20.241512 | controller | - + popd 2025-10-13 20:41:20.241517 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241523 | controller | - + exit 0 2025-10-13 20:41:20.241529 | controller | - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241534 | controller | - make wait 2025-10-13 20:41:20.241544 | controller | - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241549 | controller | - bash scripts/operator-wait.sh 2025-10-13 20:41:20.241555 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.241561 | controller | - +++ dirname scripts/operator-wait.sh 2025-10-13 20:41:20.241570 | controller | - ++ cd scripts 2025-10-13 20:41:20.241575 | controller | - ++ pwd -P 2025-10-13 20:41:20.241581 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241587 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241592 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241598 | controller | - + '[' openstack = rabbitmq ']' 2025-10-13 20:41:20.241604 | controller | - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241609 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241615 | controller | - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" 2025-10-13 20:41:20.241621 | controller | ]; do sleep 5; done' 2025-10-13 20:41:20.241627 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241632 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241638 | controller | - + '[' openstack = rabbitmq-cluster ']' 2025-10-13 20:41:20.241644 | controller | - + DEPL_NAME=openstack-operator-controller-manager 2025-10-13 20:41:20.241658 | controller | - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager 2025-10-13 20:41:20.241666 | controller | -o json 2025-10-13 20:41:20.241674 | controller | - ++ jq -e .status.availableReplicas 2025-10-13 20:41:20.241682 | controller | - + REPLICAS=1 2025-10-13 20:41:20.241689 | controller | - + '[' 1 '!=' 1 ']' 2025-10-13 20:41:20.241696 | controller | - + echo Succeeded 2025-10-13 20:41:20.241701 | controller | - + exit 0 2025-10-13 20:41:20.241707 | controller | - + rc=0 2025-10-13 20:41:20.241713 | controller | - + popd 2025-10-13 20:41:20.241718 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241724 | controller | - + exit 0 2025-10-13 20:41:20.241730 | controller | - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241735 | controller | - make wait 2025-10-13 20:41:20.241741 | controller | - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241747 | controller | - bash scripts/operator-wait.sh 2025-10-13 20:41:20.241753 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.241758 | controller | - +++ dirname scripts/operator-wait.sh 2025-10-13 20:41:20.241764 | controller | - ++ cd scripts 2025-10-13 20:41:20.241770 | controller | - ++ pwd -P 2025-10-13 20:41:20.241775 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241781 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241787 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241792 | controller | - + '[' openstack = rabbitmq ']' 2025-10-13 20:41:20.241802 | controller | - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.241807 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241813 | controller | - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" 2025-10-13 20:41:20.241819 | controller | ]; do sleep 5; done' 2025-10-13 20:41:20.241825 | controller | - + '[' -z openstack-operators ']' 2025-10-13 20:41:20.241831 | controller | - + '[' -z openstack ']' 2025-10-13 20:41:20.241836 | controller | - + '[' openstack = rabbitmq-cluster ']' 2025-10-13 20:41:20.241842 | controller | - + DEPL_NAME=openstack-operator-controller-manager 2025-10-13 20:41:20.241848 | controller | - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager 2025-10-13 20:41:20.241854 | controller | -o json 2025-10-13 20:41:20.241859 | controller | - ++ jq -e .status.availableReplicas 2025-10-13 20:41:20.241865 | controller | - + REPLICAS=1 2025-10-13 20:41:20.241871 | controller | - + '[' 1 '!=' 1 ']' 2025-10-13 20:41:20.241876 | controller | - + echo Succeeded 2025-10-13 20:41:20.241882 | controller | - + exit 0 2025-10-13 20:41:20.241888 | controller | - + rc=0 2025-10-13 20:41:20.241893 | controller | - + popd 2025-10-13 20:41:20.241901 | controller | - ~/src/github.com/openstack-k8s-operators/install_yamls 2025-10-13 20:41:20.241907 | controller | - + exit 0 2025-10-13 20:41:20.241913 | controller | - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241923 | controller | - make openstack_kuttl_run 2025-10-13 20:41:20.241928 | controller | - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.241934 | controller | - set -e; \ 2025-10-13 20:41:20.241940 | controller | - for test_dir in ctlplane-basic-deployment ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.241946 | controller | ctlplane-collapsed ctlplane-galera-3replicas ctlplane-galera-basic ctlplane-nodeselectors 2025-10-13 20:41:20.241951 | controller | ctlplane-tls-cert-rotation ctlplane-tls-custom-issuers ctlplane-tls-custom-route 2025-10-13 20:41:20.241957 | controller | dataplane-create-test dataplane-deploy-global-service-test dataplane-deploy-multiple-secrets 2025-10-13 20:41:20.241963 | controller | dataplane-deploy-no-nodes-test dataplane-deploy-tls-test dataplane-extramounts dataplane-multinode-nodeset-create-test 2025-10-13 20:41:20.241968 | controller | dataplane-service-config dataplane-service-custom-image dataplane-service-failure; 2025-10-13 20:41:20.241974 | controller | do \ 2025-10-13 20:41:20.241980 | controller | - ' oc delete osctlplane --all --namespace openstack-kuttl-tests; \' 2025-10-13 20:41:20.241986 | controller | - "\tmake crc_storage_cleanup_with_retries; \\" 2025-10-13 20:41:20.241991 | controller | - "\tmake crc_storage_with_retries; \\" 2025-10-13 20:41:20.241997 | controller | - "\tkubectl-kuttl test --config /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/kuttl-test.yaml 2025-10-13 20:41:20.242003 | controller | /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.242008 | controller | --test ${test_dir}; \\" 2025-10-13 20:41:20.242014 | controller | - done 2025-10-13 20:41:20.242020 | controller | - No resources found 2025-10-13 20:41:20.242026 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.242031 | controller | - bash scripts/retry_make_crc_storage_cleanup.sh 3 2025-10-13 20:41:20.242037 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.242043 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.242048 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.242054 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.242060 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.242065 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.242071 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.242077 | controller | - + cat 2025-10-13 20:41:20.242082 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.242088 | controller | - namespace/crc-storage created 2025-10-13 20:41:20.242094 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.242100 | controller | do sleep 1; done" 2025-10-13 20:41:20.242105 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.242111 | controller | - crc-storage Active 2025-10-13 20:41:20.242117 | controller | - oc project crc-storage 2025-10-13 20:41:20.242122 | controller | - Now using project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.242128 | controller | - bash scripts/cleanup-crc-pv.sh 2025-10-13 20:41:20.242141 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.242149 | controller | - ++ awk '{print $6}' 2025-10-13 20:41:20.242157 | controller | - ++ grep Bound 2025-10-13 20:41:20.242165 | controller | - No resources found 2025-10-13 20:41:20.242172 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.242181 | controller | - ++ awk '{print $1}' 2025-10-13 20:41:20.242200 | controller | - No resources found 2025-10-13 20:41:20.242206 | controller | - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi 2025-10-13 20:41:20.242215 | controller | - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE 2025-10-13 20:41:20.242221 | controller | - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m7s 2025-10-13 20:41:20.242226 | controller | - storageclass.storage.k8s.io "local-storage" deleted 2025-10-13 20:41:20.242232 | controller | - bash scripts/delete-pv.sh 2025-10-13 20:41:20.242238 | controller | - +++ dirname scripts/delete-pv.sh 2025-10-13 20:41:20.242243 | controller | - ++ cd scripts 2025-10-13 20:41:20.242249 | controller | - ++ pwd -P 2025-10-13 20:41:20.242255 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.242260 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.242266 | controller | - ++ set -ex 2025-10-13 20:41:20.242272 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.242278 | controller | - ++ cat 2025-10-13 20:41:20.242283 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242289 | controller | - configmap/crc-storage created 2025-10-13 20:41:20.242295 | controller | - ++ cat 2025-10-13 20:41:20.242300 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242306 | controller | - serviceaccount/crc-storage created 2025-10-13 20:41:20.242313 | controller | - ++ cat 2025-10-13 20:41:20.242320 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242328 | controller | - role.rbac.authorization.k8s.io/crc-storage-role created 2025-10-13 20:41:20.242335 | controller | - ++ cat 2025-10-13 20:41:20.242343 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242350 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding created 2025-10-13 20:41:20.242358 | controller | - + PV_NUM=20 2025-10-13 20:41:20.242365 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.242372 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.242380 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.242388 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.242395 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.242423 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.242431 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.242437 | controller | crc delete 2025-10-13 20:41:20.242442 | controller | - ++ set -ex 2025-10-13 20:41:20.242448 | controller | - ++ NODE=crc 2025-10-13 20:41:20.242454 | controller | - ++ OPERATION=delete 2025-10-13 20:41:20.242459 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.242465 | controller | - ++ cat 2025-10-13 20:41:20.242471 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242477 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.242482 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.242488 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.242494 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.242506 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.242511 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.242517 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.242523 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.242529 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.242534 | controller | --timeout 500s 2025-10-13 20:41:20.242540 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.242546 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.242551 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.242557 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.242566 | controller | - bash scripts/retry_make_crc_storage.sh 3 2025-10-13 20:41:20.242572 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.242578 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.242584 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.242589 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.242595 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.242601 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.242606 | controller | - + cat 2025-10-13 20:41:20.242612 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.242618 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.242624 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.242629 | controller | do sleep 1; done" 2025-10-13 20:41:20.242637 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.242643 | controller | - crc-storage Active 2025-10-13 20:41:20.242649 | controller | - oc project crc-storage 2025-10-13 20:41:20.242654 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.242660 | controller | - bash scripts/create-pv.sh 2025-10-13 20:41:20.242666 | controller | - +++ dirname scripts/create-pv.sh 2025-10-13 20:41:20.242672 | controller | - ++ cd scripts 2025-10-13 20:41:20.242677 | controller | - ++ pwd -P 2025-10-13 20:41:20.242683 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.242698 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.242706 | controller | - ++ set -ex 2025-10-13 20:41:20.242714 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.242721 | controller | - ++ cat 2025-10-13 20:41:20.242727 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242733 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.242739 | controller | - ++ cat 2025-10-13 20:41:20.242744 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242750 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.242756 | controller | - ++ cat 2025-10-13 20:41:20.242761 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242767 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.242773 | controller | - ++ cat 2025-10-13 20:41:20.242778 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242784 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.242790 | controller | - + PV_NUM=20 2025-10-13 20:41:20.242795 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.242801 | controller | - ++ oc get pv -o json 2025-10-13 20:41:20.242807 | controller | - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' 2025-10-13 20:41:20.242812 | controller | - + released= 2025-10-13 20:41:20.242818 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.242824 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.242830 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.242835 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.242841 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.242847 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.242852 | controller | crc create 2025-10-13 20:41:20.242858 | controller | - ++ set -ex 2025-10-13 20:41:20.242864 | controller | - ++ NODE=crc 2025-10-13 20:41:20.242869 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.242875 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.242881 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.242889 | controller | - ++ cat 2025-10-13 20:41:20.242895 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.242901 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.242909 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.242915 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.242921 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.242926 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.242932 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.242938 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.242943 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.242949 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.242955 | controller | --timeout 500s 2025-10-13 20:41:20.242960 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.242966 | controller | - bash scripts/gen-crc-pv-kustomize.sh 2025-10-13 20:41:20.242972 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.242978 | controller | - + '[' -z '"local-storage"' ']' 2025-10-13 20:41:20.242983 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' 2025-10-13 20:41:20.242989 | controller | - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/crc 2025-10-13 20:41:20.242995 | controller | - + PV_NUM=20 2025-10-13 20:41:20.243000 | controller | - + STORAGE_CAPACITY=10 2025-10-13 20:41:20.243006 | controller | - ++ oc get node -o name -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.243012 | controller | - ++ head -c-1 2025-10-13 20:41:20.243017 | controller | - ++ sed -e 's|node/||' 2025-10-13 20:41:20.243023 | controller | - ++ tr '\n' ' ' 2025-10-13 20:41:20.243029 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.243035 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.243040 | controller | - + cat 2025-10-13 20:41:20.243046 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.243052 | controller | - ++ seq -w 20 2025-10-13 20:41:20.243057 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243063 | controller | - + cat 2025-10-13 20:41:20.243069 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243074 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243080 | controller | - + cat 2025-10-13 20:41:20.243086 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243091 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243097 | controller | - + cat 2025-10-13 20:41:20.243103 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243108 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243114 | controller | - + cat 2025-10-13 20:41:20.243120 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243126 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243131 | controller | - + cat 2025-10-13 20:41:20.243137 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243143 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243148 | controller | - + cat 2025-10-13 20:41:20.243154 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243159 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243165 | controller | - + cat 2025-10-13 20:41:20.243171 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243176 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243182 | controller | - + cat 2025-10-13 20:41:20.243188 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243196 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243202 | controller | - + cat 2025-10-13 20:41:20.243208 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243213 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243219 | controller | - + cat 2025-10-13 20:41:20.243225 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243230 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243236 | controller | - + cat 2025-10-13 20:41:20.243241 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243247 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243253 | controller | - + cat 2025-10-13 20:41:20.243258 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243267 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243272 | controller | - + cat 2025-10-13 20:41:20.243278 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243284 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243289 | controller | - + cat 2025-10-13 20:41:20.243295 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243301 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243306 | controller | - + cat 2025-10-13 20:41:20.243312 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243318 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243323 | controller | - + cat 2025-10-13 20:41:20.243329 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243335 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243340 | controller | - + cat 2025-10-13 20:41:20.243346 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243352 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243357 | controller | - + cat 2025-10-13 20:41:20.243370 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243378 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243386 | controller | - + cat 2025-10-13 20:41:20.243396 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243417 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.243429 | controller | - + cat 2025-10-13 20:41:20.243437 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.243443 | controller | - + cat 2025-10-13 20:41:20.243449 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:41:20.243455 | controller | - storageclass.storage.k8s.io/local-storage created 2025-10-13 20:41:20.243461 | controller | - 'Warning: resource persistentvolumes/local-storage01-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243466 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243472 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243478 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243484 | controller | - persistentvolume/local-storage01-crc configured 2025-10-13 20:41:20.243489 | controller | - 'Warning: resource persistentvolumes/local-storage02-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243495 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243501 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243506 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243512 | controller | - persistentvolume/local-storage02-crc configured 2025-10-13 20:41:20.243518 | controller | - 'Warning: resource persistentvolumes/local-storage03-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243523 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243529 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243535 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243540 | controller | - persistentvolume/local-storage03-crc configured 2025-10-13 20:41:20.243546 | controller | - 'Warning: resource persistentvolumes/local-storage04-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243552 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243561 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243567 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243572 | controller | - persistentvolume/local-storage04-crc configured 2025-10-13 20:41:20.243578 | controller | - 'Warning: resource persistentvolumes/local-storage05-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243584 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243593 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243599 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243604 | controller | - persistentvolume/local-storage05-crc configured 2025-10-13 20:41:20.243610 | controller | - 'Warning: resource persistentvolumes/local-storage06-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243616 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243621 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243627 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243632 | controller | - persistentvolume/local-storage06-crc configured 2025-10-13 20:41:20.243638 | controller | - 'Warning: resource persistentvolumes/local-storage07-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243644 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243649 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243655 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243661 | controller | - persistentvolume/local-storage07-crc configured 2025-10-13 20:41:20.243666 | controller | - 'Warning: resource persistentvolumes/local-storage08-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243672 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243678 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243683 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243692 | controller | - persistentvolume/local-storage08-crc configured 2025-10-13 20:41:20.243698 | controller | - 'Warning: resource persistentvolumes/local-storage09-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243703 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243711 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243717 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243723 | controller | - persistentvolume/local-storage09-crc configured 2025-10-13 20:41:20.243737 | controller | - 'Warning: resource persistentvolumes/local-storage10-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243745 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243753 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243760 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243767 | controller | - persistentvolume/local-storage10-crc configured 2025-10-13 20:41:20.243775 | controller | - 'Warning: resource persistentvolumes/local-storage11-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243781 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243788 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243795 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243801 | controller | - persistentvolume/local-storage11-crc configured 2025-10-13 20:41:20.243807 | controller | - 'Warning: resource persistentvolumes/local-storage12-crc is missing the kubectl.kubernetes.io/last-applied-configuration 2025-10-13 20:41:20.243812 | controller | annotation which is required by oc apply. oc apply should only be used on resources 2025-10-13 20:41:20.243818 | controller | created declaratively by either oc create --save-config or oc apply. The missing 2025-10-13 20:41:20.243824 | controller | annotation will be patched automatically.' 2025-10-13 20:41:20.243833 | controller | - persistentvolume/local-storage12-crc configured 2025-10-13 20:41:20.243839 | controller | - persistentvolume/local-storage13-crc created 2025-10-13 20:41:20.243844 | controller | - persistentvolume/local-storage14-crc created 2025-10-13 20:41:20.243850 | controller | - persistentvolume/local-storage15-crc created 2025-10-13 20:41:20.243856 | controller | - persistentvolume/local-storage16-crc created 2025-10-13 20:41:20.243861 | controller | - persistentvolume/local-storage17-crc created 2025-10-13 20:41:20.243867 | controller | - persistentvolume/local-storage18-crc created 2025-10-13 20:41:20.243873 | controller | - persistentvolume/local-storage19-crc created 2025-10-13 20:41:20.243878 | controller | - persistentvolume/local-storage20-crc created 2025-10-13 20:41:20.243884 | controller | - persistentvolumeclaim/ansible-ee-logs created 2025-10-13 20:41:20.243889 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.243895 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.243901 | controller | - '2025/10/13 19:39:52 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.243907 | controller | ]' 2025-10-13 20:41:20.243913 | controller | - === RUN kuttl 2025-10-13 20:41:20.243918 | controller | - ' harness.go:463: starting setup' 2025-10-13 20:41:20.243924 | controller | - ' harness.go:255: running tests using configured kubeconfig.' 2025-10-13 20:41:20.243930 | controller | - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' 2025-10-13 20:41:20.243935 | controller | - ' logger.go:42: 19:39:52 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.243941 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' 2025-10-13 20:41:20.243947 | controller | - ' logger.go:42: 19:39:52 | | netconfig.network.openstack.org/netconfig created' 2025-10-13 20:41:20.243952 | controller | - ' logger.go:42: 19:39:52 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.243958 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' 2025-10-13 20:41:20.243964 | controller | - ' logger.go:42: 19:39:52 | | dnsmasq.network.openstack.org/dnsmasq created' 2025-10-13 20:41:20.243970 | controller | - ' logger.go:42: 19:39:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.243975 | controller | ]; then' 2025-10-13 20:41:20.243981 | controller | - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' 2025-10-13 20:41:20.243987 | controller | - ' fi' 2025-10-13 20:41:20.243992 | controller | - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' 2025-10-13 20:41:20.243998 | controller | - ' --save-config \' 2025-10-13 20:41:20.244004 | controller | - ' --dry-run=client \' 2025-10-13 20:41:20.244010 | controller | - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.244015 | controller | - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' 2025-10-13 20:41:20.244021 | controller | - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.244027 | controller | - ' -n openstack-kuttl-tests \' 2025-10-13 20:41:20.244033 | controller | - ' -o yaml | \' 2025-10-13 20:41:20.244039 | controller | - ' oc apply -f -' 2025-10-13 20:41:20.244044 | controller | - ' ]' 2025-10-13 20:41:20.244050 | controller | - ' logger.go:42: 19:39:53 | | Generating public/private rsa key pair.' 2025-10-13 20:41:20.244056 | controller | - ' logger.go:42: 19:39:53 | | Your identification has been saved in ansibleee-ssh-key-id_rsa' 2025-10-13 20:41:20.244064 | controller | - ' logger.go:42: 19:39:53 | | Your public key has been saved in ansibleee-ssh-key-id_rsa.pub' 2025-10-13 20:41:20.244070 | controller | - ' logger.go:42: 19:39:53 | | The key fingerprint is:' 2025-10-13 20:41:20.244076 | controller | - ' logger.go:42: 19:39:53 | | SHA256:VCJuwoD6YMCqjIbrmfxGP1cc3DBS1brr9CZYa6fIhnQ 2025-10-13 20:41:20.244084 | controller | zuul@controller' 2025-10-13 20:41:20.244090 | controller | - ' logger.go:42: 19:39:53 | | The key''s randomart image is:' 2025-10-13 20:41:20.244103 | controller | - ' logger.go:42: 19:39:53 | | +---[RSA 4096]----+' 2025-10-13 20:41:20.244110 | controller | - ' logger.go:42: 19:39:53 | | |... . o.o.. |' 2025-10-13 20:41:20.244118 | controller | - ' logger.go:42: 19:39:53 | | |o. o . o = . |' 2025-10-13 20:41:20.244126 | controller | - ' logger.go:42: 19:39:53 | | |+ o o + + . |' 2025-10-13 20:41:20.244131 | controller | - ' logger.go:42: 19:39:53 | | |+. o . o o |' 2025-10-13 20:41:20.244137 | controller | - ' logger.go:42: 19:39:53 | | |*o S . . |' 2025-10-13 20:41:20.244143 | controller | - ' logger.go:42: 19:39:53 | | |+o.. . E o |' 2025-10-13 20:41:20.244148 | controller | - ' logger.go:42: 19:39:53 | | |... . . + o.o |' 2025-10-13 20:41:20.244154 | controller | - ' logger.go:42: 19:39:53 | | |o o. o o.oo=.o |' 2025-10-13 20:41:20.244160 | controller | - ' logger.go:42: 19:39:53 | | |.=o. o .ooo=. |' 2025-10-13 20:41:20.244165 | controller | - ' logger.go:42: 19:39:53 | | +----[SHA256]-----+' 2025-10-13 20:41:20.244171 | controller | - ' logger.go:42: 19:39:53 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.244177 | controller | created' 2025-10-13 20:41:20.244183 | controller | - ' harness.go:363: running tests' 2025-10-13 20:41:20.244189 | controller | - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each 2025-10-13 20:41:20.244194 | controller | step' 2025-10-13 20:41:20.244200 | controller | - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.244206 | controller | has 19 tests' 2025-10-13 20:41:20.244212 | controller | - === RUN kuttl/harness 2025-10-13 20:41:20.244217 | controller | - === RUN kuttl/harness/ctlplane-basic-deployment 2025-10-13 20:41:20.244223 | controller | - === PAUSE kuttl/harness/ctlplane-basic-deployment 2025-10-13 20:41:20.244229 | controller | - === RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.244235 | controller | - === PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.244240 | controller | - === CONT kuttl/harness/ctlplane-basic-deployment 2025-10-13 20:41:20.244246 | controller | - ' logger.go:42: 19:39:53 | ctlplane-basic-deployment | Skipping creation of user-supplied 2025-10-13 20:41:20.244252 | controller | namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.244257 | controller | - ' logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack | starting 2025-10-13 20:41:20.244263 | controller | test step 1-deploy-openstack' 2025-10-13 20:41:20.244269 | controller | - ' logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack | running 2025-10-13 20:41:20.244274 | controller | command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.244280 | controller | | oc apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.244286 | controller | - ' ]' 2025-10-13 20:41:20.244292 | controller | - ' logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | Warning: 2025-10-13 20:41:20.244297 | controller | spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for 2025-10-13 20:41:20.244303 | controller | production! For production use at least 5G!' 2025-10-13 20:41:20.244309 | controller | - ' logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | Warning: 2025-10-13 20:41:20.244314 | controller | spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! 2025-10-13 20:41:20.244320 | controller | For production use at least 5G!' 2025-10-13 20:41:20.244326 | controller | - ' logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.244331 | controller | created' 2025-10-13 20:41:20.244337 | controller | - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/1-deploy-openstack | test 2025-10-13 20:41:20.244343 | controller | step completed 1-deploy-openstack' 2025-10-13 20:41:20.244348 | controller | - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret 2025-10-13 20:41:20.244357 | controller | | starting test step 2-deploy-custom-cacert-secret' 2025-10-13 20:41:20.244363 | controller | - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret 2025-10-13 20:41:20.244369 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../common/custom-ca.yaml' 2025-10-13 20:41:20.244374 | controller | - ' ]' 2025-10-13 20:41:20.244380 | controller | - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret 2025-10-13 20:41:20.244386 | controller | | secret/ca-custom-kuttl created' 2025-10-13 20:41:20.244395 | controller | - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret 2025-10-13 20:41:20.244415 | controller | | test step completed 2-deploy-custom-cacert-secret' 2025-10-13 20:41:20.244434 | controller | - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/3-deploy-custom-cacert | 2025-10-13 20:41:20.244440 | controller | starting test step 3-deploy-custom-cacert' 2025-10-13 20:41:20.244445 | controller | - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/3-deploy-custom-cacert | 2025-10-13 20:41:20.244451 | controller | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_ca | 2025-10-13 20:41:20.244457 | controller | oc apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.244462 | controller | - ' ]' 2025-10-13 20:41:20.244468 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert | 2025-10-13 20:41:20.244474 | controller | openstackcontrolplane.core.openstack.org/openstack configured' 2025-10-13 20:41:20.244480 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert | 2025-10-13 20:41:20.244485 | controller | test step completed 3-deploy-custom-cacert' 2025-10-13 20:41:20.244491 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | starting test step 2025-10-13 20:41:20.244497 | controller | 4-' 2025-10-13 20:41:20.244502 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | running command: [sh 2025-10-13 20:41:20.244516 | controller | -c echo "Checking ca-custom-kuttl.pem is present in combined-ca-bundle..."' 2025-10-13 20:41:20.244524 | controller | - ' CUSTOM_CERT_CONTENT=$(oc get secret ca-custom-kuttl -n $NAMESPACE -o jsonpath="{.data[''ca-custom-kuttl\.pem'']}" 2025-10-13 20:41:20.244532 | controller | | base64 --decode | tr -d ''\n'')' 2025-10-13 20:41:20.244540 | controller | - ' TLS_BUNDLE_CONTENT=$(oc get secret combined-ca-bundle -n $NAMESPACE -o 2025-10-13 20:41:20.244547 | controller | jsonpath="{.data[''tls-ca-bundle\.pem'']}" | base64 --decode | tr -d ''\n'')' 2025-10-13 20:41:20.244554 | controller | - ' if [[ "$TLS_BUNDLE_CONTENT" == *"$CUSTOM_CERT_CONTENT"* ]]; then' 2025-10-13 20:41:20.244561 | controller | - ' echo "OK"' 2025-10-13 20:41:20.244567 | controller | - ' exit 0' 2025-10-13 20:41:20.244572 | controller | - ' else' 2025-10-13 20:41:20.244578 | controller | - ' echo "Not present"' 2025-10-13 20:41:20.244584 | controller | - ' exit 1' 2025-10-13 20:41:20.244589 | controller | - ' fi' 2025-10-13 20:41:20.244595 | controller | - ' ]' 2025-10-13 20:41:20.244601 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | Checking ca-custom-kuttl.pem 2025-10-13 20:41:20.244606 | controller | is present in combined-ca-bundle...' 2025-10-13 20:41:20.244612 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | OK' 2025-10-13 20:41:20.244618 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | test step completed 2025-10-13 20:41:20.244623 | controller | 4-' 2025-10-13 20:41:20.244629 | controller | - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/5-cleanup | starting test 2025-10-13 20:41:20.244635 | controller | step 5-cleanup' 2025-10-13 20:41:20.244640 | controller | - ' logger.go:42: 19:45:01 | ctlplane-basic-deployment/5-cleanup | running command: 2025-10-13 20:41:20.244646 | controller | [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' 2025-10-13 20:41:20.244652 | controller | - ' srv-swift-storage-0' 2025-10-13 20:41:20.244657 | controller | - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' 2025-10-13 20:41:20.244667 | controller | - ' oc delete secret -l service-cert -n $NAMESPACE' 2025-10-13 20:41:20.244672 | controller | - ' oc delete secret -l ca-cert -n $NAMESPACE' 2025-10-13 20:41:20.244678 | controller | - ' ]' 2025-10-13 20:41:20.244684 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "combined-ca-bundle" 2025-10-13 20:41:20.244690 | controller | deleted' 2025-10-13 20:41:20.244695 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-barbican-internal-svc" 2025-10-13 20:41:20.244701 | controller | deleted' 2025-10-13 20:41:20.244707 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-barbican-public-route" 2025-10-13 20:41:20.244712 | controller | deleted' 2025-10-13 20:41:20.244718 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-barbican-public-svc" 2025-10-13 20:41:20.244724 | controller | deleted' 2025-10-13 20:41:20.244730 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-ceilometer-internal-svc" 2025-10-13 20:41:20.244735 | controller | deleted' 2025-10-13 20:41:20.244741 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-cinder-internal-svc" 2025-10-13 20:41:20.244747 | controller | deleted' 2025-10-13 20:41:20.244752 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-cinder-public-route" 2025-10-13 20:41:20.244758 | controller | deleted' 2025-10-13 20:41:20.244764 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-cinder-public-svc" 2025-10-13 20:41:20.244769 | controller | deleted' 2025-10-13 20:41:20.244777 | controller | - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-galera-openstack-cell1-svc" 2025-10-13 20:41:20.244783 | controller | deleted' 2025-10-13 20:41:20.244789 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-galera-openstack-svc" 2025-10-13 20:41:20.244794 | controller | deleted' 2025-10-13 20:41:20.244800 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-glance-default-internal-svc" 2025-10-13 20:41:20.244806 | controller | deleted' 2025-10-13 20:41:20.244811 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-glance-default-public-route" 2025-10-13 20:41:20.244817 | controller | deleted' 2025-10-13 20:41:20.244823 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-glance-default-public-svc" 2025-10-13 20:41:20.244828 | controller | deleted' 2025-10-13 20:41:20.244834 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-keystone-internal-svc" 2025-10-13 20:41:20.244840 | controller | deleted' 2025-10-13 20:41:20.244845 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-keystone-public-route" 2025-10-13 20:41:20.244851 | controller | deleted' 2025-10-13 20:41:20.244857 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-keystone-public-svc" 2025-10-13 20:41:20.244862 | controller | deleted' 2025-10-13 20:41:20.244868 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-kube-state-metrics-svc" 2025-10-13 20:41:20.244874 | controller | deleted' 2025-10-13 20:41:20.244880 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-memcached-svc" 2025-10-13 20:41:20.244885 | controller | deleted' 2025-10-13 20:41:20.244891 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-internal-svc" 2025-10-13 20:41:20.244897 | controller | deleted' 2025-10-13 20:41:20.244902 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-ovndbs" 2025-10-13 20:41:20.244908 | controller | deleted' 2025-10-13 20:41:20.244914 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-public-route" 2025-10-13 20:41:20.244927 | controller | deleted' 2025-10-13 20:41:20.244938 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-public-svc" 2025-10-13 20:41:20.244946 | controller | deleted' 2025-10-13 20:41:20.244954 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-internal-svc" 2025-10-13 20:41:20.244961 | controller | deleted' 2025-10-13 20:41:20.244966 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-novncproxy-cell1-public-route" 2025-10-13 20:41:20.244972 | controller | deleted' 2025-10-13 20:41:20.244978 | controller | - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" 2025-10-13 20:41:20.244983 | controller | deleted' 2025-10-13 20:41:20.244989 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" 2025-10-13 20:41:20.244995 | controller | deleted' 2025-10-13 20:41:20.245000 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-public-route" 2025-10-13 20:41:20.245006 | controller | deleted' 2025-10-13 20:41:20.245012 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-public-svc" 2025-10-13 20:41:20.245017 | controller | deleted' 2025-10-13 20:41:20.245023 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovn-metrics" 2025-10-13 20:41:20.245029 | controller | deleted' 2025-10-13 20:41:20.245035 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovndbcluster-nb-ovndbs" 2025-10-13 20:41:20.245040 | controller | deleted' 2025-10-13 20:41:20.245046 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovndbcluster-sb-ovndbs" 2025-10-13 20:41:20.245052 | controller | deleted' 2025-10-13 20:41:20.245057 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovnnorthd-ovndbs" 2025-10-13 20:41:20.245063 | controller | deleted' 2025-10-13 20:41:20.245068 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-placement-internal-svc" 2025-10-13 20:41:20.245074 | controller | deleted' 2025-10-13 20:41:20.245083 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-placement-public-route" 2025-10-13 20:41:20.245089 | controller | deleted' 2025-10-13 20:41:20.245094 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-placement-public-svc" 2025-10-13 20:41:20.245100 | controller | deleted' 2025-10-13 20:41:20.245106 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-rabbitmq-cell1-svc" 2025-10-13 20:41:20.245111 | controller | deleted' 2025-10-13 20:41:20.245117 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-rabbitmq-svc" 2025-10-13 20:41:20.245123 | controller | deleted' 2025-10-13 20:41:20.245128 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-swift-internal-svc" 2025-10-13 20:41:20.245134 | controller | deleted' 2025-10-13 20:41:20.245140 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-swift-public-route" 2025-10-13 20:41:20.245145 | controller | deleted' 2025-10-13 20:41:20.245151 | controller | - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-swift-public-svc" 2025-10-13 20:41:20.245157 | controller | deleted' 2025-10-13 20:41:20.245162 | controller | - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-internal" 2025-10-13 20:41:20.245168 | controller | deleted' 2025-10-13 20:41:20.245174 | controller | - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-libvirt" 2025-10-13 20:41:20.245179 | controller | deleted' 2025-10-13 20:41:20.245185 | controller | - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-ovn" 2025-10-13 20:41:20.245191 | controller | deleted' 2025-10-13 20:41:20.245196 | controller | - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-public" 2025-10-13 20:41:20.245205 | controller | deleted' 2025-10-13 20:41:20.245211 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment/5-cleanup | test step completed 2025-10-13 20:41:20.245216 | controller | 5-cleanup' 2025-10-13 20:41:20.245222 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment | skipping kubernetes event 2025-10-13 20:41:20.245228 | controller | logging' 2025-10-13 20:41:20.245234 | controller | - === CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.245239 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings | Skipping 2025-10-13 20:41:20.245245 | controller | creation of user-supplied namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.245251 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.245256 | controller | | starting test step 1-create-nic-mappings' 2025-10-13 20:41:20.245262 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.245268 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml' 2025-10-13 20:41:20.245274 | controller | - ' ]' 2025-10-13 20:41:20.245279 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.245285 | controller | | networkattachmentdefinition.k8s.cni.cncf.io/datacentre configured' 2025-10-13 20:41:20.245291 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.245296 | controller | | test step completed 1-create-nic-mappings' 2025-10-13 20:41:20.245302 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.245315 | controller | | starting test step 2-deploy-openstack' 2025-10-13 20:41:20.245323 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.245331 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.245338 | controller | | oc apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.245346 | controller | - ' ]' 2025-10-13 20:41:20.245352 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.245357 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.245363 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.245369 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.245374 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.245383 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.245389 | controller | - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.245398 | controller | | openstackcontrolplane.core.openstack.org/openstack created' 2025-10-13 20:41:20.245419 | controller | - ' logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.245425 | controller | | test step completed 2-deploy-openstack' 2025-10-13 20:41:20.245430 | controller | - ' logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.245436 | controller | | starting test step 3-add-ovn-nic-mappings' 2025-10-13 20:41:20.245442 | controller | - ' logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.245448 | controller | | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack 2025-10-13 20:41:20.245453 | controller | --type=''json'' -p=''[{' 2025-10-13 20:41:20.245459 | controller | - ' "op": "replace",' 2025-10-13 20:41:20.245465 | controller | - ' "path": "/spec/ovn/template/ovnController/nicMappings",' 2025-10-13 20:41:20.245471 | controller | - ' "value":{"datacentre":"ospbr"}' 2025-10-13 20:41:20.245476 | controller | - ' }]''' 2025-10-13 20:41:20.245485 | controller | - ' ]' 2025-10-13 20:41:20.245491 | controller | - ' logger.go:42: 19:50:08 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.245497 | controller | | openstackcontrolplane.core.openstack.org/openstack patched' 2025-10-13 20:41:20.245503 | controller | - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.245508 | controller | | test step completed 3-add-ovn-nic-mappings' 2025-10-13 20:41:20.245514 | controller | - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245520 | controller | | starting test step 4-remove-ovn-nic-mappings' 2025-10-13 20:41:20.245526 | controller | - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245531 | controller | | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack 2025-10-13 20:41:20.245537 | controller | --type=''json'' -p=''[{' 2025-10-13 20:41:20.245543 | controller | - ' "op": "remove",' 2025-10-13 20:41:20.245549 | controller | - ' "path": "/spec/ovn/template/ovnController/nicMappings",' 2025-10-13 20:41:20.245557 | controller | - ' }]''' 2025-10-13 20:41:20.245563 | controller | - ' ]' 2025-10-13 20:41:20.245569 | controller | - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245574 | controller | | openstackcontrolplane.core.openstack.org/openstack patched' 2025-10-13 20:41:20.245580 | controller | - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245586 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.245591 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245597 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.245603 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245609 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.245614 | controller | 0 ]; then' 2025-10-13 20:41:20.245620 | controller | - ' exit 0' 2025-10-13 20:41:20.245626 | controller | - ' fi' 2025-10-13 20:41:20.245631 | controller | - ' exit 1' 2025-10-13 20:41:20.245637 | controller | - ' ]' 2025-10-13 20:41:20.245643 | controller | - ' logger.go:42: 19:50:16 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245649 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.245655 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245660 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.245668 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245674 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.245680 | controller | 0 ]; then' 2025-10-13 20:41:20.245688 | controller | - ' exit 0' 2025-10-13 20:41:20.245693 | controller | - ' fi' 2025-10-13 20:41:20.245699 | controller | - ' exit 1' 2025-10-13 20:41:20.245705 | controller | - ' ]' 2025-10-13 20:41:20.245711 | controller | - ' logger.go:42: 19:50:17 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245719 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.245732 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245741 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.245748 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245756 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.245767 | controller | 0 ]; then' 2025-10-13 20:41:20.245773 | controller | - ' exit 0' 2025-10-13 20:41:20.245779 | controller | - ' fi' 2025-10-13 20:41:20.245785 | controller | - ' exit 1' 2025-10-13 20:41:20.245790 | controller | - ' ]' 2025-10-13 20:41:20.245796 | controller | - ' logger.go:42: 19:50:18 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245802 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.245807 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245813 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.245819 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245825 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.245830 | controller | 0 ]; then' 2025-10-13 20:41:20.245836 | controller | - ' exit 0' 2025-10-13 20:41:20.245842 | controller | - ' fi' 2025-10-13 20:41:20.245847 | controller | - ' exit 1' 2025-10-13 20:41:20.245853 | controller | - ' ]' 2025-10-13 20:41:20.245859 | controller | - ' logger.go:42: 19:50:20 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245864 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.245870 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245876 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.245881 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245887 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.245893 | controller | 0 ]; then' 2025-10-13 20:41:20.245898 | controller | - ' exit 0' 2025-10-13 20:41:20.245904 | controller | - ' fi' 2025-10-13 20:41:20.245910 | controller | - ' exit 1' 2025-10-13 20:41:20.245916 | controller | - ' ]' 2025-10-13 20:41:20.245921 | controller | - ' logger.go:42: 19:50:21 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245927 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.245933 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245938 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.245944 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.245950 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.245955 | controller | 0 ]; then' 2025-10-13 20:41:20.245961 | controller | - ' exit 0' 2025-10-13 20:41:20.245967 | controller | - ' fi' 2025-10-13 20:41:20.245972 | controller | - ' exit 1' 2025-10-13 20:41:20.245978 | controller | - ' ]' 2025-10-13 20:41:20.245984 | controller | - ' logger.go:42: 19:50:22 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.245990 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.245995 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246001 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246007 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246012 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246018 | controller | 0 ]; then' 2025-10-13 20:41:20.246024 | controller | - ' exit 0' 2025-10-13 20:41:20.246029 | controller | - ' fi' 2025-10-13 20:41:20.246035 | controller | - ' exit 1' 2025-10-13 20:41:20.246041 | controller | - ' ]' 2025-10-13 20:41:20.246046 | controller | - ' logger.go:42: 19:50:24 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246055 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246061 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246067 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246072 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246078 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246084 | controller | 0 ]; then' 2025-10-13 20:41:20.246089 | controller | - ' exit 0' 2025-10-13 20:41:20.246095 | controller | - ' fi' 2025-10-13 20:41:20.246101 | controller | - ' exit 1' 2025-10-13 20:41:20.246106 | controller | - ' ]' 2025-10-13 20:41:20.246112 | controller | - ' logger.go:42: 19:50:25 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246118 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246123 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246129 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246135 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246140 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246146 | controller | 0 ]; then' 2025-10-13 20:41:20.246152 | controller | - ' exit 0' 2025-10-13 20:41:20.246157 | controller | - ' fi' 2025-10-13 20:41:20.246171 | controller | - ' exit 1' 2025-10-13 20:41:20.246178 | controller | - ' ]' 2025-10-13 20:41:20.246186 | controller | - ' logger.go:42: 19:50:27 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246194 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246201 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246207 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246216 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246238 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246244 | controller | 0 ]; then' 2025-10-13 20:41:20.246249 | controller | - ' exit 0' 2025-10-13 20:41:20.246255 | controller | - ' fi' 2025-10-13 20:41:20.246261 | controller | - ' exit 1' 2025-10-13 20:41:20.246266 | controller | - ' ]' 2025-10-13 20:41:20.246272 | controller | - ' logger.go:42: 19:50:28 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246278 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246284 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246289 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246295 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246301 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246306 | controller | 0 ]; then' 2025-10-13 20:41:20.246312 | controller | - ' exit 0' 2025-10-13 20:41:20.246318 | controller | - ' fi' 2025-10-13 20:41:20.246324 | controller | - ' exit 1' 2025-10-13 20:41:20.246329 | controller | - ' ]' 2025-10-13 20:41:20.246335 | controller | - ' logger.go:42: 19:50:29 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246341 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246346 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246352 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246361 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246367 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246373 | controller | 0 ]; then' 2025-10-13 20:41:20.246378 | controller | - ' exit 0' 2025-10-13 20:41:20.246384 | controller | - ' fi' 2025-10-13 20:41:20.246390 | controller | - ' exit 1' 2025-10-13 20:41:20.246396 | controller | - ' ]' 2025-10-13 20:41:20.246414 | controller | - ' logger.go:42: 19:50:31 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246423 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246428 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246434 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246440 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246446 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246451 | controller | 0 ]; then' 2025-10-13 20:41:20.246457 | controller | - ' exit 0' 2025-10-13 20:41:20.246463 | controller | - ' fi' 2025-10-13 20:41:20.246468 | controller | - ' exit 1' 2025-10-13 20:41:20.246474 | controller | - ' ]' 2025-10-13 20:41:20.246480 | controller | - ' logger.go:42: 19:50:32 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246486 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246491 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246497 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246503 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246508 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246514 | controller | 0 ]; then' 2025-10-13 20:41:20.246520 | controller | - ' exit 0' 2025-10-13 20:41:20.246526 | controller | - ' fi' 2025-10-13 20:41:20.246531 | controller | - ' exit 1' 2025-10-13 20:41:20.246542 | controller | - ' ]' 2025-10-13 20:41:20.246548 | controller | - ' logger.go:42: 19:50:33 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246554 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246560 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246565 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246571 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246577 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246582 | controller | 0 ]; then' 2025-10-13 20:41:20.246588 | controller | - ' exit 0' 2025-10-13 20:41:20.246594 | controller | - ' fi' 2025-10-13 20:41:20.246600 | controller | - ' exit 1' 2025-10-13 20:41:20.246605 | controller | - ' ]' 2025-10-13 20:41:20.246611 | controller | - ' logger.go:42: 19:50:35 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246617 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246623 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246636 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246644 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246652 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246660 | controller | 0 ]; then' 2025-10-13 20:41:20.246668 | controller | - ' exit 0' 2025-10-13 20:41:20.246679 | controller | - ' fi' 2025-10-13 20:41:20.246686 | controller | - ' exit 1' 2025-10-13 20:41:20.246692 | controller | - ' ]' 2025-10-13 20:41:20.246700 | controller | - ' logger.go:42: 19:50:36 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246706 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246711 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246717 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246723 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246728 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246734 | controller | 0 ]; then' 2025-10-13 20:41:20.246740 | controller | - ' exit 0' 2025-10-13 20:41:20.246745 | controller | - ' fi' 2025-10-13 20:41:20.246751 | controller | - ' exit 1' 2025-10-13 20:41:20.246757 | controller | - ' ]' 2025-10-13 20:41:20.246762 | controller | - ' logger.go:42: 19:50:37 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246768 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246774 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246783 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246788 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246794 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246800 | controller | 0 ]; then' 2025-10-13 20:41:20.246806 | controller | - ' exit 0' 2025-10-13 20:41:20.246811 | controller | - ' fi' 2025-10-13 20:41:20.246817 | controller | - ' exit 1' 2025-10-13 20:41:20.246823 | controller | - ' ]' 2025-10-13 20:41:20.246828 | controller | - ' logger.go:42: 19:50:39 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246834 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246840 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246846 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246851 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246857 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246863 | controller | 0 ]; then' 2025-10-13 20:41:20.246868 | controller | - ' exit 0' 2025-10-13 20:41:20.246874 | controller | - ' fi' 2025-10-13 20:41:20.246880 | controller | - ' exit 1' 2025-10-13 20:41:20.246885 | controller | - ' ]' 2025-10-13 20:41:20.246891 | controller | - ' logger.go:42: 19:50:40 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246897 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246903 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246908 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246914 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246920 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246925 | controller | 0 ]; then' 2025-10-13 20:41:20.246931 | controller | - ' exit 0' 2025-10-13 20:41:20.246937 | controller | - ' fi' 2025-10-13 20:41:20.246943 | controller | - ' exit 1' 2025-10-13 20:41:20.246948 | controller | - ' ]' 2025-10-13 20:41:20.246954 | controller | - ' logger.go:42: 19:50:41 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.246960 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.246968 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246974 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.246979 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.246985 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.246991 | controller | 0 ]; then' 2025-10-13 20:41:20.246997 | controller | - ' exit 0' 2025-10-13 20:41:20.247002 | controller | - ' fi' 2025-10-13 20:41:20.247008 | controller | - ' exit 1' 2025-10-13 20:41:20.247014 | controller | - ' ]' 2025-10-13 20:41:20.247019 | controller | - ' logger.go:42: 19:50:43 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.247025 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.247031 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247036 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.247042 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247048 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.247053 | controller | 0 ]; then' 2025-10-13 20:41:20.247059 | controller | - ' exit 0' 2025-10-13 20:41:20.247065 | controller | - ' fi' 2025-10-13 20:41:20.247071 | controller | - ' exit 1' 2025-10-13 20:41:20.247076 | controller | - ' ]' 2025-10-13 20:41:20.247082 | controller | - ' logger.go:42: 19:50:44 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.247096 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.247103 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247111 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.247119 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247126 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.247133 | controller | 0 ]; then' 2025-10-13 20:41:20.247139 | controller | - ' exit 0' 2025-10-13 20:41:20.247144 | controller | - ' fi' 2025-10-13 20:41:20.247150 | controller | - ' exit 1' 2025-10-13 20:41:20.247156 | controller | - ' ]' 2025-10-13 20:41:20.247161 | controller | - ' logger.go:42: 19:50:45 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.247167 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.247173 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247179 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.247184 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247190 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.247196 | controller | 0 ]; then' 2025-10-13 20:41:20.247201 | controller | - ' exit 0' 2025-10-13 20:41:20.247207 | controller | - ' fi' 2025-10-13 20:41:20.247213 | controller | - ' exit 1' 2025-10-13 20:41:20.247218 | controller | - ' ]' 2025-10-13 20:41:20.247224 | controller | - ' logger.go:42: 19:50:47 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.247230 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.247235 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247241 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.247247 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247255 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.247261 | controller | 0 ]; then' 2025-10-13 20:41:20.247267 | controller | - ' exit 0' 2025-10-13 20:41:20.247272 | controller | - ' fi' 2025-10-13 20:41:20.247278 | controller | - ' exit 1' 2025-10-13 20:41:20.247284 | controller | - ' ]' 2025-10-13 20:41:20.247289 | controller | - ' logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.247295 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.247304 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247309 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.247315 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.247321 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.247326 | controller | 0 ]; then' 2025-10-13 20:41:20.247332 | controller | - ' exit 0' 2025-10-13 20:41:20.247338 | controller | - ' fi' 2025-10-13 20:41:20.247343 | controller | - ' exit 1' 2025-10-13 20:41:20.247349 | controller | - ' ]' 2025-10-13 20:41:20.247355 | controller | - ' logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.247360 | controller | | test step completed 4-remove-ovn-nic-mappings' 2025-10-13 20:41:20.247366 | controller | - ' logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247372 | controller | | starting test step 5-cleanup' 2025-10-13 20:41:20.247378 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247383 | controller | | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' 2025-10-13 20:41:20.247389 | controller | - ' srv-swift-storage-0' 2025-10-13 20:41:20.247397 | controller | - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' 2025-10-13 20:41:20.247418 | controller | - ' oc delete secret -l service-cert -n $NAMESPACE' 2025-10-13 20:41:20.247424 | controller | - ' oc delete secret -l ca-cert -n $NAMESPACE' 2025-10-13 20:41:20.247430 | controller | - ' ]' 2025-10-13 20:41:20.247436 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247441 | controller | | secret "combined-ca-bundle" deleted' 2025-10-13 20:41:20.247447 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247453 | controller | | secret "cert-barbican-internal-svc" deleted' 2025-10-13 20:41:20.247459 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247464 | controller | | secret "cert-barbican-public-route" deleted' 2025-10-13 20:41:20.247470 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247476 | controller | | secret "cert-barbican-public-svc" deleted' 2025-10-13 20:41:20.247481 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247487 | controller | | secret "cert-ceilometer-internal-svc" deleted' 2025-10-13 20:41:20.247493 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247498 | controller | | secret "cert-cinder-internal-svc" deleted' 2025-10-13 20:41:20.247504 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247510 | controller | | secret "cert-cinder-public-route" deleted' 2025-10-13 20:41:20.247523 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247531 | controller | | secret "cert-cinder-public-svc" deleted' 2025-10-13 20:41:20.247538 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247553 | controller | | secret "cert-galera-openstack-cell1-svc" deleted' 2025-10-13 20:41:20.247560 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247565 | controller | | secret "cert-galera-openstack-svc" deleted' 2025-10-13 20:41:20.247571 | controller | - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247577 | controller | | secret "cert-glance-default-internal-svc" deleted' 2025-10-13 20:41:20.247583 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247588 | controller | | secret "cert-glance-default-public-route" deleted' 2025-10-13 20:41:20.247594 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247600 | controller | | secret "cert-glance-default-public-svc" deleted' 2025-10-13 20:41:20.247605 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247611 | controller | | secret "cert-keystone-internal-svc" deleted' 2025-10-13 20:41:20.247617 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247622 | controller | | secret "cert-keystone-public-route" deleted' 2025-10-13 20:41:20.247628 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247634 | controller | | secret "cert-keystone-public-svc" deleted' 2025-10-13 20:41:20.247639 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247645 | controller | | secret "cert-kube-state-metrics-svc" deleted' 2025-10-13 20:41:20.247651 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247656 | controller | | secret "cert-memcached-svc" deleted' 2025-10-13 20:41:20.247662 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247668 | controller | | secret "cert-neutron-internal-svc" deleted' 2025-10-13 20:41:20.247673 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247679 | controller | | secret "cert-neutron-ovndbs" deleted' 2025-10-13 20:41:20.247685 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247691 | controller | | secret "cert-neutron-public-route" deleted' 2025-10-13 20:41:20.247696 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247702 | controller | | secret "cert-neutron-public-svc" deleted' 2025-10-13 20:41:20.247708 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247713 | controller | | secret "cert-nova-internal-svc" deleted' 2025-10-13 20:41:20.247719 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247725 | controller | | secret "cert-nova-novncproxy-cell1-public-route" deleted' 2025-10-13 20:41:20.247733 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247739 | controller | | secret "cert-nova-novncproxy-cell1-public-svc" deleted' 2025-10-13 20:41:20.247746 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247753 | controller | | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' 2025-10-13 20:41:20.247760 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247766 | controller | | secret "cert-nova-public-route" deleted' 2025-10-13 20:41:20.247772 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247777 | controller | | secret "cert-nova-public-svc" deleted' 2025-10-13 20:41:20.247786 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247792 | controller | | secret "cert-ovn-metrics" deleted' 2025-10-13 20:41:20.247800 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247806 | controller | | secret "cert-ovncontroller-ovndbs" deleted' 2025-10-13 20:41:20.247812 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247818 | controller | | secret "cert-ovndbcluster-nb-ovndbs" deleted' 2025-10-13 20:41:20.247823 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247829 | controller | | secret "cert-ovndbcluster-sb-ovndbs" deleted' 2025-10-13 20:41:20.247835 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247840 | controller | | secret "cert-ovnnorthd-ovndbs" deleted' 2025-10-13 20:41:20.247846 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247852 | controller | | secret "cert-placement-internal-svc" deleted' 2025-10-13 20:41:20.247858 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247863 | controller | | secret "cert-placement-public-route" deleted' 2025-10-13 20:41:20.247869 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247883 | controller | | secret "cert-placement-public-svc" deleted' 2025-10-13 20:41:20.247891 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247899 | controller | | secret "cert-rabbitmq-cell1-svc" deleted' 2025-10-13 20:41:20.247907 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247914 | controller | | secret "cert-rabbitmq-svc" deleted' 2025-10-13 20:41:20.247920 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247926 | controller | | secret "cert-swift-internal-svc" deleted' 2025-10-13 20:41:20.247932 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247938 | controller | | secret "cert-swift-public-route" deleted' 2025-10-13 20:41:20.247944 | controller | - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247949 | controller | | secret "cert-swift-public-svc" deleted' 2025-10-13 20:41:20.247955 | controller | - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247961 | controller | | secret "rootca-internal" deleted' 2025-10-13 20:41:20.247966 | controller | - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247972 | controller | | secret "rootca-libvirt" deleted' 2025-10-13 20:41:20.247978 | controller | - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247983 | controller | | secret "rootca-ovn" deleted' 2025-10-13 20:41:20.247989 | controller | - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.247995 | controller | | secret "rootca-public" deleted' 2025-10-13 20:41:20.248000 | controller | - ' logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.248006 | controller | | test step completed 5-cleanup' 2025-10-13 20:41:20.248012 | controller | - ' logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings | skipping 2025-10-13 20:41:20.248018 | controller | kubernetes event logging' 2025-10-13 20:41:20.248023 | controller | - === NAME kuttl 2025-10-13 20:41:20.248032 | controller | - ' harness.go:406: run tests finished' 2025-10-13 20:41:20.248038 | controller | - ' harness.go:514: cleaning up' 2025-10-13 20:41:20.248044 | controller | - ' harness.go:571: removing temp folder: ""' 2025-10-13 20:41:20.248050 | controller | - '--- PASS: kuttl (689.89s)' 2025-10-13 20:41:20.248055 | controller | - ' --- PASS: kuttl/harness (0.00s)' 2025-10-13 20:41:20.248061 | controller | - ' --- PASS: kuttl/harness/ctlplane-basic-deployment (348.38s)' 2025-10-13 20:41:20.248069 | controller | - ' --- PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings (340.23s)' 2025-10-13 20:41:20.248078 | controller | - PASS 2025-10-13 20:41:20.248084 | controller | - No resources found 2025-10-13 20:41:20.248089 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.248095 | controller | - bash scripts/retry_make_crc_storage_cleanup.sh 3 2025-10-13 20:41:20.248101 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.248107 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.248112 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.248118 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.248124 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.248130 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.248135 | controller | - + cat 2025-10-13 20:41:20.248141 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.248147 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.248152 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.248158 | controller | do sleep 1; done" 2025-10-13 20:41:20.248164 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.248169 | controller | - crc-storage Active 2025-10-13 20:41:20.248175 | controller | - oc project crc-storage 2025-10-13 20:41:20.248181 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.248187 | controller | - bash scripts/cleanup-crc-pv.sh 2025-10-13 20:41:20.248192 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.248198 | controller | - ++ awk '{print $6}' 2025-10-13 20:41:20.248204 | controller | - ++ grep Bound 2025-10-13 20:41:20.248209 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.248215 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.248221 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.248226 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.248232 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.248238 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.248243 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.248249 | controller | - + NAME=swift-swift-storage-0 2025-10-13 20:41:20.248255 | controller | - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found 2025-10-13 20:41:20.248261 | controller | - persistentvolumeclaim "swift-swift-storage-0" deleted 2025-10-13 20:41:20.248266 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.248272 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.248278 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.248283 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.248289 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.248295 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.248300 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.248308 | controller | - + NAME=glance-glance-default-internal-api-0 2025-10-13 20:41:20.248314 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found 2025-10-13 20:41:20.248332 | controller | - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted 2025-10-13 20:41:20.248340 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.248348 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.248356 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.248364 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.248369 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.248375 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.248381 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.248390 | controller | - + NAME=mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.248399 | controller | - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found 2025-10-13 20:41:20.248420 | controller | - persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted 2025-10-13 20:41:20.248426 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.248432 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.248438 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.248443 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.248449 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.248455 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.248461 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.248466 | controller | - + NAME=glance-glance-default-external-api-0 2025-10-13 20:41:20.248475 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found 2025-10-13 20:41:20.248481 | controller | - persistentvolumeclaim "glance-glance-default-external-api-0" deleted 2025-10-13 20:41:20.248486 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.248492 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.248498 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.248504 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.248509 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.248515 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.248521 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.248526 | controller | - + NAME=mysql-db-openstack-galera-0 2025-10-13 20:41:20.248532 | controller | - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found 2025-10-13 20:41:20.248538 | controller | - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted 2025-10-13 20:41:20.248544 | controller | - ++ awk '{print $1}' 2025-10-13 20:41:20.248549 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.248555 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248561 | controller | '{print $1}'` 2025-10-13 20:41:20.248566 | controller | - + oc delete pv/local-storage01-crc 2025-10-13 20:41:20.248572 | controller | - persistentvolume "local-storage01-crc" deleted 2025-10-13 20:41:20.248578 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248583 | controller | '{print $1}'` 2025-10-13 20:41:20.248589 | controller | - + oc delete pv/local-storage02-crc 2025-10-13 20:41:20.248595 | controller | - persistentvolume "local-storage02-crc" deleted 2025-10-13 20:41:20.248600 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248606 | controller | '{print $1}'` 2025-10-13 20:41:20.248612 | controller | - + oc delete pv/local-storage03-crc 2025-10-13 20:41:20.248617 | controller | - persistentvolume "local-storage03-crc" deleted 2025-10-13 20:41:20.248623 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248629 | controller | '{print $1}'` 2025-10-13 20:41:20.248634 | controller | - + oc delete pv/local-storage04-crc 2025-10-13 20:41:20.248640 | controller | - persistentvolume "local-storage04-crc" deleted 2025-10-13 20:41:20.248646 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248651 | controller | '{print $1}'` 2025-10-13 20:41:20.248657 | controller | - + oc delete pv/local-storage05-crc 2025-10-13 20:41:20.248663 | controller | - persistentvolume "local-storage05-crc" deleted 2025-10-13 20:41:20.248669 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248674 | controller | '{print $1}'` 2025-10-13 20:41:20.248680 | controller | - + oc delete pv/local-storage06-crc 2025-10-13 20:41:20.248686 | controller | - persistentvolume "local-storage06-crc" deleted 2025-10-13 20:41:20.248691 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248700 | controller | '{print $1}'` 2025-10-13 20:41:20.248705 | controller | - + oc delete pv/local-storage07-crc 2025-10-13 20:41:20.248711 | controller | - persistentvolume "local-storage07-crc" deleted 2025-10-13 20:41:20.248717 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248722 | controller | '{print $1}'` 2025-10-13 20:41:20.248728 | controller | - + oc delete pv/local-storage08-crc 2025-10-13 20:41:20.248734 | controller | - persistentvolume "local-storage08-crc" deleted 2025-10-13 20:41:20.248740 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248745 | controller | '{print $1}'` 2025-10-13 20:41:20.248751 | controller | - + oc delete pv/local-storage09-crc 2025-10-13 20:41:20.248757 | controller | - persistentvolume "local-storage09-crc" deleted 2025-10-13 20:41:20.248762 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248768 | controller | '{print $1}'` 2025-10-13 20:41:20.248776 | controller | - + oc delete pv/local-storage10-crc 2025-10-13 20:41:20.248782 | controller | - persistentvolume "local-storage10-crc" deleted 2025-10-13 20:41:20.248788 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248793 | controller | '{print $1}'` 2025-10-13 20:41:20.248799 | controller | - + oc delete pv/local-storage11-crc 2025-10-13 20:41:20.248805 | controller | - persistentvolume "local-storage11-crc" deleted 2025-10-13 20:41:20.248818 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248826 | controller | '{print $1}'` 2025-10-13 20:41:20.248834 | controller | - + oc delete pv/local-storage12-crc 2025-10-13 20:41:20.248841 | controller | - persistentvolume "local-storage12-crc" deleted 2025-10-13 20:41:20.248849 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248856 | controller | '{print $1}'` 2025-10-13 20:41:20.248861 | controller | - + oc delete pv/local-storage13-crc 2025-10-13 20:41:20.248867 | controller | - persistentvolume "local-storage13-crc" deleted 2025-10-13 20:41:20.248873 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248878 | controller | '{print $1}'` 2025-10-13 20:41:20.248884 | controller | - + oc delete pv/local-storage14-crc 2025-10-13 20:41:20.248890 | controller | - persistentvolume "local-storage14-crc" deleted 2025-10-13 20:41:20.248895 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248902 | controller | '{print $1}'` 2025-10-13 20:41:20.248907 | controller | - + oc delete pv/local-storage15-crc 2025-10-13 20:41:20.248913 | controller | - persistentvolume "local-storage15-crc" deleted 2025-10-13 20:41:20.248919 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248924 | controller | '{print $1}'` 2025-10-13 20:41:20.248930 | controller | - + oc delete pv/local-storage16-crc 2025-10-13 20:41:20.248936 | controller | - persistentvolume "local-storage16-crc" deleted 2025-10-13 20:41:20.248941 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248947 | controller | '{print $1}'` 2025-10-13 20:41:20.248953 | controller | - + oc delete pv/local-storage17-crc 2025-10-13 20:41:20.248958 | controller | - persistentvolume "local-storage17-crc" deleted 2025-10-13 20:41:20.248964 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248970 | controller | '{print $1}'` 2025-10-13 20:41:20.248975 | controller | - + oc delete pv/local-storage18-crc 2025-10-13 20:41:20.248981 | controller | - persistentvolume "local-storage18-crc" deleted 2025-10-13 20:41:20.248987 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.248992 | controller | '{print $1}'` 2025-10-13 20:41:20.248998 | controller | - + oc delete pv/local-storage19-crc 2025-10-13 20:41:20.249004 | controller | - persistentvolume "local-storage19-crc" deleted 2025-10-13 20:41:20.249010 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.249026 | controller | '{print $1}'` 2025-10-13 20:41:20.249032 | controller | - + oc delete pv/local-storage20-crc 2025-10-13 20:41:20.249041 | controller | - persistentvolume "local-storage20-crc" deleted 2025-10-13 20:41:20.249047 | controller | - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi 2025-10-13 20:41:20.249053 | controller | - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE 2025-10-13 20:41:20.249058 | controller | - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 11m 2025-10-13 20:41:20.249064 | controller | - storageclass.storage.k8s.io "local-storage" deleted 2025-10-13 20:41:20.249070 | controller | - bash scripts/delete-pv.sh 2025-10-13 20:41:20.249076 | controller | - +++ dirname scripts/delete-pv.sh 2025-10-13 20:41:20.249081 | controller | - ++ cd scripts 2025-10-13 20:41:20.249087 | controller | - ++ pwd -P 2025-10-13 20:41:20.249093 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.249099 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.249104 | controller | - ++ set -ex 2025-10-13 20:41:20.249110 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.249116 | controller | - ++ cat 2025-10-13 20:41:20.249122 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249127 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.249133 | controller | - ++ cat 2025-10-13 20:41:20.249139 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249144 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.249150 | controller | - ++ cat 2025-10-13 20:41:20.249156 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249161 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.249167 | controller | - ++ cat 2025-10-13 20:41:20.249173 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249178 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.249184 | controller | - + PV_NUM=20 2025-10-13 20:41:20.249190 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.249195 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.249201 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.249207 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.249212 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.249218 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.249224 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.249229 | controller | crc delete 2025-10-13 20:41:20.249235 | controller | - ++ set -ex 2025-10-13 20:41:20.249241 | controller | - ++ NODE=crc 2025-10-13 20:41:20.249246 | controller | - ++ OPERATION=delete 2025-10-13 20:41:20.249252 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.249258 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.249264 | controller | - ++ cat 2025-10-13 20:41:20.249269 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249275 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.249281 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.249286 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.249292 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.249298 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.249303 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.249309 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.249315 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.249327 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.249339 | controller | --timeout 500s 2025-10-13 20:41:20.249346 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.249354 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.249361 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.249367 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.249373 | controller | - bash scripts/retry_make_crc_storage.sh 3 2025-10-13 20:41:20.249378 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.249384 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.249390 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.249398 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.249418 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.249424 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.249430 | controller | - + cat 2025-10-13 20:41:20.249438 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.249444 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.249450 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.249456 | controller | do sleep 1; done" 2025-10-13 20:41:20.249461 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.249467 | controller | - crc-storage Active 2025-10-13 20:41:20.249473 | controller | - oc project crc-storage 2025-10-13 20:41:20.249479 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.249484 | controller | - bash scripts/create-pv.sh 2025-10-13 20:41:20.249490 | controller | - +++ dirname scripts/create-pv.sh 2025-10-13 20:41:20.249496 | controller | - ++ cd scripts 2025-10-13 20:41:20.249501 | controller | - ++ pwd -P 2025-10-13 20:41:20.249507 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.249513 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.249518 | controller | - ++ set -ex 2025-10-13 20:41:20.249524 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.249530 | controller | - ++ cat 2025-10-13 20:41:20.249535 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249543 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.249549 | controller | - ++ cat 2025-10-13 20:41:20.249555 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249561 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.249566 | controller | - ++ cat 2025-10-13 20:41:20.249572 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249578 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.249584 | controller | - ++ cat 2025-10-13 20:41:20.249589 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249595 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.249601 | controller | - + PV_NUM=20 2025-10-13 20:41:20.249606 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.249612 | controller | - ++ oc get pv -o json 2025-10-13 20:41:20.249618 | controller | - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' 2025-10-13 20:41:20.249623 | controller | - + released= 2025-10-13 20:41:20.249629 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.249635 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.249640 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.249646 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.249652 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.249657 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.249663 | controller | crc create 2025-10-13 20:41:20.249669 | controller | - ++ set -ex 2025-10-13 20:41:20.249677 | controller | - ++ NODE=crc 2025-10-13 20:41:20.249683 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.249689 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.249694 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.249700 | controller | - ++ cat 2025-10-13 20:41:20.249706 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.249711 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.249717 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.249723 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.249728 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.249734 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.249740 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.249745 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.249751 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.249757 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.249762 | controller | --timeout 500s 2025-10-13 20:41:20.249768 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.249774 | controller | - bash scripts/gen-crc-pv-kustomize.sh 2025-10-13 20:41:20.249779 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.249785 | controller | - + '[' -z '"local-storage"' ']' 2025-10-13 20:41:20.249791 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' 2025-10-13 20:41:20.249796 | controller | - + PV_NUM=20 2025-10-13 20:41:20.249802 | controller | - + STORAGE_CAPACITY=10 2025-10-13 20:41:20.249808 | controller | - ++ oc get node -o name -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.249813 | controller | - ++ head -c-1 2025-10-13 20:41:20.249819 | controller | - ++ tr '\n' ' ' 2025-10-13 20:41:20.249825 | controller | - ++ sed -e 's|node/||' 2025-10-13 20:41:20.249831 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.249836 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.249842 | controller | - + cat 2025-10-13 20:41:20.249847 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.249853 | controller | - ++ seq -w 20 2025-10-13 20:41:20.249866 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.249874 | controller | - + cat 2025-10-13 20:41:20.249882 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.249890 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.249897 | controller | - + cat 2025-10-13 20:41:20.249904 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.249910 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.249915 | controller | - + cat 2025-10-13 20:41:20.249921 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.249927 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.249932 | controller | - + cat 2025-10-13 20:41:20.249938 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.249944 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.249950 | controller | - + cat 2025-10-13 20:41:20.249955 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.249961 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.249967 | controller | - + cat 2025-10-13 20:41:20.249972 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.249978 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.249984 | controller | - + cat 2025-10-13 20:41:20.249989 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.249995 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250001 | controller | - + cat 2025-10-13 20:41:20.250006 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250012 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250018 | controller | - + cat 2025-10-13 20:41:20.250023 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250029 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250034 | controller | - + cat 2025-10-13 20:41:20.250043 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250049 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250055 | controller | - + cat 2025-10-13 20:41:20.250060 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250066 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250072 | controller | - + cat 2025-10-13 20:41:20.250077 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250086 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250092 | controller | - + cat 2025-10-13 20:41:20.250098 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250103 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250109 | controller | - + cat 2025-10-13 20:41:20.250115 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250120 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250126 | controller | - + cat 2025-10-13 20:41:20.250132 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250137 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250143 | controller | - + cat 2025-10-13 20:41:20.250148 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250154 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250160 | controller | - + cat 2025-10-13 20:41:20.250165 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250171 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250177 | controller | - + cat 2025-10-13 20:41:20.250182 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250188 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250194 | controller | - + cat 2025-10-13 20:41:20.250199 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250205 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.250211 | controller | - + cat 2025-10-13 20:41:20.250216 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.250222 | controller | - + cat 2025-10-13 20:41:20.250228 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:41:20.250233 | controller | - storageclass.storage.k8s.io/local-storage created 2025-10-13 20:41:20.250239 | controller | - persistentvolume/local-storage01-crc created 2025-10-13 20:41:20.250248 | controller | - persistentvolume/local-storage02-crc created 2025-10-13 20:41:20.250268 | controller | - persistentvolume/local-storage03-crc created 2025-10-13 20:41:20.250275 | controller | - persistentvolume/local-storage04-crc created 2025-10-13 20:41:20.250280 | controller | - persistentvolume/local-storage05-crc created 2025-10-13 20:41:20.250286 | controller | - persistentvolume/local-storage06-crc created 2025-10-13 20:41:20.250292 | controller | - persistentvolume/local-storage07-crc created 2025-10-13 20:41:20.250297 | controller | - persistentvolume/local-storage08-crc created 2025-10-13 20:41:20.250303 | controller | - persistentvolume/local-storage09-crc created 2025-10-13 20:41:20.250309 | controller | - persistentvolume/local-storage10-crc created 2025-10-13 20:41:20.250314 | controller | - persistentvolume/local-storage11-crc created 2025-10-13 20:41:20.250320 | controller | - persistentvolume/local-storage12-crc created 2025-10-13 20:41:20.250326 | controller | - persistentvolume/local-storage13-crc created 2025-10-13 20:41:20.250331 | controller | - persistentvolume/local-storage14-crc created 2025-10-13 20:41:20.250337 | controller | - persistentvolume/local-storage15-crc created 2025-10-13 20:41:20.250343 | controller | - persistentvolume/local-storage16-crc created 2025-10-13 20:41:20.250348 | controller | - persistentvolume/local-storage17-crc created 2025-10-13 20:41:20.250354 | controller | - persistentvolume/local-storage18-crc created 2025-10-13 20:41:20.250360 | controller | - persistentvolume/local-storage19-crc created 2025-10-13 20:41:20.250365 | controller | - persistentvolume/local-storage20-crc created 2025-10-13 20:41:20.250371 | controller | - persistentvolumeclaim/ansible-ee-logs unchanged 2025-10-13 20:41:20.250377 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.250382 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.250388 | controller | - '2025/10/13 19:51:44 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.250397 | controller | ]' 2025-10-13 20:41:20.250416 | controller | - === RUN kuttl 2025-10-13 20:41:20.250424 | controller | - ' harness.go:463: starting setup' 2025-10-13 20:41:20.250430 | controller | - ' harness.go:255: running tests using configured kubeconfig.' 2025-10-13 20:41:20.250436 | controller | - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' 2025-10-13 20:41:20.250442 | controller | - ' logger.go:42: 19:51:44 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.250447 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' 2025-10-13 20:41:20.250453 | controller | - ' logger.go:42: 19:51:44 | | netconfig.network.openstack.org/netconfig configured' 2025-10-13 20:41:20.250459 | controller | - ' logger.go:42: 19:51:44 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.250465 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' 2025-10-13 20:41:20.250478 | controller | - ' logger.go:42: 19:51:45 | | dnsmasq.network.openstack.org/dnsmasq configured' 2025-10-13 20:41:20.250486 | controller | - ' logger.go:42: 19:51:45 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.250494 | controller | ]; then' 2025-10-13 20:41:20.250502 | controller | - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' 2025-10-13 20:41:20.250509 | controller | - ' fi' 2025-10-13 20:41:20.250516 | controller | - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' 2025-10-13 20:41:20.250522 | controller | - ' --save-config \' 2025-10-13 20:41:20.250527 | controller | - ' --dry-run=client \' 2025-10-13 20:41:20.250533 | controller | - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.250539 | controller | - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' 2025-10-13 20:41:20.250545 | controller | - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.250550 | controller | - ' -n openstack-kuttl-tests \' 2025-10-13 20:41:20.250556 | controller | - ' -o yaml | \' 2025-10-13 20:41:20.250562 | controller | - ' oc apply -f -' 2025-10-13 20:41:20.250567 | controller | - ' ]' 2025-10-13 20:41:20.250573 | controller | - ' logger.go:42: 19:51:45 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.250579 | controller | configured' 2025-10-13 20:41:20.250584 | controller | - ' harness.go:363: running tests' 2025-10-13 20:41:20.250590 | controller | - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each 2025-10-13 20:41:20.250596 | controller | step' 2025-10-13 20:41:20.250602 | controller | - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.250607 | controller | has 19 tests' 2025-10-13 20:41:20.250613 | controller | - === RUN kuttl/harness 2025-10-13 20:41:20.250619 | controller | - === RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.250624 | controller | - === PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.250630 | controller | - === CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings 2025-10-13 20:41:20.250636 | controller | - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings | Skipping 2025-10-13 20:41:20.250641 | controller | creation of user-supplied namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.250647 | controller | - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.250653 | controller | | starting test step 1-create-nic-mappings' 2025-10-13 20:41:20.250659 | controller | - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.250664 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml' 2025-10-13 20:41:20.250670 | controller | - ' ]' 2025-10-13 20:41:20.250676 | controller | - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.250686 | controller | | networkattachmentdefinition.k8s.cni.cncf.io/datacentre unchanged' 2025-10-13 20:41:20.250692 | controller | - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings 2025-10-13 20:41:20.250697 | controller | | test step completed 1-create-nic-mappings' 2025-10-13 20:41:20.250703 | controller | - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.250709 | controller | | starting test step 2-deploy-openstack' 2025-10-13 20:41:20.250720 | controller | - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.250726 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.250731 | controller | | oc apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.250737 | controller | - ' ]' 2025-10-13 20:41:20.250743 | controller | - ' logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.250748 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.250754 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.250760 | controller | - ' logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.250765 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.250771 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.250777 | controller | - ' logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.250783 | controller | | openstackcontrolplane.core.openstack.org/openstack created' 2025-10-13 20:41:20.250788 | controller | - ' logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack 2025-10-13 20:41:20.250794 | controller | | test step completed 2-deploy-openstack' 2025-10-13 20:41:20.250800 | controller | - ' logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.250805 | controller | | starting test step 3-add-ovn-nic-mappings' 2025-10-13 20:41:20.250811 | controller | - ' logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.250817 | controller | | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack 2025-10-13 20:41:20.250822 | controller | --type=''json'' -p=''[{' 2025-10-13 20:41:20.250830 | controller | - ' "op": "replace",' 2025-10-13 20:41:20.250836 | controller | - ' "path": "/spec/ovn/template/ovnController/nicMappings",' 2025-10-13 20:41:20.250842 | controller | - ' "value":{"datacentre":"ospbr"}' 2025-10-13 20:41:20.250847 | controller | - ' }]''' 2025-10-13 20:41:20.250853 | controller | - ' ]' 2025-10-13 20:41:20.250866 | controller | - ' logger.go:42: 19:55:58 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.250874 | controller | | openstackcontrolplane.core.openstack.org/openstack patched' 2025-10-13 20:41:20.250882 | controller | - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings 2025-10-13 20:41:20.250890 | controller | | test step completed 3-add-ovn-nic-mappings' 2025-10-13 20:41:20.250897 | controller | - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.250904 | controller | | starting test step 4-remove-ovn-nic-mappings' 2025-10-13 20:41:20.250910 | controller | - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.250915 | controller | | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack 2025-10-13 20:41:20.250921 | controller | --type=''json'' -p=''[{' 2025-10-13 20:41:20.250927 | controller | - ' "op": "remove",' 2025-10-13 20:41:20.250932 | controller | - ' "path": "/spec/ovn/template/ovnController/nicMappings",' 2025-10-13 20:41:20.250938 | controller | - ' }]''' 2025-10-13 20:41:20.250947 | controller | - ' ]' 2025-10-13 20:41:20.250953 | controller | - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.250958 | controller | | openstackcontrolplane.core.openstack.org/openstack patched' 2025-10-13 20:41:20.250964 | controller | - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.250970 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.250975 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.250981 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.250987 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.250992 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.250998 | controller | 0 ]; then' 2025-10-13 20:41:20.251004 | controller | - ' exit 0' 2025-10-13 20:41:20.251009 | controller | - ' fi' 2025-10-13 20:41:20.251015 | controller | - ' exit 1' 2025-10-13 20:41:20.251020 | controller | - ' ]' 2025-10-13 20:41:20.251026 | controller | - ' logger.go:42: 19:56:04 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.251032 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.251037 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.251046 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.251052 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.251057 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.251063 | controller | 0 ]; then' 2025-10-13 20:41:20.251069 | controller | - ' exit 0' 2025-10-13 20:41:20.251074 | controller | - ' fi' 2025-10-13 20:41:20.251080 | controller | - ' exit 1' 2025-10-13 20:41:20.251086 | controller | - ' ]' 2025-10-13 20:41:20.251091 | controller | - ' logger.go:42: 19:56:06 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.251097 | controller | | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l 2025-10-13 20:41:20.251103 | controller | service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.251108 | controller | - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller 2025-10-13 20:41:20.251114 | controller | --no-headers=true --ignore-not-found=true | wc -l)' 2025-10-13 20:41:20.251120 | controller | - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 2025-10-13 20:41:20.251125 | controller | 0 ]; then' 2025-10-13 20:41:20.251131 | controller | - ' exit 0' 2025-10-13 20:41:20.251137 | controller | - ' fi' 2025-10-13 20:41:20.251142 | controller | - ' exit 1' 2025-10-13 20:41:20.251148 | controller | - ' ]' 2025-10-13 20:41:20.251154 | controller | - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.251159 | controller | | Unable to connect to the server: dial tcp: lookup api.crc.testing on 199.204.44.24:53: 2025-10-13 20:41:20.251165 | controller | no such host' 2025-10-13 20:41:20.251171 | controller | - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings 2025-10-13 20:41:20.251176 | controller | | test step completed 4-remove-ovn-nic-mappings' 2025-10-13 20:41:20.251182 | controller | - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251188 | controller | | starting test step 5-cleanup' 2025-10-13 20:41:20.251193 | controller | - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251199 | controller | | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' 2025-10-13 20:41:20.251205 | controller | - ' srv-swift-storage-0' 2025-10-13 20:41:20.251213 | controller | - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' 2025-10-13 20:41:20.251219 | controller | - ' oc delete secret -l service-cert -n $NAMESPACE' 2025-10-13 20:41:20.251224 | controller | - ' oc delete secret -l ca-cert -n $NAMESPACE' 2025-10-13 20:41:20.251230 | controller | - ' ]' 2025-10-13 20:41:20.251236 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251241 | controller | | secret "combined-ca-bundle" deleted' 2025-10-13 20:41:20.251247 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251253 | controller | | secret "cert-barbican-internal-svc" deleted' 2025-10-13 20:41:20.251265 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251274 | controller | | secret "cert-barbican-public-route" deleted' 2025-10-13 20:41:20.251281 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251289 | controller | | secret "cert-barbican-public-svc" deleted' 2025-10-13 20:41:20.251296 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251303 | controller | | secret "cert-ceilometer-internal-svc" deleted' 2025-10-13 20:41:20.251308 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251314 | controller | | secret "cert-cinder-internal-svc" deleted' 2025-10-13 20:41:20.251319 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251325 | controller | | secret "cert-cinder-public-route" deleted' 2025-10-13 20:41:20.251331 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251336 | controller | | secret "cert-cinder-public-svc" deleted' 2025-10-13 20:41:20.251342 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251348 | controller | | secret "cert-galera-openstack-cell1-svc" deleted' 2025-10-13 20:41:20.251353 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251359 | controller | | secret "cert-galera-openstack-svc" deleted' 2025-10-13 20:41:20.251365 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251370 | controller | | secret "cert-glance-default-internal-svc" deleted' 2025-10-13 20:41:20.251376 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251382 | controller | | secret "cert-glance-default-public-route" deleted' 2025-10-13 20:41:20.251387 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251396 | controller | | secret "cert-glance-default-public-svc" deleted' 2025-10-13 20:41:20.251416 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251425 | controller | | secret "cert-keystone-internal-svc" deleted' 2025-10-13 20:41:20.251430 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251436 | controller | | secret "cert-keystone-public-route" deleted' 2025-10-13 20:41:20.251442 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251447 | controller | | secret "cert-keystone-public-svc" deleted' 2025-10-13 20:41:20.251453 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251459 | controller | | secret "cert-kube-state-metrics-svc" deleted' 2025-10-13 20:41:20.251464 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251470 | controller | | secret "cert-memcached-svc" deleted' 2025-10-13 20:41:20.251476 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251482 | controller | | secret "cert-neutron-internal-svc" deleted' 2025-10-13 20:41:20.251490 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251496 | controller | | secret "cert-neutron-ovndbs" deleted' 2025-10-13 20:41:20.251507 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251513 | controller | | secret "cert-neutron-public-route" deleted' 2025-10-13 20:41:20.251519 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251524 | controller | | secret "cert-neutron-public-svc" deleted' 2025-10-13 20:41:20.251530 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251536 | controller | | secret "cert-nova-internal-svc" deleted' 2025-10-13 20:41:20.251541 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251547 | controller | | secret "cert-nova-novncproxy-cell1-public-route" deleted' 2025-10-13 20:41:20.251553 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251558 | controller | | secret "cert-nova-novncproxy-cell1-public-svc" deleted' 2025-10-13 20:41:20.251564 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251570 | controller | | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' 2025-10-13 20:41:20.251575 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251581 | controller | | secret "cert-nova-public-route" deleted' 2025-10-13 20:41:20.251587 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251592 | controller | | secret "cert-nova-public-svc" deleted' 2025-10-13 20:41:20.251598 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251604 | controller | | secret "cert-ovn-metrics" deleted' 2025-10-13 20:41:20.251609 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251615 | controller | | secret "cert-ovncontroller-ovndbs" deleted' 2025-10-13 20:41:20.251621 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251626 | controller | | secret "cert-ovndbcluster-nb-ovndbs" deleted' 2025-10-13 20:41:20.251640 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251648 | controller | | secret "cert-ovndbcluster-sb-ovndbs" deleted' 2025-10-13 20:41:20.251656 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251664 | controller | | secret "cert-ovnnorthd-ovndbs" deleted' 2025-10-13 20:41:20.251671 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251678 | controller | | secret "cert-placement-internal-svc" deleted' 2025-10-13 20:41:20.251683 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251689 | controller | | secret "cert-placement-public-route" deleted' 2025-10-13 20:41:20.251695 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251700 | controller | | secret "cert-placement-public-svc" deleted' 2025-10-13 20:41:20.251706 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251712 | controller | | secret "cert-rabbitmq-cell1-svc" deleted' 2025-10-13 20:41:20.251717 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251723 | controller | | secret "cert-rabbitmq-svc" deleted' 2025-10-13 20:41:20.251729 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251734 | controller | | secret "cert-swift-internal-svc" deleted' 2025-10-13 20:41:20.251740 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251749 | controller | | secret "cert-swift-public-route" deleted' 2025-10-13 20:41:20.251755 | controller | - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251760 | controller | | secret "cert-swift-public-svc" deleted' 2025-10-13 20:41:20.251766 | controller | - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251772 | controller | | secret "rootca-internal" deleted' 2025-10-13 20:41:20.251777 | controller | - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251783 | controller | | secret "rootca-libvirt" deleted' 2025-10-13 20:41:20.251789 | controller | - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251794 | controller | | secret "rootca-ovn" deleted' 2025-10-13 20:41:20.251800 | controller | - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251806 | controller | | secret "rootca-public" deleted' 2025-10-13 20:41:20.251811 | controller | - ' logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings/5-cleanup 2025-10-13 20:41:20.251817 | controller | | test step completed 5-cleanup' 2025-10-13 20:41:20.251823 | controller | - ' logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings | skipping 2025-10-13 20:41:20.251828 | controller | kubernetes event logging' 2025-10-13 20:41:20.251837 | controller | - === NAME kuttl 2025-10-13 20:41:20.251843 | controller | - ' harness.go:406: run tests finished' 2025-10-13 20:41:20.251849 | controller | - ' harness.go:514: cleaning up' 2025-10-13 20:41:20.251854 | controller | - ' harness.go:571: removing temp folder: ""' 2025-10-13 20:41:20.251860 | controller | - '--- PASS: kuttl (301.64s)' 2025-10-13 20:41:20.251866 | controller | - ' --- PASS: kuttl/harness (0.00s)' 2025-10-13 20:41:20.251871 | controller | - ' --- PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings (300.23s)' 2025-10-13 20:41:20.251877 | controller | - PASS 2025-10-13 20:41:20.251883 | controller | - No resources found 2025-10-13 20:41:20.251889 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.251894 | controller | - bash scripts/retry_make_crc_storage_cleanup.sh 3 2025-10-13 20:41:20.251900 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.251906 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.251911 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.251917 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.251923 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.251928 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.251934 | controller | - + cat 2025-10-13 20:41:20.251940 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.251946 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.251952 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.251957 | controller | do sleep 1; done" 2025-10-13 20:41:20.251963 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.251969 | controller | - crc-storage Active 2025-10-13 20:41:20.251974 | controller | - oc project crc-storage 2025-10-13 20:41:20.251983 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.251988 | controller | - bash scripts/cleanup-crc-pv.sh 2025-10-13 20:41:20.251994 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.252000 | controller | - ++ awk '{print $6}' 2025-10-13 20:41:20.252005 | controller | - ++ grep Bound 2025-10-13 20:41:20.252013 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.252019 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.252025 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.252035 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.252041 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.252049 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.252055 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.252061 | controller | - + NAME=glance-glance-default-external-api-0 2025-10-13 20:41:20.252074 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found 2025-10-13 20:41:20.252082 | controller | - persistentvolumeclaim "glance-glance-default-external-api-0" deleted 2025-10-13 20:41:20.252090 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.252097 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.252105 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.252111 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.252117 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.252123 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.252128 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.252134 | controller | - + NAME=mysql-db-openstack-galera-0 2025-10-13 20:41:20.252140 | controller | - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found 2025-10-13 20:41:20.252146 | controller | - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted 2025-10-13 20:41:20.252151 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.252157 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.252163 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.252168 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.252174 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.252180 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.252185 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.252191 | controller | - + NAME=mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.252197 | controller | - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found 2025-10-13 20:41:20.252202 | controller | - persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted 2025-10-13 20:41:20.252208 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.252214 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.252220 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.252225 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.252231 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.252237 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.252242 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.252248 | controller | - + NAME=glance-glance-default-internal-api-0 2025-10-13 20:41:20.252254 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found 2025-10-13 20:41:20.252259 | controller | - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted 2025-10-13 20:41:20.252265 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.252271 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.252276 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.252282 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.252288 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.252294 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.252299 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.252305 | controller | - + NAME=swift-swift-storage-0 2025-10-13 20:41:20.252311 | controller | - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found 2025-10-13 20:41:20.252316 | controller | - persistentvolumeclaim "swift-swift-storage-0" deleted 2025-10-13 20:41:20.252322 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.252328 | controller | - ++ awk '{print $1}' 2025-10-13 20:41:20.252339 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252345 | controller | '{print $1}'` 2025-10-13 20:41:20.252351 | controller | - + oc delete pv/local-storage01-crc 2025-10-13 20:41:20.252356 | controller | - persistentvolume "local-storage01-crc" deleted 2025-10-13 20:41:20.252362 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252368 | controller | '{print $1}'` 2025-10-13 20:41:20.252373 | controller | - + oc delete pv/local-storage02-crc 2025-10-13 20:41:20.252379 | controller | - persistentvolume "local-storage02-crc" deleted 2025-10-13 20:41:20.252385 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252390 | controller | '{print $1}'` 2025-10-13 20:41:20.252411 | controller | - + oc delete pv/local-storage03-crc 2025-10-13 20:41:20.252420 | controller | - persistentvolume "local-storage03-crc" deleted 2025-10-13 20:41:20.252426 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252432 | controller | '{print $1}'` 2025-10-13 20:41:20.252437 | controller | - + oc delete pv/local-storage04-crc 2025-10-13 20:41:20.252443 | controller | - persistentvolume "local-storage04-crc" deleted 2025-10-13 20:41:20.252449 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252455 | controller | '{print $1}'` 2025-10-13 20:41:20.252460 | controller | - + oc delete pv/local-storage05-crc 2025-10-13 20:41:20.252466 | controller | - persistentvolume "local-storage05-crc" deleted 2025-10-13 20:41:20.252472 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252477 | controller | '{print $1}'` 2025-10-13 20:41:20.252483 | controller | - + oc delete pv/local-storage06-crc 2025-10-13 20:41:20.252488 | controller | - persistentvolume "local-storage06-crc" deleted 2025-10-13 20:41:20.252494 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252500 | controller | '{print $1}'` 2025-10-13 20:41:20.252506 | controller | - + oc delete pv/local-storage07-crc 2025-10-13 20:41:20.252511 | controller | - persistentvolume "local-storage07-crc" deleted 2025-10-13 20:41:20.252517 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252522 | controller | '{print $1}'` 2025-10-13 20:41:20.252528 | controller | - + oc delete pv/local-storage08-crc 2025-10-13 20:41:20.252534 | controller | - persistentvolume "local-storage08-crc" deleted 2025-10-13 20:41:20.252539 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252545 | controller | '{print $1}'` 2025-10-13 20:41:20.252558 | controller | - + oc delete pv/local-storage09-crc 2025-10-13 20:41:20.252566 | controller | - persistentvolume "local-storage09-crc" deleted 2025-10-13 20:41:20.252574 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252582 | controller | '{print $1}'` 2025-10-13 20:41:20.252589 | controller | - + oc delete pv/local-storage10-crc 2025-10-13 20:41:20.252595 | controller | - persistentvolume "local-storage10-crc" deleted 2025-10-13 20:41:20.252601 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252606 | controller | '{print $1}'` 2025-10-13 20:41:20.252612 | controller | - + oc delete pv/local-storage11-crc 2025-10-13 20:41:20.252618 | controller | - persistentvolume "local-storage11-crc" deleted 2025-10-13 20:41:20.252623 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252629 | controller | '{print $1}'` 2025-10-13 20:41:20.252635 | controller | - + oc delete pv/local-storage12-crc 2025-10-13 20:41:20.252640 | controller | - persistentvolume "local-storage12-crc" deleted 2025-10-13 20:41:20.252646 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252652 | controller | '{print $1}'` 2025-10-13 20:41:20.252658 | controller | - + oc delete pv/local-storage13-crc 2025-10-13 20:41:20.252663 | controller | - persistentvolume "local-storage13-crc" deleted 2025-10-13 20:41:20.252673 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252699 | controller | '{print $1}'` 2025-10-13 20:41:20.252705 | controller | - + oc delete pv/local-storage14-crc 2025-10-13 20:41:20.252711 | controller | - persistentvolume "local-storage14-crc" deleted 2025-10-13 20:41:20.252716 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252722 | controller | '{print $1}'` 2025-10-13 20:41:20.252728 | controller | - + oc delete pv/local-storage15-crc 2025-10-13 20:41:20.252733 | controller | - persistentvolume "local-storage15-crc" deleted 2025-10-13 20:41:20.252739 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252745 | controller | '{print $1}'` 2025-10-13 20:41:20.252750 | controller | - + oc delete pv/local-storage16-crc 2025-10-13 20:41:20.252756 | controller | - persistentvolume "local-storage16-crc" deleted 2025-10-13 20:41:20.252762 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252767 | controller | '{print $1}'` 2025-10-13 20:41:20.252773 | controller | - + oc delete pv/local-storage17-crc 2025-10-13 20:41:20.252779 | controller | - persistentvolume "local-storage17-crc" deleted 2025-10-13 20:41:20.252784 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252790 | controller | '{print $1}'` 2025-10-13 20:41:20.252796 | controller | - + oc delete pv/local-storage18-crc 2025-10-13 20:41:20.252802 | controller | - persistentvolume "local-storage18-crc" deleted 2025-10-13 20:41:20.252807 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252813 | controller | '{print $1}'` 2025-10-13 20:41:20.252819 | controller | - + oc delete pv/local-storage19-crc 2025-10-13 20:41:20.252824 | controller | - persistentvolume "local-storage19-crc" deleted 2025-10-13 20:41:20.252830 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.252836 | controller | '{print $1}'` 2025-10-13 20:41:20.252841 | controller | - + oc delete pv/local-storage20-crc 2025-10-13 20:41:20.252847 | controller | - persistentvolume "local-storage20-crc" deleted 2025-10-13 20:41:20.252853 | controller | - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi 2025-10-13 20:41:20.252858 | controller | - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE 2025-10-13 20:41:20.252864 | controller | - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m11s 2025-10-13 20:41:20.252870 | controller | - storageclass.storage.k8s.io "local-storage" deleted 2025-10-13 20:41:20.252875 | controller | - bash scripts/delete-pv.sh 2025-10-13 20:41:20.252881 | controller | - +++ dirname scripts/delete-pv.sh 2025-10-13 20:41:20.252887 | controller | - ++ cd scripts 2025-10-13 20:41:20.252892 | controller | - ++ pwd -P 2025-10-13 20:41:20.252898 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.252904 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.252909 | controller | - ++ set -ex 2025-10-13 20:41:20.252915 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.252921 | controller | - ++ cat 2025-10-13 20:41:20.252926 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.252932 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.252938 | controller | - ++ cat 2025-10-13 20:41:20.252943 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.252949 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.252955 | controller | - ++ cat 2025-10-13 20:41:20.252960 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.252966 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.252972 | controller | - ++ cat 2025-10-13 20:41:20.252977 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.252983 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.252989 | controller | - + PV_NUM=20 2025-10-13 20:41:20.252994 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.253003 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.253009 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.253014 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.253020 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.253026 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.253032 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.253037 | controller | crc delete 2025-10-13 20:41:20.253043 | controller | - ++ set -ex 2025-10-13 20:41:20.253049 | controller | - ++ NODE=crc 2025-10-13 20:41:20.253054 | controller | - ++ OPERATION=delete 2025-10-13 20:41:20.253060 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.253066 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.253071 | controller | - ++ cat 2025-10-13 20:41:20.253077 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.253083 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.253096 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.253104 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.253115 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.253123 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.253128 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.253134 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.253142 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.253148 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.253153 | controller | --timeout 500s 2025-10-13 20:41:20.253159 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.253165 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.253170 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.253176 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.253182 | controller | - bash scripts/retry_make_crc_storage.sh 3 2025-10-13 20:41:20.253188 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.253193 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.253199 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.253205 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.253210 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.253216 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.253222 | controller | - + cat 2025-10-13 20:41:20.253229 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.253234 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.253240 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.253246 | controller | do sleep 1; done" 2025-10-13 20:41:20.253252 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.253257 | controller | - crc-storage Active 2025-10-13 20:41:20.253263 | controller | - oc project crc-storage 2025-10-13 20:41:20.253269 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.253274 | controller | - bash scripts/create-pv.sh 2025-10-13 20:41:20.253280 | controller | - +++ dirname scripts/create-pv.sh 2025-10-13 20:41:20.253286 | controller | - ++ cd scripts 2025-10-13 20:41:20.253291 | controller | - ++ pwd -P 2025-10-13 20:41:20.253300 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.253306 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.253311 | controller | - ++ set -ex 2025-10-13 20:41:20.253317 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.253323 | controller | - ++ cat 2025-10-13 20:41:20.253328 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.253334 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.253340 | controller | - ++ cat 2025-10-13 20:41:20.253345 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.253351 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.253357 | controller | - ++ cat 2025-10-13 20:41:20.253362 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.253368 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.253374 | controller | - ++ cat 2025-10-13 20:41:20.253380 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.253385 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.253394 | controller | - + PV_NUM=20 2025-10-13 20:41:20.253415 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.253427 | controller | - ++ oc get pv -o json 2025-10-13 20:41:20.253440 | controller | - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' 2025-10-13 20:41:20.253446 | controller | - + released= 2025-10-13 20:41:20.253451 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.253457 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.253465 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.253471 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.253477 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.253483 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.253489 | controller | crc create 2025-10-13 20:41:20.253494 | controller | - ++ set -ex 2025-10-13 20:41:20.253500 | controller | - ++ NODE=crc 2025-10-13 20:41:20.253506 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.253512 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.253517 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.253523 | controller | - ++ cat 2025-10-13 20:41:20.253529 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.253535 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.253540 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.253546 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.253552 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.253557 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.253563 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.253569 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.253574 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.253580 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.253594 | controller | --timeout 500s 2025-10-13 20:41:20.253602 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.253610 | controller | - bash scripts/gen-crc-pv-kustomize.sh 2025-10-13 20:41:20.253618 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.253625 | controller | - + '[' -z '"local-storage"' ']' 2025-10-13 20:41:20.253633 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' 2025-10-13 20:41:20.253640 | controller | - + PV_NUM=20 2025-10-13 20:41:20.253647 | controller | - + STORAGE_CAPACITY=10 2025-10-13 20:41:20.253654 | controller | - ++ oc get node -o name -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.253661 | controller | - ++ head -c-1 2025-10-13 20:41:20.253668 | controller | - ++ sed -e 's|node/||' 2025-10-13 20:41:20.253677 | controller | - ++ tr '\n' ' ' 2025-10-13 20:41:20.253683 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.253689 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.253694 | controller | - + cat 2025-10-13 20:41:20.253700 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.253706 | controller | - ++ seq -w 20 2025-10-13 20:41:20.253711 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253717 | controller | - + cat 2025-10-13 20:41:20.253723 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253729 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253734 | controller | - + cat 2025-10-13 20:41:20.253740 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253746 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253751 | controller | - + cat 2025-10-13 20:41:20.253757 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253763 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253768 | controller | - + cat 2025-10-13 20:41:20.253774 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253780 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253785 | controller | - + cat 2025-10-13 20:41:20.253791 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253797 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253802 | controller | - + cat 2025-10-13 20:41:20.253808 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253813 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253819 | controller | - + cat 2025-10-13 20:41:20.253825 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253830 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253836 | controller | - + cat 2025-10-13 20:41:20.253842 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253847 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253853 | controller | - + cat 2025-10-13 20:41:20.253859 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253864 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253870 | controller | - + cat 2025-10-13 20:41:20.253876 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253882 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253887 | controller | - + cat 2025-10-13 20:41:20.253893 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253898 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253904 | controller | - + cat 2025-10-13 20:41:20.253910 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253915 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253921 | controller | - + cat 2025-10-13 20:41:20.253927 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253932 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253938 | controller | - + cat 2025-10-13 20:41:20.253944 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253950 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253955 | controller | - + cat 2025-10-13 20:41:20.253961 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253966 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253972 | controller | - + cat 2025-10-13 20:41:20.253978 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.253983 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.253989 | controller | - + cat 2025-10-13 20:41:20.253995 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.254000 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.254006 | controller | - + cat 2025-10-13 20:41:20.254012 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.254017 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.254023 | controller | - + cat 2025-10-13 20:41:20.254029 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.254034 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.254040 | controller | - + cat 2025-10-13 20:41:20.254046 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.254051 | controller | - + cat 2025-10-13 20:41:20.254057 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:41:20.254063 | controller | - storageclass.storage.k8s.io/local-storage created 2025-10-13 20:41:20.254068 | controller | - persistentvolume/local-storage01-crc created 2025-10-13 20:41:20.254074 | controller | - persistentvolume/local-storage02-crc created 2025-10-13 20:41:20.254082 | controller | - persistentvolume/local-storage03-crc created 2025-10-13 20:41:20.254088 | controller | - persistentvolume/local-storage04-crc created 2025-10-13 20:41:20.254094 | controller | - persistentvolume/local-storage05-crc created 2025-10-13 20:41:20.254100 | controller | - persistentvolume/local-storage06-crc created 2025-10-13 20:41:20.254105 | controller | - persistentvolume/local-storage07-crc created 2025-10-13 20:41:20.254111 | controller | - persistentvolume/local-storage08-crc created 2025-10-13 20:41:20.254117 | controller | - persistentvolume/local-storage09-crc created 2025-10-13 20:41:20.254122 | controller | - persistentvolume/local-storage10-crc created 2025-10-13 20:41:20.254128 | controller | - persistentvolume/local-storage11-crc created 2025-10-13 20:41:20.254136 | controller | - persistentvolume/local-storage12-crc created 2025-10-13 20:41:20.254142 | controller | - persistentvolume/local-storage13-crc created 2025-10-13 20:41:20.254148 | controller | - persistentvolume/local-storage14-crc created 2025-10-13 20:41:20.254153 | controller | - persistentvolume/local-storage15-crc created 2025-10-13 20:41:20.254159 | controller | - persistentvolume/local-storage16-crc created 2025-10-13 20:41:20.254165 | controller | - persistentvolume/local-storage17-crc created 2025-10-13 20:41:20.254170 | controller | - persistentvolume/local-storage18-crc created 2025-10-13 20:41:20.254176 | controller | - persistentvolume/local-storage19-crc created 2025-10-13 20:41:20.254181 | controller | - persistentvolume/local-storage20-crc created 2025-10-13 20:41:20.254187 | controller | - persistentvolumeclaim/ansible-ee-logs unchanged 2025-10-13 20:41:20.254193 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.254198 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.254204 | controller | - '2025/10/13 19:57:08 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.254210 | controller | ]' 2025-10-13 20:41:20.254216 | controller | - === RUN kuttl 2025-10-13 20:41:20.254221 | controller | - ' harness.go:463: starting setup' 2025-10-13 20:41:20.254227 | controller | - ' harness.go:255: running tests using configured kubeconfig.' 2025-10-13 20:41:20.254233 | controller | - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' 2025-10-13 20:41:20.254246 | controller | - ' logger.go:42: 19:57:08 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.254254 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' 2025-10-13 20:41:20.254262 | controller | - ' logger.go:42: 19:57:08 | | netconfig.network.openstack.org/netconfig configured' 2025-10-13 20:41:20.254270 | controller | - ' logger.go:42: 19:57:08 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.254277 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' 2025-10-13 20:41:20.254298 | controller | - ' logger.go:42: 19:57:09 | | dnsmasq.network.openstack.org/dnsmasq configured' 2025-10-13 20:41:20.254306 | controller | - ' logger.go:42: 19:57:09 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.254313 | controller | ]; then' 2025-10-13 20:41:20.254319 | controller | - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' 2025-10-13 20:41:20.254326 | controller | - ' fi' 2025-10-13 20:41:20.254332 | controller | - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' 2025-10-13 20:41:20.254338 | controller | - ' --save-config \' 2025-10-13 20:41:20.254344 | controller | - ' --dry-run=client \' 2025-10-13 20:41:20.254353 | controller | - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.254359 | controller | - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' 2025-10-13 20:41:20.254365 | controller | - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.254374 | controller | - ' -n openstack-kuttl-tests \' 2025-10-13 20:41:20.254379 | controller | - ' -o yaml | \' 2025-10-13 20:41:20.254385 | controller | - ' oc apply -f -' 2025-10-13 20:41:20.254391 | controller | - ' ]' 2025-10-13 20:41:20.254397 | controller | - ' logger.go:42: 19:57:09 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.254418 | controller | configured' 2025-10-13 20:41:20.254424 | controller | - ' harness.go:363: running tests' 2025-10-13 20:41:20.254430 | controller | - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each 2025-10-13 20:41:20.254436 | controller | step' 2025-10-13 20:41:20.254442 | controller | - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.254447 | controller | has 19 tests' 2025-10-13 20:41:20.254453 | controller | - === RUN kuttl/harness 2025-10-13 20:41:20.254459 | controller | - === RUN kuttl/harness/ctlplane-collapsed 2025-10-13 20:41:20.254465 | controller | - === PAUSE kuttl/harness/ctlplane-collapsed 2025-10-13 20:41:20.254470 | controller | - === CONT kuttl/harness/ctlplane-collapsed 2025-10-13 20:41:20.254476 | controller | - ' logger.go:42: 19:57:09 | ctlplane-collapsed | Skipping creation of user-supplied 2025-10-13 20:41:20.254482 | controller | namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.254487 | controller | - ' logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | starting test step 0-deps' 2025-10-13 20:41:20.254493 | controller | - ' logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | running command: [sh -c 2025-10-13 20:41:20.254498 | controller | oc apply -f ../../common/rhobs.yaml' 2025-10-13 20:41:20.254504 | controller | - ' until oc api-resources | grep -q rhobs; do sleep 1; done' 2025-10-13 20:41:20.254510 | controller | - ' ]' 2025-10-13 20:41:20.254516 | controller | - ' logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | subscription.operators.coreos.com/cluster-observability-operator 2025-10-13 20:41:20.254521 | controller | created' 2025-10-13 20:41:20.254527 | controller | - ' logger.go:42: 19:57:25 | ctlplane-collapsed/0-deps | test step completed 0-deps' 2025-10-13 20:41:20.254533 | controller | - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.254538 | controller | | starting test step 1-deploy-openstack-collapsed-cell' 2025-10-13 20:41:20.254544 | controller | - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.254550 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_collapsed_cell.yaml' 2025-10-13 20:41:20.254555 | controller | - ' ]' 2025-10-13 20:41:20.254561 | controller | - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.254569 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.254575 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.254581 | controller | - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.254586 | controller | | openstackcontrolplane.core.openstack.org/openstack-collapsed-cell created' 2025-10-13 20:41:20.254592 | controller | - ' logger.go:42: 20:01:51 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell 2025-10-13 20:41:20.254598 | controller | | test step completed 1-deploy-openstack-collapsed-cell' 2025-10-13 20:41:20.254603 | controller | - ' logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | starting test step 2025-10-13 20:41:20.254609 | controller | 2-cleanup' 2025-10-13 20:41:20.254615 | controller | - ' logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | running command: [sh 2025-10-13 20:41:20.254620 | controller | -c oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' 2025-10-13 20:41:20.254626 | controller | - ' oc delete secret -l service-cert -n $NAMESPACE' 2025-10-13 20:41:20.254632 | controller | - ' oc delete secret -l ca-cert -n $NAMESPACE' 2025-10-13 20:41:20.254637 | controller | - ' ]' 2025-10-13 20:41:20.254643 | controller | - ' logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | secret "combined-ca-bundle" 2025-10-13 20:41:20.254651 | controller | deleted' 2025-10-13 20:41:20.254665 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-barbican-internal-svc" 2025-10-13 20:41:20.254673 | controller | deleted' 2025-10-13 20:41:20.254681 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-barbican-public-route" 2025-10-13 20:41:20.254689 | controller | deleted' 2025-10-13 20:41:20.254697 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-barbican-public-svc" 2025-10-13 20:41:20.254703 | controller | deleted' 2025-10-13 20:41:20.254709 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ceilometer-internal-svc" 2025-10-13 20:41:20.254715 | controller | deleted' 2025-10-13 20:41:20.254720 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-cinder-internal-svc" 2025-10-13 20:41:20.254726 | controller | deleted' 2025-10-13 20:41:20.254731 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-cinder-public-route" 2025-10-13 20:41:20.254737 | controller | deleted' 2025-10-13 20:41:20.254743 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-cinder-public-svc" 2025-10-13 20:41:20.254748 | controller | deleted' 2025-10-13 20:41:20.254754 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-galera-openstack-svc" 2025-10-13 20:41:20.254760 | controller | deleted' 2025-10-13 20:41:20.254765 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-glance-default-internal-svc" 2025-10-13 20:41:20.254771 | controller | deleted' 2025-10-13 20:41:20.254777 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-glance-default-public-route" 2025-10-13 20:41:20.254782 | controller | deleted' 2025-10-13 20:41:20.254788 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-glance-default-public-svc" 2025-10-13 20:41:20.254794 | controller | deleted' 2025-10-13 20:41:20.254799 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-keystone-internal-svc" 2025-10-13 20:41:20.254805 | controller | deleted' 2025-10-13 20:41:20.254811 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-keystone-public-route" 2025-10-13 20:41:20.254816 | controller | deleted' 2025-10-13 20:41:20.254822 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-keystone-public-svc" 2025-10-13 20:41:20.254828 | controller | deleted' 2025-10-13 20:41:20.254833 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-kube-state-metrics-svc" 2025-10-13 20:41:20.254839 | controller | deleted' 2025-10-13 20:41:20.254845 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-memcached-svc" 2025-10-13 20:41:20.254850 | controller | deleted' 2025-10-13 20:41:20.254856 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-metric-storage-prometheus-svc" 2025-10-13 20:41:20.254862 | controller | deleted' 2025-10-13 20:41:20.254874 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-internal-svc" 2025-10-13 20:41:20.254879 | controller | deleted' 2025-10-13 20:41:20.254885 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-ovndbs" 2025-10-13 20:41:20.254891 | controller | deleted' 2025-10-13 20:41:20.254896 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-public-route" 2025-10-13 20:41:20.254902 | controller | deleted' 2025-10-13 20:41:20.254908 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-public-svc" 2025-10-13 20:41:20.254913 | controller | deleted' 2025-10-13 20:41:20.254919 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-internal-svc" 2025-10-13 20:41:20.254925 | controller | deleted' 2025-10-13 20:41:20.254931 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-novncproxy-cell1-public-route" 2025-10-13 20:41:20.254939 | controller | deleted' 2025-10-13 20:41:20.254945 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" 2025-10-13 20:41:20.254950 | controller | deleted' 2025-10-13 20:41:20.254956 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" 2025-10-13 20:41:20.254962 | controller | deleted' 2025-10-13 20:41:20.254968 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-public-route" 2025-10-13 20:41:20.254973 | controller | deleted' 2025-10-13 20:41:20.254979 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-public-svc" 2025-10-13 20:41:20.254985 | controller | deleted' 2025-10-13 20:41:20.254990 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovn-metrics" 2025-10-13 20:41:20.254996 | controller | deleted' 2025-10-13 20:41:20.255002 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovndbcluster-nb-ovndbs" 2025-10-13 20:41:20.255007 | controller | deleted' 2025-10-13 20:41:20.255013 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovndbcluster-sb-ovndbs" 2025-10-13 20:41:20.255019 | controller | deleted' 2025-10-13 20:41:20.255024 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovnnorthd-ovndbs" 2025-10-13 20:41:20.255030 | controller | deleted' 2025-10-13 20:41:20.255036 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-placement-internal-svc" 2025-10-13 20:41:20.255041 | controller | deleted' 2025-10-13 20:41:20.255047 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-placement-public-route" 2025-10-13 20:41:20.255052 | controller | deleted' 2025-10-13 20:41:20.255058 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-placement-public-svc" 2025-10-13 20:41:20.255064 | controller | deleted' 2025-10-13 20:41:20.255070 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-rabbitmq-svc" 2025-10-13 20:41:20.255075 | controller | deleted' 2025-10-13 20:41:20.255089 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-swift-internal-svc" 2025-10-13 20:41:20.255096 | controller | deleted' 2025-10-13 20:41:20.255104 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-swift-public-route" 2025-10-13 20:41:20.255112 | controller | deleted' 2025-10-13 20:41:20.255119 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-swift-public-svc" 2025-10-13 20:41:20.255125 | controller | deleted' 2025-10-13 20:41:20.255130 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-watcher-internal-svc" 2025-10-13 20:41:20.255136 | controller | deleted' 2025-10-13 20:41:20.255142 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-watcher-public-route" 2025-10-13 20:41:20.255147 | controller | deleted' 2025-10-13 20:41:20.255153 | controller | - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-watcher-public-svc" 2025-10-13 20:41:20.255159 | controller | deleted' 2025-10-13 20:41:20.255164 | controller | - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-internal" 2025-10-13 20:41:20.255170 | controller | deleted' 2025-10-13 20:41:20.255176 | controller | - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-libvirt" 2025-10-13 20:41:20.255181 | controller | deleted' 2025-10-13 20:41:20.255187 | controller | - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-ovn" 2025-10-13 20:41:20.255192 | controller | deleted' 2025-10-13 20:41:20.255198 | controller | - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-public" 2025-10-13 20:41:20.255204 | controller | deleted' 2025-10-13 20:41:20.255209 | controller | - ' logger.go:42: 20:02:25 | ctlplane-collapsed/2-cleanup | test step completed 2025-10-13 20:41:20.255215 | controller | 2-cleanup' 2025-10-13 20:41:20.255221 | controller | - ' logger.go:42: 20:02:25 | ctlplane-collapsed | skipping kubernetes event logging' 2025-10-13 20:41:20.255229 | controller | - === NAME kuttl 2025-10-13 20:41:20.255235 | controller | - ' harness.go:406: run tests finished' 2025-10-13 20:41:20.255241 | controller | - ' harness.go:514: cleaning up' 2025-10-13 20:41:20.255246 | controller | - ' harness.go:571: removing temp folder: ""' 2025-10-13 20:41:20.255252 | controller | - '--- PASS: kuttl (317.74s)' 2025-10-13 20:41:20.255258 | controller | - ' --- PASS: kuttl/harness (0.00s)' 2025-10-13 20:41:20.255264 | controller | - ' --- PASS: kuttl/harness/ctlplane-collapsed (316.26s)' 2025-10-13 20:41:20.255269 | controller | - PASS 2025-10-13 20:41:20.255275 | controller | - No resources found 2025-10-13 20:41:20.255281 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.255286 | controller | - bash scripts/retry_make_crc_storage_cleanup.sh 3 2025-10-13 20:41:20.255292 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.255298 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.255303 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.255309 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.255315 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.255320 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.255326 | controller | - + cat 2025-10-13 20:41:20.255331 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.255337 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.255343 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.255348 | controller | do sleep 1; done" 2025-10-13 20:41:20.255354 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.255360 | controller | - crc-storage Active 2025-10-13 20:41:20.255365 | controller | - oc project crc-storage 2025-10-13 20:41:20.255371 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.255377 | controller | - bash scripts/cleanup-crc-pv.sh 2025-10-13 20:41:20.255382 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.255388 | controller | - ++ awk '{print $6}' 2025-10-13 20:41:20.255396 | controller | - ++ grep Bound 2025-10-13 20:41:20.255414 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.255422 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.255428 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.255434 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.255439 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.255445 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.255451 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.255456 | controller | - + NAME=glance-glance-default-external-api-0 2025-10-13 20:41:20.255480 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found 2025-10-13 20:41:20.255486 | controller | - persistentvolumeclaim "glance-glance-default-external-api-0" deleted 2025-10-13 20:41:20.255491 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.255497 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.255503 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.255508 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.255514 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.255520 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.255525 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.255531 | controller | - + NAME=glance-glance-default-internal-api-0 2025-10-13 20:41:20.255537 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found 2025-10-13 20:41:20.255542 | controller | - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted 2025-10-13 20:41:20.255551 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.255557 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.255571 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.255578 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.255586 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.255593 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.255601 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.255609 | controller | - + NAME=swift-swift-storage-0 2025-10-13 20:41:20.255615 | controller | - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found 2025-10-13 20:41:20.255621 | controller | - persistentvolumeclaim "swift-swift-storage-0" deleted 2025-10-13 20:41:20.255626 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.255632 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.255638 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.255643 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.255649 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.255655 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.255660 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.255666 | controller | - + NAME=mysql-db-openstack-galera-0 2025-10-13 20:41:20.255672 | controller | - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found 2025-10-13 20:41:20.255678 | controller | - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted 2025-10-13 20:41:20.255683 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.255689 | controller | - ++ awk '{print $1}' 2025-10-13 20:41:20.255695 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255700 | controller | '{print $1}'` 2025-10-13 20:41:20.255706 | controller | - + oc delete pv/local-storage01-crc 2025-10-13 20:41:20.255712 | controller | - persistentvolume "local-storage01-crc" deleted 2025-10-13 20:41:20.255717 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255723 | controller | '{print $1}'` 2025-10-13 20:41:20.255729 | controller | - + oc delete pv/local-storage02-crc 2025-10-13 20:41:20.255734 | controller | - persistentvolume "local-storage02-crc" deleted 2025-10-13 20:41:20.255740 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255746 | controller | '{print $1}'` 2025-10-13 20:41:20.255751 | controller | - + oc delete pv/local-storage03-crc 2025-10-13 20:41:20.255757 | controller | - persistentvolume "local-storage03-crc" deleted 2025-10-13 20:41:20.255763 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255768 | controller | '{print $1}'` 2025-10-13 20:41:20.255774 | controller | - + oc delete pv/local-storage04-crc 2025-10-13 20:41:20.255780 | controller | - persistentvolume "local-storage04-crc" deleted 2025-10-13 20:41:20.255789 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255795 | controller | '{print $1}'` 2025-10-13 20:41:20.255800 | controller | - + oc delete pv/local-storage05-crc 2025-10-13 20:41:20.255806 | controller | - persistentvolume "local-storage05-crc" deleted 2025-10-13 20:41:20.255812 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255818 | controller | '{print $1}'` 2025-10-13 20:41:20.255823 | controller | - + oc delete pv/local-storage06-crc 2025-10-13 20:41:20.255829 | controller | - persistentvolume "local-storage06-crc" deleted 2025-10-13 20:41:20.255835 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255840 | controller | '{print $1}'` 2025-10-13 20:41:20.255846 | controller | - + oc delete pv/local-storage07-crc 2025-10-13 20:41:20.255852 | controller | - persistentvolume "local-storage07-crc" deleted 2025-10-13 20:41:20.255857 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255866 | controller | '{print $1}'` 2025-10-13 20:41:20.255872 | controller | - + oc delete pv/local-storage08-crc 2025-10-13 20:41:20.255877 | controller | - persistentvolume "local-storage08-crc" deleted 2025-10-13 20:41:20.255883 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255889 | controller | '{print $1}'` 2025-10-13 20:41:20.255894 | controller | - + oc delete pv/local-storage09-crc 2025-10-13 20:41:20.255900 | controller | - persistentvolume "local-storage09-crc" deleted 2025-10-13 20:41:20.255906 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255911 | controller | '{print $1}'` 2025-10-13 20:41:20.255917 | controller | - + oc delete pv/local-storage10-crc 2025-10-13 20:41:20.255923 | controller | - persistentvolume "local-storage10-crc" deleted 2025-10-13 20:41:20.255928 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255934 | controller | '{print $1}'` 2025-10-13 20:41:20.255940 | controller | - + oc delete pv/local-storage11-crc 2025-10-13 20:41:20.255945 | controller | - persistentvolume "local-storage11-crc" deleted 2025-10-13 20:41:20.255951 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255957 | controller | '{print $1}'` 2025-10-13 20:41:20.255962 | controller | - + oc delete pv/local-storage12-crc 2025-10-13 20:41:20.255968 | controller | - persistentvolume "local-storage12-crc" deleted 2025-10-13 20:41:20.255974 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.255979 | controller | '{print $1}'` 2025-10-13 20:41:20.255985 | controller | - + oc delete pv/local-storage13-crc 2025-10-13 20:41:20.255991 | controller | - persistentvolume "local-storage13-crc" deleted 2025-10-13 20:41:20.255996 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.256002 | controller | '{print $1}'` 2025-10-13 20:41:20.256008 | controller | - + oc delete pv/local-storage14-crc 2025-10-13 20:41:20.256013 | controller | - persistentvolume "local-storage14-crc" deleted 2025-10-13 20:41:20.256019 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.256025 | controller | '{print $1}'` 2025-10-13 20:41:20.256030 | controller | - + oc delete pv/local-storage15-crc 2025-10-13 20:41:20.256036 | controller | - persistentvolume "local-storage15-crc" deleted 2025-10-13 20:41:20.256042 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.256047 | controller | '{print $1}'` 2025-10-13 20:41:20.256061 | controller | - + oc delete pv/local-storage16-crc 2025-10-13 20:41:20.256069 | controller | - persistentvolume "local-storage16-crc" deleted 2025-10-13 20:41:20.256076 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.256084 | controller | '{print $1}'` 2025-10-13 20:41:20.256095 | controller | - + oc delete pv/local-storage17-crc 2025-10-13 20:41:20.256101 | controller | - persistentvolume "local-storage17-crc" deleted 2025-10-13 20:41:20.256106 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.256112 | controller | '{print $1}'` 2025-10-13 20:41:20.256120 | controller | - + oc delete pv/local-storage18-crc 2025-10-13 20:41:20.256126 | controller | - persistentvolume "local-storage18-crc" deleted 2025-10-13 20:41:20.256131 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.256137 | controller | '{print $1}'` 2025-10-13 20:41:20.256143 | controller | - + oc delete pv/local-storage19-crc 2025-10-13 20:41:20.256148 | controller | - persistentvolume "local-storage19-crc" deleted 2025-10-13 20:41:20.256154 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.256160 | controller | '{print $1}'` 2025-10-13 20:41:20.256165 | controller | - + oc delete pv/local-storage20-crc 2025-10-13 20:41:20.256171 | controller | - persistentvolume "local-storage20-crc" deleted 2025-10-13 20:41:20.256177 | controller | - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi 2025-10-13 20:41:20.256185 | controller | - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE 2025-10-13 20:41:20.256191 | controller | - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m26s 2025-10-13 20:41:20.256197 | controller | - storageclass.storage.k8s.io "local-storage" deleted 2025-10-13 20:41:20.256202 | controller | - bash scripts/delete-pv.sh 2025-10-13 20:41:20.256208 | controller | - +++ dirname scripts/delete-pv.sh 2025-10-13 20:41:20.256214 | controller | - ++ cd scripts 2025-10-13 20:41:20.256219 | controller | - ++ pwd -P 2025-10-13 20:41:20.256225 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.256233 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.256239 | controller | - ++ set -ex 2025-10-13 20:41:20.256245 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.256250 | controller | - ++ cat 2025-10-13 20:41:20.256256 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256262 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.256267 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256273 | controller | - ++ cat 2025-10-13 20:41:20.256279 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.256284 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256290 | controller | - ++ cat 2025-10-13 20:41:20.256296 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.256301 | controller | - ++ cat 2025-10-13 20:41:20.256309 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256315 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.256320 | controller | - + PV_NUM=20 2025-10-13 20:41:20.256326 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.256332 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.256338 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.256343 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.256349 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.256354 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.256360 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.256366 | controller | crc delete 2025-10-13 20:41:20.256372 | controller | - ++ set -ex 2025-10-13 20:41:20.256377 | controller | - ++ NODE=crc 2025-10-13 20:41:20.256383 | controller | - ++ OPERATION=delete 2025-10-13 20:41:20.256389 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.256397 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.256418 | controller | - ++ cat 2025-10-13 20:41:20.256424 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256430 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.256436 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.256441 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.256447 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.256453 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.256459 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.256464 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.256470 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.256476 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.256482 | controller | --timeout 500s 2025-10-13 20:41:20.256487 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.256496 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.256502 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.256511 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.256516 | controller | - bash scripts/retry_make_crc_storage.sh 3 2025-10-13 20:41:20.256522 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.256528 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.256533 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.256539 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.256545 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.256558 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.256570 | controller | - + cat 2025-10-13 20:41:20.256578 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.256586 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.256593 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.256599 | controller | do sleep 1; done" 2025-10-13 20:41:20.256604 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.256610 | controller | - crc-storage Active 2025-10-13 20:41:20.256616 | controller | - oc project crc-storage 2025-10-13 20:41:20.256621 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.256627 | controller | - bash scripts/create-pv.sh 2025-10-13 20:41:20.256633 | controller | - +++ dirname scripts/create-pv.sh 2025-10-13 20:41:20.256639 | controller | - ++ cd scripts 2025-10-13 20:41:20.256644 | controller | - ++ pwd -P 2025-10-13 20:41:20.256650 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.256656 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.256661 | controller | - ++ set -ex 2025-10-13 20:41:20.256667 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.256673 | controller | - ++ cat 2025-10-13 20:41:20.256680 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256686 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.256692 | controller | - ++ cat 2025-10-13 20:41:20.256697 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256703 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.256709 | controller | - ++ cat 2025-10-13 20:41:20.256714 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256720 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.256726 | controller | - ++ cat 2025-10-13 20:41:20.256731 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256737 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.256743 | controller | - + PV_NUM=20 2025-10-13 20:41:20.256748 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.256754 | controller | - ++ oc get pv -o json 2025-10-13 20:41:20.256760 | controller | - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' 2025-10-13 20:41:20.256765 | controller | - + released= 2025-10-13 20:41:20.256771 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.256777 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.256782 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.256788 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.256794 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.256799 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.256805 | controller | crc create 2025-10-13 20:41:20.256811 | controller | - ++ set -ex 2025-10-13 20:41:20.256816 | controller | - ++ NODE=crc 2025-10-13 20:41:20.256822 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.256828 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.256833 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.256839 | controller | - ++ cat 2025-10-13 20:41:20.256845 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.256854 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.256860 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.256865 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.256871 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.256877 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.256888 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.256894 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.256899 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.256905 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.256911 | controller | --timeout 500s 2025-10-13 20:41:20.256916 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.256922 | controller | - bash scripts/gen-crc-pv-kustomize.sh 2025-10-13 20:41:20.256928 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.256933 | controller | - + '[' -z '"local-storage"' ']' 2025-10-13 20:41:20.256939 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' 2025-10-13 20:41:20.256945 | controller | - + PV_NUM=20 2025-10-13 20:41:20.256950 | controller | - + STORAGE_CAPACITY=10 2025-10-13 20:41:20.256956 | controller | - ++ oc get node -o name -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.256962 | controller | - ++ head -c-1 2025-10-13 20:41:20.256967 | controller | - ++ sed -e 's|node/||' 2025-10-13 20:41:20.256973 | controller | - ++ tr '\n' ' ' 2025-10-13 20:41:20.256979 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.256984 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.256990 | controller | - + cat 2025-10-13 20:41:20.256999 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.257004 | controller | - ++ seq -w 20 2025-10-13 20:41:20.257010 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257016 | controller | - + cat 2025-10-13 20:41:20.257023 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257029 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257034 | controller | - + cat 2025-10-13 20:41:20.257040 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257046 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257051 | controller | - + cat 2025-10-13 20:41:20.257057 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257063 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257069 | controller | - + cat 2025-10-13 20:41:20.257074 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257080 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257086 | controller | - + cat 2025-10-13 20:41:20.257091 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257097 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257103 | controller | - + cat 2025-10-13 20:41:20.257108 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257114 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257120 | controller | - + cat 2025-10-13 20:41:20.257125 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257131 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257137 | controller | - + cat 2025-10-13 20:41:20.257142 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257148 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257154 | controller | - + cat 2025-10-13 20:41:20.257159 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257165 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257171 | controller | - + cat 2025-10-13 20:41:20.257176 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257190 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257198 | controller | - + cat 2025-10-13 20:41:20.257206 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257213 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257221 | controller | - + cat 2025-10-13 20:41:20.257230 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257236 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257241 | controller | - + cat 2025-10-13 20:41:20.257247 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257253 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257258 | controller | - + cat 2025-10-13 20:41:20.257264 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257270 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257275 | controller | - + cat 2025-10-13 20:41:20.257281 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257286 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257292 | controller | - + cat 2025-10-13 20:41:20.257298 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257304 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257309 | controller | - + cat 2025-10-13 20:41:20.257315 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257321 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257326 | controller | - + cat 2025-10-13 20:41:20.257332 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257338 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257343 | controller | - + cat 2025-10-13 20:41:20.257349 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257355 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.257360 | controller | - + cat 2025-10-13 20:41:20.257366 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.257372 | controller | - + cat 2025-10-13 20:41:20.257377 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:41:20.257386 | controller | - storageclass.storage.k8s.io/local-storage created 2025-10-13 20:41:20.257394 | controller | - persistentvolume/local-storage01-crc created 2025-10-13 20:41:20.257411 | controller | - persistentvolume/local-storage02-crc created 2025-10-13 20:41:20.257420 | controller | - persistentvolume/local-storage03-crc created 2025-10-13 20:41:20.257426 | controller | - persistentvolume/local-storage04-crc created 2025-10-13 20:41:20.257431 | controller | - persistentvolume/local-storage05-crc created 2025-10-13 20:41:20.257437 | controller | - persistentvolume/local-storage06-crc created 2025-10-13 20:41:20.257443 | controller | - persistentvolume/local-storage07-crc created 2025-10-13 20:41:20.257448 | controller | - persistentvolume/local-storage08-crc created 2025-10-13 20:41:20.257454 | controller | - persistentvolume/local-storage09-crc created 2025-10-13 20:41:20.257460 | controller | - persistentvolume/local-storage10-crc created 2025-10-13 20:41:20.257465 | controller | - persistentvolume/local-storage11-crc created 2025-10-13 20:41:20.257471 | controller | - persistentvolume/local-storage12-crc created 2025-10-13 20:41:20.257477 | controller | - persistentvolume/local-storage13-crc created 2025-10-13 20:41:20.257483 | controller | - persistentvolume/local-storage14-crc created 2025-10-13 20:41:20.257488 | controller | - persistentvolume/local-storage15-crc created 2025-10-13 20:41:20.257494 | controller | - persistentvolume/local-storage16-crc created 2025-10-13 20:41:20.257502 | controller | - persistentvolume/local-storage17-crc created 2025-10-13 20:41:20.257508 | controller | - persistentvolume/local-storage18-crc created 2025-10-13 20:41:20.257514 | controller | - persistentvolume/local-storage19-crc created 2025-10-13 20:41:20.257519 | controller | - persistentvolume/local-storage20-crc created 2025-10-13 20:41:20.257525 | controller | - persistentvolumeclaim/ansible-ee-logs unchanged 2025-10-13 20:41:20.257531 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.257537 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.257542 | controller | - '2025/10/13 20:02:47 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.257548 | controller | ]' 2025-10-13 20:41:20.257554 | controller | - === RUN kuttl 2025-10-13 20:41:20.257560 | controller | - ' harness.go:463: starting setup' 2025-10-13 20:41:20.257565 | controller | - ' harness.go:255: running tests using configured kubeconfig.' 2025-10-13 20:41:20.257571 | controller | - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' 2025-10-13 20:41:20.257579 | controller | - ' logger.go:42: 20:02:47 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.257585 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' 2025-10-13 20:41:20.257591 | controller | - ' logger.go:42: 20:02:51 | | netconfig.network.openstack.org/netconfig configured' 2025-10-13 20:41:20.257596 | controller | - ' logger.go:42: 20:02:51 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.257602 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' 2025-10-13 20:41:20.257608 | controller | - ' logger.go:42: 20:02:52 | | dnsmasq.network.openstack.org/dnsmasq configured' 2025-10-13 20:41:20.257613 | controller | - ' logger.go:42: 20:02:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.257619 | controller | ]; then' 2025-10-13 20:41:20.257625 | controller | - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' 2025-10-13 20:41:20.257631 | controller | - ' fi' 2025-10-13 20:41:20.257636 | controller | - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' 2025-10-13 20:41:20.257642 | controller | - ' --save-config \' 2025-10-13 20:41:20.257648 | controller | - ' --dry-run=client \' 2025-10-13 20:41:20.257653 | controller | - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.257659 | controller | - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' 2025-10-13 20:41:20.257665 | controller | - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.257670 | controller | - ' -n openstack-kuttl-tests \' 2025-10-13 20:41:20.257676 | controller | - ' -o yaml | \' 2025-10-13 20:41:20.257682 | controller | - ' oc apply -f -' 2025-10-13 20:41:20.257687 | controller | - ' ]' 2025-10-13 20:41:20.257693 | controller | - ' logger.go:42: 20:02:52 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.257699 | controller | configured' 2025-10-13 20:41:20.257712 | controller | - ' harness.go:363: running tests' 2025-10-13 20:41:20.257721 | controller | - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each 2025-10-13 20:41:20.257728 | controller | step' 2025-10-13 20:41:20.257736 | controller | - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.257744 | controller | has 19 tests' 2025-10-13 20:41:20.257750 | controller | - === RUN kuttl/harness 2025-10-13 20:41:20.257756 | controller | - === RUN kuttl/harness/ctlplane-galera-3replicas 2025-10-13 20:41:20.257761 | controller | - === PAUSE kuttl/harness/ctlplane-galera-3replicas 2025-10-13 20:41:20.257767 | controller | - === CONT kuttl/harness/ctlplane-galera-3replicas 2025-10-13 20:41:20.257773 | controller | - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas | Skipping creation of user-supplied 2025-10-13 20:41:20.257778 | controller | namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.257784 | controller | - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.257790 | controller | | starting test step 1-deploy-galera-3replicas' 2025-10-13 20:41:20.257795 | controller | - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.257801 | controller | | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera_3replicas.yaml' 2025-10-13 20:41:20.257807 | controller | - ' ]' 2025-10-13 20:41:20.257813 | controller | - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.257818 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.257824 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.257830 | controller | - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.257839 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.257845 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.257850 | controller | - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.257856 | controller | | openstackcontrolplane.core.openstack.org/openstack-galera-3replicas created' 2025-10-13 20:41:20.257862 | controller | - ' logger.go:42: 20:07:10 | ctlplane-galera-3replicas/1-deploy-galera-3replicas 2025-10-13 20:41:20.257870 | controller | | test step completed 1-deploy-galera-3replicas' 2025-10-13 20:41:20.257876 | controller | - ' logger.go:42: 20:07:10 | ctlplane-galera-3replicas/2-cleanup | starting test 2025-10-13 20:41:20.257882 | controller | step 2-cleanup' 2025-10-13 20:41:20.257887 | controller | - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | running command: 2025-10-13 20:41:20.257893 | controller | [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' 2025-10-13 20:41:20.257899 | controller | - ' mysql-db-openstack-galera-0 \' 2025-10-13 20:41:20.257905 | controller | - ' mysql-db-openstack-galera-1 \' 2025-10-13 20:41:20.257910 | controller | - ' mysql-db-openstack-galera-2 \' 2025-10-13 20:41:20.257916 | controller | - ' mysql-db-openstack-cell1-galera-0 \' 2025-10-13 20:41:20.257922 | controller | - ' mysql-db-openstack-cell1-galera-1 \' 2025-10-13 20:41:20.257927 | controller | - ' mysql-db-openstack-cell1-galera-2' 2025-10-13 20:41:20.257933 | controller | - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' 2025-10-13 20:41:20.257939 | controller | - ' oc delete secret -l service-cert -n $NAMESPACE' 2025-10-13 20:41:20.257944 | controller | - ' oc delete secret -l ca-cert -n $NAMESPACE' 2025-10-13 20:41:20.257950 | controller | - ' ]' 2025-10-13 20:41:20.257956 | controller | - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.257964 | controller | "mysql-db-openstack-galera-0" deleted' 2025-10-13 20:41:20.257970 | controller | - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.257975 | controller | "mysql-db-openstack-galera-1" deleted' 2025-10-13 20:41:20.257981 | controller | - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.257987 | controller | "mysql-db-openstack-galera-2" deleted' 2025-10-13 20:41:20.257992 | controller | - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.257998 | controller | "mysql-db-openstack-cell1-galera-0" deleted' 2025-10-13 20:41:20.258004 | controller | - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.258010 | controller | "mysql-db-openstack-cell1-galera-1" deleted' 2025-10-13 20:41:20.258015 | controller | - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.258021 | controller | "mysql-db-openstack-cell1-galera-2" deleted' 2025-10-13 20:41:20.258027 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "combined-ca-bundle" 2025-10-13 20:41:20.258032 | controller | deleted' 2025-10-13 20:41:20.258038 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-barbican-internal-svc" 2025-10-13 20:41:20.258044 | controller | deleted' 2025-10-13 20:41:20.258050 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-barbican-public-route" 2025-10-13 20:41:20.258055 | controller | deleted' 2025-10-13 20:41:20.258061 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-barbican-public-svc" 2025-10-13 20:41:20.258067 | controller | deleted' 2025-10-13 20:41:20.258073 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ceilometer-internal-svc" 2025-10-13 20:41:20.258088 | controller | deleted' 2025-10-13 20:41:20.258101 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-cinder-internal-svc" 2025-10-13 20:41:20.258113 | controller | deleted' 2025-10-13 20:41:20.258121 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-cinder-public-route" 2025-10-13 20:41:20.258129 | controller | deleted' 2025-10-13 20:41:20.258134 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-cinder-public-svc" 2025-10-13 20:41:20.258140 | controller | deleted' 2025-10-13 20:41:20.258146 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-galera-openstack-cell1-svc" 2025-10-13 20:41:20.258152 | controller | deleted' 2025-10-13 20:41:20.258157 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-galera-openstack-svc" 2025-10-13 20:41:20.258163 | controller | deleted' 2025-10-13 20:41:20.258169 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-glance-default-internal-svc" 2025-10-13 20:41:20.258174 | controller | deleted' 2025-10-13 20:41:20.258180 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-glance-default-public-route" 2025-10-13 20:41:20.258186 | controller | deleted' 2025-10-13 20:41:20.258191 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-glance-default-public-svc" 2025-10-13 20:41:20.258197 | controller | deleted' 2025-10-13 20:41:20.258203 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-keystone-internal-svc" 2025-10-13 20:41:20.258208 | controller | deleted' 2025-10-13 20:41:20.258214 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-keystone-public-route" 2025-10-13 20:41:20.258223 | controller | deleted' 2025-10-13 20:41:20.258229 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-keystone-public-svc" 2025-10-13 20:41:20.258234 | controller | deleted' 2025-10-13 20:41:20.258240 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-kube-state-metrics-svc" 2025-10-13 20:41:20.258246 | controller | deleted' 2025-10-13 20:41:20.258251 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-memcached-svc" 2025-10-13 20:41:20.258257 | controller | deleted' 2025-10-13 20:41:20.258263 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-internal-svc" 2025-10-13 20:41:20.258268 | controller | deleted' 2025-10-13 20:41:20.258274 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-ovndbs" 2025-10-13 20:41:20.258280 | controller | deleted' 2025-10-13 20:41:20.258285 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-public-route" 2025-10-13 20:41:20.258291 | controller | deleted' 2025-10-13 20:41:20.258297 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-public-svc" 2025-10-13 20:41:20.258302 | controller | deleted' 2025-10-13 20:41:20.258308 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-internal-svc" 2025-10-13 20:41:20.258317 | controller | deleted' 2025-10-13 20:41:20.258339 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-novncproxy-cell1-public-route" 2025-10-13 20:41:20.258347 | controller | deleted' 2025-10-13 20:41:20.258354 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" 2025-10-13 20:41:20.258361 | controller | deleted' 2025-10-13 20:41:20.258368 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" 2025-10-13 20:41:20.258375 | controller | deleted' 2025-10-13 20:41:20.258380 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-public-route" 2025-10-13 20:41:20.258386 | controller | deleted' 2025-10-13 20:41:20.258392 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-public-svc" 2025-10-13 20:41:20.258398 | controller | deleted' 2025-10-13 20:41:20.258425 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovn-metrics" 2025-10-13 20:41:20.258432 | controller | deleted' 2025-10-13 20:41:20.258437 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovndbcluster-nb-ovndbs" 2025-10-13 20:41:20.258443 | controller | deleted' 2025-10-13 20:41:20.258449 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovndbcluster-sb-ovndbs" 2025-10-13 20:41:20.258454 | controller | deleted' 2025-10-13 20:41:20.258460 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovnnorthd-ovndbs" 2025-10-13 20:41:20.258466 | controller | deleted' 2025-10-13 20:41:20.258471 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-placement-internal-svc" 2025-10-13 20:41:20.258477 | controller | deleted' 2025-10-13 20:41:20.258483 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-placement-public-route" 2025-10-13 20:41:20.258488 | controller | deleted' 2025-10-13 20:41:20.258494 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-placement-public-svc" 2025-10-13 20:41:20.258500 | controller | deleted' 2025-10-13 20:41:20.258505 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-rabbitmq-cell1-svc" 2025-10-13 20:41:20.258511 | controller | deleted' 2025-10-13 20:41:20.258517 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-rabbitmq-svc" 2025-10-13 20:41:20.258522 | controller | deleted' 2025-10-13 20:41:20.258528 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-swift-internal-svc" 2025-10-13 20:41:20.258534 | controller | deleted' 2025-10-13 20:41:20.258548 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-swift-public-route" 2025-10-13 20:41:20.258555 | controller | deleted' 2025-10-13 20:41:20.258563 | controller | - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-swift-public-svc" 2025-10-13 20:41:20.258571 | controller | deleted' 2025-10-13 20:41:20.258578 | controller | - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-internal" 2025-10-13 20:41:20.258586 | controller | deleted' 2025-10-13 20:41:20.258593 | controller | - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-libvirt" 2025-10-13 20:41:20.258600 | controller | deleted' 2025-10-13 20:41:20.259099 | controller | - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-ovn" 2025-10-13 20:41:20.259105 | controller | deleted' 2025-10-13 20:41:20.259111 | controller | - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-public" 2025-10-13 20:41:20.259117 | controller | deleted' 2025-10-13 20:41:20.259122 | controller | - ' logger.go:42: 20:07:44 | ctlplane-galera-3replicas/2-cleanup | test step completed 2025-10-13 20:41:20.259128 | controller | 2-cleanup' 2025-10-13 20:41:20.259134 | controller | - ' logger.go:42: 20:07:44 | ctlplane-galera-3replicas | skipping kubernetes event 2025-10-13 20:41:20.259140 | controller | logging' 2025-10-13 20:41:20.259145 | controller | - === NAME kuttl 2025-10-13 20:41:20.259151 | controller | - ' harness.go:406: run tests finished' 2025-10-13 20:41:20.259157 | controller | - ' harness.go:514: cleaning up' 2025-10-13 20:41:20.259162 | controller | - ' harness.go:571: removing temp folder: ""' 2025-10-13 20:41:20.259168 | controller | - '--- PASS: kuttl (297.42s)' 2025-10-13 20:41:20.259174 | controller | - ' --- PASS: kuttl/harness (0.00s)' 2025-10-13 20:41:20.259180 | controller | - ' --- PASS: kuttl/harness/ctlplane-galera-3replicas (292.40s)' 2025-10-13 20:41:20.259185 | controller | - PASS 2025-10-13 20:41:20.259191 | controller | - No resources found 2025-10-13 20:41:20.259197 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.259202 | controller | - bash scripts/retry_make_crc_storage_cleanup.sh 3 2025-10-13 20:41:20.259208 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.259217 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.259223 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.259231 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.259237 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.259243 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.259249 | controller | - + cat 2025-10-13 20:41:20.259254 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.259260 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.259266 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.259271 | controller | do sleep 1; done" 2025-10-13 20:41:20.259277 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.259283 | controller | - crc-storage Active 2025-10-13 20:41:20.259288 | controller | - oc project crc-storage 2025-10-13 20:41:20.259294 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.259300 | controller | - bash scripts/cleanup-crc-pv.sh 2025-10-13 20:41:20.259305 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.259311 | controller | - ++ awk '{print $6}' 2025-10-13 20:41:20.259317 | controller | - ++ grep Bound 2025-10-13 20:41:20.259323 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.259328 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.259334 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.259340 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.259345 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.259351 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.259357 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.259362 | controller | - + NAME=swift-swift-storage-0 2025-10-13 20:41:20.259368 | controller | - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found 2025-10-13 20:41:20.259374 | controller | - persistentvolumeclaim "swift-swift-storage-0" deleted 2025-10-13 20:41:20.259379 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.259385 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.259391 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.259414 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.259423 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.259428 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.259434 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.259440 | controller | - + NAME=glance-glance-default-internal-api-0 2025-10-13 20:41:20.259446 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found 2025-10-13 20:41:20.259451 | controller | - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted 2025-10-13 20:41:20.259457 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.259463 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.259468 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.259474 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.259480 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.259485 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.259491 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.259497 | controller | - + NAME=glance-glance-default-external-api-0 2025-10-13 20:41:20.259502 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found 2025-10-13 20:41:20.259508 | controller | - persistentvolumeclaim "glance-glance-default-external-api-0" deleted 2025-10-13 20:41:20.259522 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.259530 | controller | - ++ awk '{print $1}' 2025-10-13 20:41:20.259545 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259553 | controller | '{print $1}'` 2025-10-13 20:41:20.259561 | controller | - + oc delete pv/local-storage01-crc 2025-10-13 20:41:20.259570 | controller | - persistentvolume "local-storage01-crc" deleted 2025-10-13 20:41:20.259576 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259581 | controller | '{print $1}'` 2025-10-13 20:41:20.259587 | controller | - + oc delete pv/local-storage02-crc 2025-10-13 20:41:20.259593 | controller | - persistentvolume "local-storage02-crc" deleted 2025-10-13 20:41:20.259598 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259604 | controller | '{print $1}'` 2025-10-13 20:41:20.259610 | controller | - + oc delete pv/local-storage03-crc 2025-10-13 20:41:20.259615 | controller | - persistentvolume "local-storage03-crc" deleted 2025-10-13 20:41:20.259621 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259627 | controller | '{print $1}'` 2025-10-13 20:41:20.259632 | controller | - + oc delete pv/local-storage04-crc 2025-10-13 20:41:20.259638 | controller | - persistentvolume "local-storage04-crc" deleted 2025-10-13 20:41:20.259644 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259649 | controller | '{print $1}'` 2025-10-13 20:41:20.259655 | controller | - + oc delete pv/local-storage05-crc 2025-10-13 20:41:20.259661 | controller | - persistentvolume "local-storage05-crc" deleted 2025-10-13 20:41:20.259666 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259672 | controller | '{print $1}'` 2025-10-13 20:41:20.259678 | controller | - + oc delete pv/local-storage06-crc 2025-10-13 20:41:20.259683 | controller | - persistentvolume "local-storage06-crc" deleted 2025-10-13 20:41:20.259689 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259695 | controller | '{print $1}'` 2025-10-13 20:41:20.259700 | controller | - + oc delete pv/local-storage07-crc 2025-10-13 20:41:20.259706 | controller | - persistentvolume "local-storage07-crc" deleted 2025-10-13 20:41:20.259712 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259717 | controller | '{print $1}'` 2025-10-13 20:41:20.259723 | controller | - + oc delete pv/local-storage08-crc 2025-10-13 20:41:20.259729 | controller | - persistentvolume "local-storage08-crc" deleted 2025-10-13 20:41:20.259734 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259740 | controller | '{print $1}'` 2025-10-13 20:41:20.259746 | controller | - + oc delete pv/local-storage09-crc 2025-10-13 20:41:20.259751 | controller | - persistentvolume "local-storage09-crc" deleted 2025-10-13 20:41:20.259757 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259763 | controller | '{print $1}'` 2025-10-13 20:41:20.259768 | controller | - + oc delete pv/local-storage10-crc 2025-10-13 20:41:20.259774 | controller | - persistentvolume "local-storage10-crc" deleted 2025-10-13 20:41:20.259780 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259785 | controller | '{print $1}'` 2025-10-13 20:41:20.259791 | controller | - + oc delete pv/local-storage11-crc 2025-10-13 20:41:20.259797 | controller | - persistentvolume "local-storage11-crc" deleted 2025-10-13 20:41:20.259802 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259808 | controller | '{print $1}'` 2025-10-13 20:41:20.259814 | controller | - + oc delete pv/local-storage12-crc 2025-10-13 20:41:20.259819 | controller | - persistentvolume "local-storage12-crc" deleted 2025-10-13 20:41:20.259825 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259831 | controller | '{print $1}'` 2025-10-13 20:41:20.259836 | controller | - + oc delete pv/local-storage13-crc 2025-10-13 20:41:20.259842 | controller | - persistentvolume "local-storage13-crc" deleted 2025-10-13 20:41:20.259851 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259856 | controller | '{print $1}'` 2025-10-13 20:41:20.259862 | controller | - + oc delete pv/local-storage14-crc 2025-10-13 20:41:20.259868 | controller | - persistentvolume "local-storage14-crc" deleted 2025-10-13 20:41:20.259874 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259879 | controller | '{print $1}'` 2025-10-13 20:41:20.259885 | controller | - + oc delete pv/local-storage15-crc 2025-10-13 20:41:20.259893 | controller | - persistentvolume "local-storage15-crc" deleted 2025-10-13 20:41:20.259899 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259905 | controller | '{print $1}'` 2025-10-13 20:41:20.259910 | controller | - + oc delete pv/local-storage16-crc 2025-10-13 20:41:20.259916 | controller | - persistentvolume "local-storage16-crc" deleted 2025-10-13 20:41:20.259922 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259927 | controller | '{print $1}'` 2025-10-13 20:41:20.259933 | controller | - + oc delete pv/local-storage17-crc 2025-10-13 20:41:20.259939 | controller | - persistentvolume "local-storage17-crc" deleted 2025-10-13 20:41:20.259944 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259950 | controller | '{print $1}'` 2025-10-13 20:41:20.259958 | controller | - + oc delete pv/local-storage18-crc 2025-10-13 20:41:20.259964 | controller | - persistentvolume "local-storage18-crc" deleted 2025-10-13 20:41:20.259970 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.259977 | controller | '{print $1}'` 2025-10-13 20:41:20.259983 | controller | - + oc delete pv/local-storage19-crc 2025-10-13 20:41:20.259989 | controller | - persistentvolume "local-storage19-crc" deleted 2025-10-13 20:41:20.259994 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.260000 | controller | '{print $1}'` 2025-10-13 20:41:20.260006 | controller | - + oc delete pv/local-storage20-crc 2025-10-13 20:41:20.260012 | controller | - persistentvolume "local-storage20-crc" deleted 2025-10-13 20:41:20.260025 | controller | - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi 2025-10-13 20:41:20.260033 | controller | - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE 2025-10-13 20:41:20.260041 | controller | - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m6s 2025-10-13 20:41:20.260049 | controller | - storageclass.storage.k8s.io "local-storage" deleted 2025-10-13 20:41:20.260056 | controller | - bash scripts/delete-pv.sh 2025-10-13 20:41:20.260062 | controller | - +++ dirname scripts/delete-pv.sh 2025-10-13 20:41:20.260067 | controller | - ++ cd scripts 2025-10-13 20:41:20.260073 | controller | - ++ pwd -P 2025-10-13 20:41:20.260079 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.260085 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.260090 | controller | - ++ set -ex 2025-10-13 20:41:20.260096 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.260102 | controller | - ++ cat 2025-10-13 20:41:20.260107 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260113 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.260119 | controller | - ++ cat 2025-10-13 20:41:20.260124 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260130 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.260136 | controller | - ++ cat 2025-10-13 20:41:20.260141 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260147 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.260153 | controller | - ++ cat 2025-10-13 20:41:20.260158 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260164 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.260170 | controller | - + PV_NUM=20 2025-10-13 20:41:20.260179 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.260184 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.260190 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.260196 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.260201 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.260207 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.260213 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.260218 | controller | crc delete 2025-10-13 20:41:20.260224 | controller | - ++ set -ex 2025-10-13 20:41:20.260230 | controller | - ++ NODE=crc 2025-10-13 20:41:20.260235 | controller | - ++ OPERATION=delete 2025-10-13 20:41:20.260241 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.260246 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.260252 | controller | - ++ cat 2025-10-13 20:41:20.260258 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260263 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.260269 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.260275 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.260280 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.260286 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.260292 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.260297 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.260303 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.260309 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.260314 | controller | --timeout 500s 2025-10-13 20:41:20.260320 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.260326 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.260331 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.260337 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.260343 | controller | - bash scripts/retry_make_crc_storage.sh 3 2025-10-13 20:41:20.260348 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.260354 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.260360 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.260365 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.260371 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.260377 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.260382 | controller | - + cat 2025-10-13 20:41:20.260391 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.260411 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.260420 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.260426 | controller | do sleep 1; done" 2025-10-13 20:41:20.260432 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.260437 | controller | - crc-storage Active 2025-10-13 20:41:20.260443 | controller | - oc project crc-storage 2025-10-13 20:41:20.260449 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.260454 | controller | - bash scripts/create-pv.sh 2025-10-13 20:41:20.260460 | controller | - +++ dirname scripts/create-pv.sh 2025-10-13 20:41:20.260466 | controller | - ++ cd scripts 2025-10-13 20:41:20.260474 | controller | - ++ pwd -P 2025-10-13 20:41:20.260480 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.260486 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.260491 | controller | - ++ set -ex 2025-10-13 20:41:20.260497 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.260503 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260508 | controller | - ++ cat 2025-10-13 20:41:20.260522 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.260530 | controller | - ++ cat 2025-10-13 20:41:20.260537 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260545 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.260553 | controller | - ++ cat 2025-10-13 20:41:20.260559 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260568 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.260574 | controller | - ++ cat 2025-10-13 20:41:20.260580 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260585 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.260591 | controller | - + PV_NUM=20 2025-10-13 20:41:20.260597 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.260602 | controller | - ++ oc get pv -o json 2025-10-13 20:41:20.260608 | controller | - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' 2025-10-13 20:41:20.260614 | controller | - + released= 2025-10-13 20:41:20.260619 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.260625 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.260631 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.260636 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.260642 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.260648 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.260653 | controller | crc create 2025-10-13 20:41:20.260659 | controller | - ++ set -ex 2025-10-13 20:41:20.260665 | controller | - ++ NODE=crc 2025-10-13 20:41:20.260670 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.260676 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.260682 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.260687 | controller | - ++ cat 2025-10-13 20:41:20.260693 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.260699 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.260704 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.260710 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.260716 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.260721 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.260727 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.260733 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.260738 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.260744 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.260750 | controller | --timeout 500s 2025-10-13 20:41:20.260755 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.260761 | controller | - bash scripts/gen-crc-pv-kustomize.sh 2025-10-13 20:41:20.260767 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.260772 | controller | - + '[' -z '"local-storage"' ']' 2025-10-13 20:41:20.260778 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' 2025-10-13 20:41:20.260784 | controller | - + PV_NUM=20 2025-10-13 20:41:20.260789 | controller | - + STORAGE_CAPACITY=10 2025-10-13 20:41:20.260795 | controller | - ++ oc get node -o name -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.260801 | controller | - ++ head -c-1 2025-10-13 20:41:20.260809 | controller | - ++ tr '\n' ' ' 2025-10-13 20:41:20.260815 | controller | - ++ sed -e 's|node/||' 2025-10-13 20:41:20.260821 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.260826 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.260832 | controller | - + cat 2025-10-13 20:41:20.260837 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.260843 | controller | - ++ seq -w 20 2025-10-13 20:41:20.260849 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260854 | controller | - + cat 2025-10-13 20:41:20.260860 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260866 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260871 | controller | - + cat 2025-10-13 20:41:20.260877 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260883 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260888 | controller | - + cat 2025-10-13 20:41:20.260894 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260900 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260905 | controller | - + cat 2025-10-13 20:41:20.260911 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260916 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260922 | controller | - + cat 2025-10-13 20:41:20.260928 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260933 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260939 | controller | - + cat 2025-10-13 20:41:20.260945 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260950 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260957 | controller | - + cat 2025-10-13 20:41:20.260964 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260970 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260977 | controller | - + cat 2025-10-13 20:41:20.260983 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.260989 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.260997 | controller | - + cat 2025-10-13 20:41:20.261003 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261009 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261014 | controller | - + cat 2025-10-13 20:41:20.261020 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261026 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261031 | controller | - + cat 2025-10-13 20:41:20.261037 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261043 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261048 | controller | - + cat 2025-10-13 20:41:20.261054 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261059 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261065 | controller | - + cat 2025-10-13 20:41:20.261071 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261076 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261082 | controller | - + cat 2025-10-13 20:41:20.261088 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261093 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261099 | controller | - + cat 2025-10-13 20:41:20.261105 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261110 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261116 | controller | - + cat 2025-10-13 20:41:20.261121 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261127 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261133 | controller | - + cat 2025-10-13 20:41:20.261138 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261144 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261149 | controller | - + cat 2025-10-13 20:41:20.261155 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261161 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261166 | controller | - + cat 2025-10-13 20:41:20.261172 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261178 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.261183 | controller | - + cat 2025-10-13 20:41:20.261189 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.261194 | controller | - + cat 2025-10-13 20:41:20.261208 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:41:20.261216 | controller | - storageclass.storage.k8s.io/local-storage created 2025-10-13 20:41:20.261224 | controller | - persistentvolume/local-storage01-crc created 2025-10-13 20:41:20.261232 | controller | - persistentvolume/local-storage02-crc created 2025-10-13 20:41:20.261243 | controller | - persistentvolume/local-storage03-crc created 2025-10-13 20:41:20.261248 | controller | - persistentvolume/local-storage04-crc created 2025-10-13 20:41:20.261254 | controller | - persistentvolume/local-storage05-crc created 2025-10-13 20:41:20.261260 | controller | - persistentvolume/local-storage06-crc created 2025-10-13 20:41:20.261265 | controller | - persistentvolume/local-storage07-crc created 2025-10-13 20:41:20.261271 | controller | - persistentvolume/local-storage08-crc created 2025-10-13 20:41:20.261277 | controller | - persistentvolume/local-storage09-crc created 2025-10-13 20:41:20.261282 | controller | - persistentvolume/local-storage10-crc created 2025-10-13 20:41:20.261291 | controller | - persistentvolume/local-storage11-crc created 2025-10-13 20:41:20.261297 | controller | - persistentvolume/local-storage12-crc created 2025-10-13 20:41:20.261302 | controller | - persistentvolume/local-storage13-crc created 2025-10-13 20:41:20.261308 | controller | - persistentvolume/local-storage14-crc created 2025-10-13 20:41:20.261313 | controller | - persistentvolume/local-storage15-crc created 2025-10-13 20:41:20.261319 | controller | - persistentvolume/local-storage16-crc created 2025-10-13 20:41:20.261325 | controller | - persistentvolume/local-storage17-crc created 2025-10-13 20:41:20.261330 | controller | - persistentvolume/local-storage18-crc created 2025-10-13 20:41:20.261336 | controller | - persistentvolume/local-storage19-crc created 2025-10-13 20:41:20.261342 | controller | - persistentvolume/local-storage20-crc created 2025-10-13 20:41:20.261347 | controller | - persistentvolumeclaim/ansible-ee-logs unchanged 2025-10-13 20:41:20.261353 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.261359 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.261364 | controller | - '2025/10/13 20:08:06 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.261370 | controller | ]' 2025-10-13 20:41:20.261376 | controller | - === RUN kuttl 2025-10-13 20:41:20.261381 | controller | - ' harness.go:463: starting setup' 2025-10-13 20:41:20.261387 | controller | - ' harness.go:255: running tests using configured kubeconfig.' 2025-10-13 20:41:20.261396 | controller | - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' 2025-10-13 20:41:20.261413 | controller | - ' logger.go:42: 20:08:06 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.261422 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' 2025-10-13 20:41:20.261427 | controller | - ' logger.go:42: 20:08:07 | | netconfig.network.openstack.org/netconfig configured' 2025-10-13 20:41:20.261433 | controller | - ' logger.go:42: 20:08:07 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.261439 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' 2025-10-13 20:41:20.261444 | controller | - ' logger.go:42: 20:08:07 | | dnsmasq.network.openstack.org/dnsmasq configured' 2025-10-13 20:41:20.261450 | controller | - ' logger.go:42: 20:08:07 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.261456 | controller | ]; then' 2025-10-13 20:41:20.261461 | controller | - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' 2025-10-13 20:41:20.261467 | controller | - ' fi' 2025-10-13 20:41:20.261473 | controller | - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' 2025-10-13 20:41:20.261478 | controller | - ' --save-config \' 2025-10-13 20:41:20.261484 | controller | - ' --dry-run=client \' 2025-10-13 20:41:20.261490 | controller | - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.261495 | controller | - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' 2025-10-13 20:41:20.261501 | controller | - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.261510 | controller | - ' -n openstack-kuttl-tests \' 2025-10-13 20:41:20.261515 | controller | - ' -o yaml | \' 2025-10-13 20:41:20.261521 | controller | - ' oc apply -f -' 2025-10-13 20:41:20.261527 | controller | - ' ]' 2025-10-13 20:41:20.261532 | controller | - ' logger.go:42: 20:08:07 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.261538 | controller | configured' 2025-10-13 20:41:20.261544 | controller | - ' harness.go:363: running tests' 2025-10-13 20:41:20.261549 | controller | - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each 2025-10-13 20:41:20.261558 | controller | step' 2025-10-13 20:41:20.261565 | controller | - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.261571 | controller | has 19 tests' 2025-10-13 20:41:20.261577 | controller | - === RUN kuttl/harness 2025-10-13 20:41:20.261582 | controller | - === RUN kuttl/harness/ctlplane-galera-basic 2025-10-13 20:41:20.261588 | controller | - === PAUSE kuttl/harness/ctlplane-galera-basic 2025-10-13 20:41:20.261594 | controller | - === CONT kuttl/harness/ctlplane-galera-basic 2025-10-13 20:41:20.261599 | controller | - ' logger.go:42: 20:08:07 | ctlplane-galera-basic | Skipping creation of user-supplied 2025-10-13 20:41:20.261605 | controller | namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.261611 | controller | - ' logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera | starting test 2025-10-13 20:41:20.261616 | controller | step 1-deploy-galera' 2025-10-13 20:41:20.261622 | controller | - ' logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera | running command: 2025-10-13 20:41:20.261636 | controller | [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera.yaml' 2025-10-13 20:41:20.261644 | controller | - ' ]' 2025-10-13 20:41:20.261652 | controller | - ' logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | Warning: spec.galera.template[openstack].storageRequest: 2025-10-13 20:41:20.261660 | controller | 500M is not appropriate for production! For production use at least 5G!' 2025-10-13 20:41:20.261667 | controller | - ' logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | Warning: spec.galera.template[openstack-cell1].storageRequest: 2025-10-13 20:41:20.261674 | controller | 500M is not appropriate for production! For production use at least 5G!' 2025-10-13 20:41:20.261680 | controller | - ' logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | openstackcontrolplane.core.openstack.org/openstack-galera 2025-10-13 20:41:20.261686 | controller | created' 2025-10-13 20:41:20.261691 | controller | - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/1-deploy-galera | test step 2025-10-13 20:41:20.261697 | controller | completed 1-deploy-galera' 2025-10-13 20:41:20.261703 | controller | - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | starting test step 2025-10-13 20:41:20.261708 | controller | 2-cleanup' 2025-10-13 20:41:20.261714 | controller | - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | running command: 2025-10-13 20:41:20.261720 | controller | [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' 2025-10-13 20:41:20.261725 | controller | - ' mysql-db-openstack-galera-0 \' 2025-10-13 20:41:20.261731 | controller | - ' mysql-db-openstack-cell1-galera-0 \' 2025-10-13 20:41:20.261737 | controller | - ' srv-swift-storage-0' 2025-10-13 20:41:20.261742 | controller | - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' 2025-10-13 20:41:20.261748 | controller | - ' oc delete secret -l service-cert -n $NAMESPACE' 2025-10-13 20:41:20.261754 | controller | - ' oc delete secret -l ca-cert -n $NAMESPACE' 2025-10-13 20:41:20.261759 | controller | - ' ]' 2025-10-13 20:41:20.261765 | controller | - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.261771 | controller | "mysql-db-openstack-galera-0" deleted' 2025-10-13 20:41:20.261777 | controller | - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | persistentvolumeclaim 2025-10-13 20:41:20.261782 | controller | "mysql-db-openstack-cell1-galera-0" deleted' 2025-10-13 20:41:20.261794 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "combined-ca-bundle" 2025-10-13 20:41:20.261800 | controller | deleted' 2025-10-13 20:41:20.261805 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-barbican-internal-svc" 2025-10-13 20:41:20.261811 | controller | deleted' 2025-10-13 20:41:20.261817 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-barbican-public-route" 2025-10-13 20:41:20.261822 | controller | deleted' 2025-10-13 20:41:20.261828 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-barbican-public-svc" 2025-10-13 20:41:20.261834 | controller | deleted' 2025-10-13 20:41:20.261839 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ceilometer-internal-svc" 2025-10-13 20:41:20.261845 | controller | deleted' 2025-10-13 20:41:20.261851 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-cinder-internal-svc" 2025-10-13 20:41:20.261856 | controller | deleted' 2025-10-13 20:41:20.261862 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-cinder-public-route" 2025-10-13 20:41:20.261868 | controller | deleted' 2025-10-13 20:41:20.261873 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-cinder-public-svc" 2025-10-13 20:41:20.261879 | controller | deleted' 2025-10-13 20:41:20.261885 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-galera-openstack-cell1-svc" 2025-10-13 20:41:20.261890 | controller | deleted' 2025-10-13 20:41:20.261899 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-galera-openstack-svc" 2025-10-13 20:41:20.261905 | controller | deleted' 2025-10-13 20:41:20.261910 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-glance-default-internal-svc" 2025-10-13 20:41:20.261916 | controller | deleted' 2025-10-13 20:41:20.261922 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-glance-default-public-route" 2025-10-13 20:41:20.261927 | controller | deleted' 2025-10-13 20:41:20.261933 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-glance-default-public-svc" 2025-10-13 20:41:20.261939 | controller | deleted' 2025-10-13 20:41:20.261944 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-keystone-internal-svc" 2025-10-13 20:41:20.261950 | controller | deleted' 2025-10-13 20:41:20.261956 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-keystone-public-route" 2025-10-13 20:41:20.261961 | controller | deleted' 2025-10-13 20:41:20.261967 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-keystone-public-svc" 2025-10-13 20:41:20.261973 | controller | deleted' 2025-10-13 20:41:20.261978 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-kube-state-metrics-svc" 2025-10-13 20:41:20.261984 | controller | deleted' 2025-10-13 20:41:20.261990 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-memcached-svc" 2025-10-13 20:41:20.261995 | controller | deleted' 2025-10-13 20:41:20.262001 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-internal-svc" 2025-10-13 20:41:20.262007 | controller | deleted' 2025-10-13 20:41:20.262012 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-ovndbs" 2025-10-13 20:41:20.262018 | controller | deleted' 2025-10-13 20:41:20.262032 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-public-route" 2025-10-13 20:41:20.262040 | controller | deleted' 2025-10-13 20:41:20.262047 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-public-svc" 2025-10-13 20:41:20.262055 | controller | deleted' 2025-10-13 20:41:20.262062 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-internal-svc" 2025-10-13 20:41:20.262068 | controller | deleted' 2025-10-13 20:41:20.262076 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-novncproxy-cell1-public-route" 2025-10-13 20:41:20.262082 | controller | deleted' 2025-10-13 20:41:20.262088 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" 2025-10-13 20:41:20.262094 | controller | deleted' 2025-10-13 20:41:20.262099 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" 2025-10-13 20:41:20.262105 | controller | deleted' 2025-10-13 20:41:20.262111 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-public-route" 2025-10-13 20:41:20.262116 | controller | deleted' 2025-10-13 20:41:20.262122 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-public-svc" 2025-10-13 20:41:20.262128 | controller | deleted' 2025-10-13 20:41:20.262133 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovn-metrics" 2025-10-13 20:41:20.262139 | controller | deleted' 2025-10-13 20:41:20.262144 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovndbcluster-nb-ovndbs" 2025-10-13 20:41:20.262150 | controller | deleted' 2025-10-13 20:41:20.262156 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovndbcluster-sb-ovndbs" 2025-10-13 20:41:20.262161 | controller | deleted' 2025-10-13 20:41:20.262167 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovnnorthd-ovndbs" 2025-10-13 20:41:20.262173 | controller | deleted' 2025-10-13 20:41:20.262178 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-placement-internal-svc" 2025-10-13 20:41:20.262184 | controller | deleted' 2025-10-13 20:41:20.262190 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-placement-public-route" 2025-10-13 20:41:20.262195 | controller | deleted' 2025-10-13 20:41:20.262201 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-placement-public-svc" 2025-10-13 20:41:20.262207 | controller | deleted' 2025-10-13 20:41:20.262212 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-rabbitmq-cell1-svc" 2025-10-13 20:41:20.262218 | controller | deleted' 2025-10-13 20:41:20.262224 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-rabbitmq-svc" 2025-10-13 20:41:20.262229 | controller | deleted' 2025-10-13 20:41:20.262235 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-swift-internal-svc" 2025-10-13 20:41:20.262241 | controller | deleted' 2025-10-13 20:41:20.262246 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-swift-public-route" 2025-10-13 20:41:20.262252 | controller | deleted' 2025-10-13 20:41:20.262260 | controller | - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-swift-public-svc" 2025-10-13 20:41:20.262265 | controller | deleted' 2025-10-13 20:41:20.262271 | controller | - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-internal" 2025-10-13 20:41:20.262277 | controller | deleted' 2025-10-13 20:41:20.262283 | controller | - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-libvirt" 2025-10-13 20:41:20.262288 | controller | deleted' 2025-10-13 20:41:20.262297 | controller | - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-ovn" 2025-10-13 20:41:20.262303 | controller | deleted' 2025-10-13 20:41:20.262309 | controller | - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-public" 2025-10-13 20:41:20.262314 | controller | deleted' 2025-10-13 20:41:20.262320 | controller | - ' logger.go:42: 20:12:39 | ctlplane-galera-basic/2-cleanup | test step completed 2025-10-13 20:41:20.262326 | controller | 2-cleanup' 2025-10-13 20:41:20.262331 | controller | - ' logger.go:42: 20:12:39 | ctlplane-galera-basic | skipping kubernetes event 2025-10-13 20:41:20.262337 | controller | logging' 2025-10-13 20:41:20.262343 | controller | - === NAME kuttl 2025-10-13 20:41:20.262352 | controller | - ' harness.go:406: run tests finished' 2025-10-13 20:41:20.262371 | controller | - ' harness.go:514: cleaning up' 2025-10-13 20:41:20.262378 | controller | - ' harness.go:571: removing temp folder: ""' 2025-10-13 20:41:20.262385 | controller | - '--- PASS: kuttl (272.65s)' 2025-10-13 20:41:20.262392 | controller | - ' --- PASS: kuttl/harness (0.00s)' 2025-10-13 20:41:20.262399 | controller | - ' --- PASS: kuttl/harness/ctlplane-galera-basic (271.12s)' 2025-10-13 20:41:20.262421 | controller | - PASS 2025-10-13 20:41:20.262427 | controller | - No resources found 2025-10-13 20:41:20.262433 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.262438 | controller | - bash scripts/retry_make_crc_storage_cleanup.sh 3 2025-10-13 20:41:20.262444 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.262450 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.262455 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.262465 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.262471 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.262476 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.262482 | controller | - + cat 2025-10-13 20:41:20.262488 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.262493 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.262507 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.262515 | controller | do sleep 1; done" 2025-10-13 20:41:20.262523 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.262531 | controller | - crc-storage Active 2025-10-13 20:41:20.262538 | controller | - oc project crc-storage 2025-10-13 20:41:20.262546 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.262552 | controller | - bash scripts/cleanup-crc-pv.sh 2025-10-13 20:41:20.262557 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.262563 | controller | - ++ awk '{print $6}' 2025-10-13 20:41:20.262569 | controller | - ++ grep Bound 2025-10-13 20:41:20.262575 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.262580 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.262586 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.262592 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.262597 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.262603 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.262609 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.262615 | controller | - + NAME=swift-swift-storage-0 2025-10-13 20:41:20.262620 | controller | - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found 2025-10-13 20:41:20.262626 | controller | - persistentvolumeclaim "swift-swift-storage-0" deleted 2025-10-13 20:41:20.262632 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.262637 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.262643 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.262649 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.262655 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.262660 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.262666 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.262672 | controller | - + NAME=glance-glance-default-internal-api-0 2025-10-13 20:41:20.262677 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found 2025-10-13 20:41:20.262683 | controller | - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted 2025-10-13 20:41:20.262689 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.262698 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.262704 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.262709 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.262715 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.262721 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.262726 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.262732 | controller | - + NAME=glance-glance-default-external-api-0 2025-10-13 20:41:20.262738 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found 2025-10-13 20:41:20.262743 | controller | - persistentvolumeclaim "glance-glance-default-external-api-0" deleted 2025-10-13 20:41:20.262749 | controller | - ++ awk '{print $1}' 2025-10-13 20:41:20.262755 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.262760 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262766 | controller | '{print $1}'` 2025-10-13 20:41:20.262772 | controller | - + oc delete pv/local-storage01-crc 2025-10-13 20:41:20.262781 | controller | - persistentvolume "local-storage01-crc" deleted 2025-10-13 20:41:20.262786 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262792 | controller | '{print $1}'` 2025-10-13 20:41:20.262798 | controller | - + oc delete pv/local-storage02-crc 2025-10-13 20:41:20.262804 | controller | - persistentvolume "local-storage02-crc" deleted 2025-10-13 20:41:20.262810 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262815 | controller | '{print $1}'` 2025-10-13 20:41:20.262821 | controller | - + oc delete pv/local-storage03-crc 2025-10-13 20:41:20.262827 | controller | - persistentvolume "local-storage03-crc" deleted 2025-10-13 20:41:20.262833 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262838 | controller | '{print $1}'` 2025-10-13 20:41:20.262844 | controller | - + oc delete pv/local-storage04-crc 2025-10-13 20:41:20.262850 | controller | - persistentvolume "local-storage04-crc" deleted 2025-10-13 20:41:20.262855 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262861 | controller | '{print $1}'` 2025-10-13 20:41:20.262867 | controller | - + oc delete pv/local-storage05-crc 2025-10-13 20:41:20.262872 | controller | - persistentvolume "local-storage05-crc" deleted 2025-10-13 20:41:20.262878 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262884 | controller | '{print $1}'` 2025-10-13 20:41:20.262889 | controller | - + oc delete pv/local-storage06-crc 2025-10-13 20:41:20.262895 | controller | - persistentvolume "local-storage06-crc" deleted 2025-10-13 20:41:20.262901 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262907 | controller | '{print $1}'` 2025-10-13 20:41:20.262912 | controller | - + oc delete pv/local-storage07-crc 2025-10-13 20:41:20.262918 | controller | - persistentvolume "local-storage07-crc" deleted 2025-10-13 20:41:20.262924 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262929 | controller | '{print $1}'` 2025-10-13 20:41:20.262935 | controller | - + oc delete pv/local-storage08-crc 2025-10-13 20:41:20.262941 | controller | - persistentvolume "local-storage08-crc" deleted 2025-10-13 20:41:20.262947 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262952 | controller | '{print $1}'` 2025-10-13 20:41:20.262960 | controller | - + oc delete pv/local-storage09-crc 2025-10-13 20:41:20.262966 | controller | - persistentvolume "local-storage09-crc" deleted 2025-10-13 20:41:20.262972 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.262979 | controller | '{print $1}'` 2025-10-13 20:41:20.262993 | controller | - + oc delete pv/local-storage10-crc 2025-10-13 20:41:20.263001 | controller | - persistentvolume "local-storage10-crc" deleted 2025-10-13 20:41:20.263009 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263020 | controller | '{print $1}'` 2025-10-13 20:41:20.263028 | controller | - + oc delete pv/local-storage11-crc 2025-10-13 20:41:20.263035 | controller | - persistentvolume "local-storage11-crc" deleted 2025-10-13 20:41:20.263042 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263049 | controller | '{print $1}'` 2025-10-13 20:41:20.263056 | controller | - + oc delete pv/local-storage12-crc 2025-10-13 20:41:20.263063 | controller | - persistentvolume "local-storage12-crc" deleted 2025-10-13 20:41:20.263069 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263075 | controller | '{print $1}'` 2025-10-13 20:41:20.263081 | controller | - + oc delete pv/local-storage13-crc 2025-10-13 20:41:20.263086 | controller | - persistentvolume "local-storage13-crc" deleted 2025-10-13 20:41:20.263092 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263098 | controller | '{print $1}'` 2025-10-13 20:41:20.263103 | controller | - + oc delete pv/local-storage14-crc 2025-10-13 20:41:20.263109 | controller | - persistentvolume "local-storage14-crc" deleted 2025-10-13 20:41:20.263115 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263121 | controller | '{print $1}'` 2025-10-13 20:41:20.263130 | controller | - + oc delete pv/local-storage15-crc 2025-10-13 20:41:20.263135 | controller | - persistentvolume "local-storage15-crc" deleted 2025-10-13 20:41:20.263141 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263147 | controller | '{print $1}'` 2025-10-13 20:41:20.263153 | controller | - + oc delete pv/local-storage16-crc 2025-10-13 20:41:20.263158 | controller | - persistentvolume "local-storage16-crc" deleted 2025-10-13 20:41:20.263164 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263170 | controller | '{print $1}'` 2025-10-13 20:41:20.263175 | controller | - + oc delete pv/local-storage17-crc 2025-10-13 20:41:20.263181 | controller | - persistentvolume "local-storage17-crc" deleted 2025-10-13 20:41:20.263187 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263193 | controller | '{print $1}'` 2025-10-13 20:41:20.263201 | controller | - + oc delete pv/local-storage18-crc 2025-10-13 20:41:20.263206 | controller | - persistentvolume "local-storage18-crc" deleted 2025-10-13 20:41:20.263212 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263218 | controller | '{print $1}'` 2025-10-13 20:41:20.263223 | controller | - + oc delete pv/local-storage19-crc 2025-10-13 20:41:20.263229 | controller | - persistentvolume "local-storage19-crc" deleted 2025-10-13 20:41:20.263237 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.263243 | controller | '{print $1}'` 2025-10-13 20:41:20.263248 | controller | - + oc delete pv/local-storage20-crc 2025-10-13 20:41:20.263254 | controller | - persistentvolume "local-storage20-crc" deleted 2025-10-13 20:41:20.263260 | controller | - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi 2025-10-13 20:41:20.263265 | controller | - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE 2025-10-13 20:41:20.263271 | controller | - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 4m41s 2025-10-13 20:41:20.263277 | controller | - storageclass.storage.k8s.io "local-storage" deleted 2025-10-13 20:41:20.263283 | controller | - bash scripts/delete-pv.sh 2025-10-13 20:41:20.263288 | controller | - +++ dirname scripts/delete-pv.sh 2025-10-13 20:41:20.263294 | controller | - ++ cd scripts 2025-10-13 20:41:20.263300 | controller | - ++ pwd -P 2025-10-13 20:41:20.263305 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.263311 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.263320 | controller | - ++ set -ex 2025-10-13 20:41:20.263325 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.263331 | controller | - ++ cat 2025-10-13 20:41:20.263337 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263343 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.263348 | controller | - ++ cat 2025-10-13 20:41:20.263354 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263360 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.263366 | controller | - ++ cat 2025-10-13 20:41:20.263371 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263377 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.263383 | controller | - ++ cat 2025-10-13 20:41:20.263388 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263397 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.263415 | controller | - + PV_NUM=20 2025-10-13 20:41:20.263423 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.263429 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.263435 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.263440 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.263446 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.263452 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.263457 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.263463 | controller | crc delete 2025-10-13 20:41:20.263469 | controller | - ++ set -ex 2025-10-13 20:41:20.263474 | controller | - ++ NODE=crc 2025-10-13 20:41:20.263480 | controller | - ++ OPERATION=delete 2025-10-13 20:41:20.263486 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.263491 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.263497 | controller | - ++ cat 2025-10-13 20:41:20.263503 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263508 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.263514 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.263520 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.263534 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.263542 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.263550 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.263557 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.263565 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.263572 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.263577 | controller | --timeout 500s 2025-10-13 20:41:20.263583 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.263589 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.263594 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.263600 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.263606 | controller | - bash scripts/retry_make_crc_storage.sh 3 2025-10-13 20:41:20.263611 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.263617 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.263623 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.263628 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.263638 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.263643 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.263649 | controller | - + cat 2025-10-13 20:41:20.263658 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.263663 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.263669 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.263675 | controller | do sleep 1; done" 2025-10-13 20:41:20.263680 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.263686 | controller | - crc-storage Active 2025-10-13 20:41:20.263692 | controller | - oc project crc-storage 2025-10-13 20:41:20.263697 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.263703 | controller | - bash scripts/create-pv.sh 2025-10-13 20:41:20.263709 | controller | - +++ dirname scripts/create-pv.sh 2025-10-13 20:41:20.263715 | controller | - ++ cd scripts 2025-10-13 20:41:20.263720 | controller | - ++ pwd -P 2025-10-13 20:41:20.263726 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.263732 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.263737 | controller | - ++ set -ex 2025-10-13 20:41:20.263743 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.263749 | controller | - ++ cat 2025-10-13 20:41:20.263754 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263760 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.263766 | controller | - ++ cat 2025-10-13 20:41:20.263771 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263777 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.263783 | controller | - ++ cat 2025-10-13 20:41:20.263788 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263794 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.263800 | controller | - ++ cat 2025-10-13 20:41:20.263805 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263811 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.263817 | controller | - + PV_NUM=20 2025-10-13 20:41:20.263822 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.263828 | controller | - ++ oc get pv -o json 2025-10-13 20:41:20.263834 | controller | - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' 2025-10-13 20:41:20.263839 | controller | - + released= 2025-10-13 20:41:20.263845 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.263851 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.263856 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.263862 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.263868 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.263873 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.263879 | controller | crc create 2025-10-13 20:41:20.263885 | controller | - ++ set -ex 2025-10-13 20:41:20.263890 | controller | - ++ NODE=crc 2025-10-13 20:41:20.263896 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.263902 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.263907 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.263913 | controller | - ++ cat 2025-10-13 20:41:20.263919 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.263924 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.263930 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.263936 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.263941 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.263947 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.263953 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.263958 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.263964 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.263975 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.263981 | controller | --timeout 500s 2025-10-13 20:41:20.263987 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.263992 | controller | - bash scripts/gen-crc-pv-kustomize.sh 2025-10-13 20:41:20.263998 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.264004 | controller | - + '[' -z '"local-storage"' ']' 2025-10-13 20:41:20.264018 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' 2025-10-13 20:41:20.264026 | controller | - + PV_NUM=20 2025-10-13 20:41:20.264033 | controller | - + STORAGE_CAPACITY=10 2025-10-13 20:41:20.264041 | controller | - ++ oc get node -o name -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.264048 | controller | - ++ head -c-1 2025-10-13 20:41:20.264054 | controller | - ++ sed -e 's|node/||' 2025-10-13 20:41:20.264060 | controller | - ++ tr '\n' ' ' 2025-10-13 20:41:20.264065 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.264071 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.264077 | controller | - + cat 2025-10-13 20:41:20.264082 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.264088 | controller | - ++ seq -w 20 2025-10-13 20:41:20.264094 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264099 | controller | - + cat 2025-10-13 20:41:20.264105 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264111 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264117 | controller | - + cat 2025-10-13 20:41:20.264122 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264128 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264137 | controller | - + cat 2025-10-13 20:41:20.264143 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264149 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264155 | controller | - + cat 2025-10-13 20:41:20.264160 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264166 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264172 | controller | - + cat 2025-10-13 20:41:20.264177 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264183 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264189 | controller | - + cat 2025-10-13 20:41:20.264194 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264200 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264206 | controller | - + cat 2025-10-13 20:41:20.264211 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264217 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264223 | controller | - + cat 2025-10-13 20:41:20.264228 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264234 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264240 | controller | - + cat 2025-10-13 20:41:20.264245 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264251 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264257 | controller | - + cat 2025-10-13 20:41:20.264262 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264268 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264274 | controller | - + cat 2025-10-13 20:41:20.264279 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264285 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264291 | controller | - + cat 2025-10-13 20:41:20.264296 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264302 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264307 | controller | - + cat 2025-10-13 20:41:20.264313 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264319 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264324 | controller | - + cat 2025-10-13 20:41:20.264330 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264336 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264342 | controller | - + cat 2025-10-13 20:41:20.264347 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264353 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264359 | controller | - + cat 2025-10-13 20:41:20.264364 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264370 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264376 | controller | - + cat 2025-10-13 20:41:20.264381 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264390 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264399 | controller | - + cat 2025-10-13 20:41:20.264419 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264425 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264431 | controller | - + cat 2025-10-13 20:41:20.264436 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264442 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.264448 | controller | - + cat 2025-10-13 20:41:20.264453 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.264459 | controller | - + cat 2025-10-13 20:41:20.264465 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:41:20.264470 | controller | - storageclass.storage.k8s.io/local-storage created 2025-10-13 20:41:20.264476 | controller | - persistentvolume/local-storage01-crc created 2025-10-13 20:41:20.264482 | controller | - persistentvolume/local-storage02-crc created 2025-10-13 20:41:20.264487 | controller | - persistentvolume/local-storage03-crc created 2025-10-13 20:41:20.264493 | controller | - persistentvolume/local-storage04-crc created 2025-10-13 20:41:20.264499 | controller | - persistentvolume/local-storage05-crc created 2025-10-13 20:41:20.264504 | controller | - persistentvolume/local-storage06-crc created 2025-10-13 20:41:20.264510 | controller | - persistentvolume/local-storage07-crc created 2025-10-13 20:41:20.264516 | controller | - persistentvolume/local-storage08-crc created 2025-10-13 20:41:20.264521 | controller | - persistentvolume/local-storage09-crc created 2025-10-13 20:41:20.264527 | controller | - persistentvolume/local-storage10-crc created 2025-10-13 20:41:20.264533 | controller | - persistentvolume/local-storage11-crc created 2025-10-13 20:41:20.264538 | controller | - persistentvolume/local-storage12-crc created 2025-10-13 20:41:20.264544 | controller | - persistentvolume/local-storage13-crc created 2025-10-13 20:41:20.264549 | controller | - persistentvolume/local-storage14-crc created 2025-10-13 20:41:20.264555 | controller | - persistentvolume/local-storage15-crc created 2025-10-13 20:41:20.264561 | controller | - persistentvolume/local-storage16-crc created 2025-10-13 20:41:20.264566 | controller | - persistentvolume/local-storage17-crc created 2025-10-13 20:41:20.264572 | controller | - persistentvolume/local-storage18-crc created 2025-10-13 20:41:20.264577 | controller | - persistentvolume/local-storage19-crc created 2025-10-13 20:41:20.264583 | controller | - persistentvolume/local-storage20-crc created 2025-10-13 20:41:20.264589 | controller | - persistentvolumeclaim/ansible-ee-logs unchanged 2025-10-13 20:41:20.264594 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.264600 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.264606 | controller | - '2025/10/13 20:13:01 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.264612 | controller | ]' 2025-10-13 20:41:20.264617 | controller | - === RUN kuttl 2025-10-13 20:41:20.264623 | controller | - ' harness.go:463: starting setup' 2025-10-13 20:41:20.264629 | controller | - ' harness.go:255: running tests using configured kubeconfig.' 2025-10-13 20:41:20.264634 | controller | - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' 2025-10-13 20:41:20.264640 | controller | - ' logger.go:42: 20:13:01 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.264646 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' 2025-10-13 20:41:20.264663 | controller | - ' logger.go:42: 20:13:02 | | netconfig.network.openstack.org/netconfig configured' 2025-10-13 20:41:20.264670 | controller | - ' logger.go:42: 20:13:02 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.264678 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' 2025-10-13 20:41:20.264685 | controller | - ' logger.go:42: 20:13:03 | | dnsmasq.network.openstack.org/dnsmasq configured' 2025-10-13 20:41:20.264698 | controller | - ' logger.go:42: 20:13:03 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.264705 | controller | ]; then' 2025-10-13 20:41:20.264710 | controller | - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' 2025-10-13 20:41:20.264716 | controller | - ' fi' 2025-10-13 20:41:20.264722 | controller | - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' 2025-10-13 20:41:20.264727 | controller | - ' --save-config \' 2025-10-13 20:41:20.264733 | controller | - ' --dry-run=client \' 2025-10-13 20:41:20.264739 | controller | - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.264749 | controller | - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' 2025-10-13 20:41:20.264754 | controller | - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.264760 | controller | - ' -n openstack-kuttl-tests \' 2025-10-13 20:41:20.264766 | controller | - ' -o yaml | \' 2025-10-13 20:41:20.264771 | controller | - ' oc apply -f -' 2025-10-13 20:41:20.264777 | controller | - ' ]' 2025-10-13 20:41:20.264783 | controller | - ' logger.go:42: 20:13:03 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.264788 | controller | configured' 2025-10-13 20:41:20.264794 | controller | - ' harness.go:363: running tests' 2025-10-13 20:41:20.264800 | controller | - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each 2025-10-13 20:41:20.264805 | controller | step' 2025-10-13 20:41:20.264811 | controller | - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.264817 | controller | has 19 tests' 2025-10-13 20:41:20.264823 | controller | - === RUN kuttl/harness 2025-10-13 20:41:20.264828 | controller | - === RUN kuttl/harness/ctlplane-nodeselectors 2025-10-13 20:41:20.264834 | controller | - === PAUSE kuttl/harness/ctlplane-nodeselectors 2025-10-13 20:41:20.264840 | controller | - === CONT kuttl/harness/ctlplane-nodeselectors 2025-10-13 20:41:20.264845 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors | Skipping creation of user-supplied 2025-10-13 20:41:20.264851 | controller | namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.264857 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | starting 2025-10-13 20:41:20.264863 | controller | test step 1-deploy-openstack' 2025-10-13 20:41:20.264868 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | running 2025-10-13 20:41:20.264874 | controller | command: [sh -c oc annotate namespace $NAMESPACE openshift.io/node-selector="beta.kubernetes.io/os=linux"' 2025-10-13 20:41:20.264880 | controller | - ' ]' 2025-10-13 20:41:20.264885 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | namespace/openstack-kuttl-tests 2025-10-13 20:41:20.264891 | controller | annotated' 2025-10-13 20:41:20.264897 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | running 2025-10-13 20:41:20.264905 | controller | command: [sh -c oc kustomize ../../../../config/samples/nodeselectors/global | oc 2025-10-13 20:41:20.264911 | controller | apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.264916 | controller | - ' ]' 2025-10-13 20:41:20.264922 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | Warning: 2025-10-13 20:41:20.264928 | controller | spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! 2025-10-13 20:41:20.264933 | controller | For production use at least 5G!' 2025-10-13 20:41:20.264939 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | Warning: 2025-10-13 20:41:20.264945 | controller | spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for 2025-10-13 20:41:20.264950 | controller | production! For production use at least 5G!' 2025-10-13 20:41:20.264956 | controller | - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.264964 | controller | created' 2025-10-13 20:41:20.264970 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/1-deploy-openstack | test step 2025-10-13 20:41:20.264979 | controller | completed 1-deploy-openstack' 2025-10-13 20:41:20.264984 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | starting test step 2-' 2025-10-13 20:41:20.264990 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | running command: [sh -c 2025-10-13 20:41:20.264996 | controller | echo "Checking all pods have expected nodeselector"' 2025-10-13 20:41:20.265001 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:"' 2025-10-13 20:41:20.265007 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.265013 | controller | -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector 2025-10-13 20:41:20.265018 | controller | }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' 2025-10-13 20:41:20.265024 | controller | | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.265030 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.265035 | controller | | wc -l)' 2025-10-13 20:41:20.265049 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.265057 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.265065 | controller | nodeselector:"' 2025-10-13 20:41:20.265072 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.265079 | controller | - ' exit 1' 2025-10-13 20:41:20.265085 | controller | - ' fi' 2025-10-13 20:41:20.265091 | controller | - ' ]' 2025-10-13 20:41:20.265097 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all pods have 2025-10-13 20:41:20.265102 | controller | expected nodeselector' 2025-10-13 20:41:20.265108 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | running command: [sh -c 2025-10-13 20:41:20.265114 | controller | echo "Checking all cronjobs have expected nodeselector"' 2025-10-13 20:41:20.265120 | controller | - ' EXPECTED_NODE_SELECTOR="node-role.kubernetes.io/worker:"' 2025-10-13 20:41:20.265125 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get cronjobs -n $NAMESPACE -o=go-template 2025-10-13 20:41:20.265131 | controller | --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.jobTemplate.spec.template.spec.nodeSelector 2025-10-13 20:41:20.265137 | controller | }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' 2025-10-13 20:41:20.265142 | controller | | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.265148 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.265154 | controller | | wc -l)' 2025-10-13 20:41:20.265159 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.265165 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs with bad or 2025-10-13 20:41:20.265171 | controller | missing nodeselector:"' 2025-10-13 20:41:20.265177 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.265182 | controller | - ' exit 1' 2025-10-13 20:41:20.265188 | controller | - ' fi' 2025-10-13 20:41:20.265194 | controller | - ' ]' 2025-10-13 20:41:20.265199 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all cronjobs 2025-10-13 20:41:20.265205 | controller | have expected nodeselector' 2025-10-13 20:41:20.265211 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | test step completed 2-' 2025-10-13 20:41:20.265216 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector | starting 2025-10-13 20:41:20.265222 | controller | test step 3-update-nodeselector' 2025-10-13 20:41:20.265228 | controller | - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector | running 2025-10-13 20:41:20.265233 | controller | command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack --type=''json'' 2025-10-13 20:41:20.265242 | controller | -p=''[{' 2025-10-13 20:41:20.265248 | controller | - ' "op": "replace",' 2025-10-13 20:41:20.265254 | controller | - ' "path": "/spec/nodeSelector",' 2025-10-13 20:41:20.265259 | controller | - ' "value": {"kubernetes.io/os":"linux"}' 2025-10-13 20:41:20.265265 | controller | - ' }]''' 2025-10-13 20:41:20.265271 | controller | - ' ]' 2025-10-13 20:41:20.265277 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.265282 | controller | patched' 2025-10-13 20:41:20.265288 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector | test 2025-10-13 20:41:20.265294 | controller | step completed 3-update-nodeselector' 2025-10-13 20:41:20.265299 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | starting test step 4-' 2025-10-13 20:41:20.265305 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.265311 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.265316 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.265322 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.265328 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.265333 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.265339 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.265345 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.265351 | controller | | wc -l)' 2025-10-13 20:41:20.265356 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.265362 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.265368 | controller | nodeselector:"' 2025-10-13 20:41:20.265373 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.265379 | controller | - ' exit 1' 2025-10-13 20:41:20.265388 | controller | - ' fi' 2025-10-13 20:41:20.265397 | controller | - ' ]' 2025-10-13 20:41:20.265414 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.265423 | controller | have new nodeselector' 2025-10-13 20:41:20.265429 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | Found 28 pods with bad 2025-10-13 20:41:20.265434 | controller | or missing nodeselector:' 2025-10-13 20:41:20.265440 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.265446 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265452 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.265458 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265471 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.265480 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265488 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265495 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265503 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265509 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265515 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265521 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265526 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.265536 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265542 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.265547 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265553 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.265559 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265565 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | kube-state-metrics-0: 2025-10-13 20:41:20.265570 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265576 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265582 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265587 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.265593 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265599 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265605 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265610 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.265616 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265625 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.265631 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265637 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: 2025-10-13 20:41:20.265642 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265648 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265654 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265659 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265665 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265671 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: 2025-10-13 20:41:20.265677 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265682 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265688 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265694 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265700 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265708 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265714 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265719 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265725 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265731 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265737 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265742 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.265748 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265754 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.265762 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265768 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265774 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265779 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.265785 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265799 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265806 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265814 | controller | - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.265822 | controller | 1 additional commands' 2025-10-13 20:41:20.265836 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.265841 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.265847 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.265853 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.265858 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.265864 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.265870 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.265876 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.265881 | controller | | wc -l)' 2025-10-13 20:41:20.265887 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.265893 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.265898 | controller | nodeselector:"' 2025-10-13 20:41:20.265904 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.265910 | controller | - ' exit 1' 2025-10-13 20:41:20.265915 | controller | - ' fi' 2025-10-13 20:41:20.265921 | controller | - ' ]' 2025-10-13 20:41:20.265927 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.265933 | controller | have new nodeselector' 2025-10-13 20:41:20.265938 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | Found 28 pods with bad 2025-10-13 20:41:20.265944 | controller | or missing nodeselector:' 2025-10-13 20:41:20.265950 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.265955 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265961 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.265967 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265972 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.265978 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265984 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.265990 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.265995 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266001 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266007 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266015 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266021 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.266027 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266033 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.266038 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266044 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.266050 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266058 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | kube-state-metrics-0: 2025-10-13 20:41:20.266066 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266071 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266077 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266083 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.266088 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266094 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266100 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266105 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.266111 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266117 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.266122 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266128 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: 2025-10-13 20:41:20.266134 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266147 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266155 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266163 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266170 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266177 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: 2025-10-13 20:41:20.266183 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266189 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266194 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266200 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266206 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266211 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266217 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266223 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266228 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266234 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266240 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266245 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.266251 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266260 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.266266 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266271 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266277 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266283 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.266288 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266294 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266300 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266305 | controller | - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.266311 | controller | 1 additional commands' 2025-10-13 20:41:20.266317 | controller | - ' logger.go:42: 20:17:22 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.266322 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.266328 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.266334 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.266339 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.266345 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.266351 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.266356 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.266362 | controller | | wc -l)' 2025-10-13 20:41:20.266368 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.266374 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.266379 | controller | nodeselector:"' 2025-10-13 20:41:20.266389 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.266422 | controller | - ' exit 1' 2025-10-13 20:41:20.266430 | controller | - ' fi' 2025-10-13 20:41:20.266437 | controller | - ' ]' 2025-10-13 20:41:20.266444 | controller | - ' logger.go:42: 20:17:22 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.266451 | controller | have new nodeselector' 2025-10-13 20:41:20.266459 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | Found 25 pods with bad 2025-10-13 20:41:20.266466 | controller | or missing nodeselector:' 2025-10-13 20:41:20.266474 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.266481 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266488 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.266495 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266503 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.266510 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266517 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266524 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266541 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266549 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266556 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266568 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266576 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.266584 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266591 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.266599 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266606 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.266613 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266619 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | kube-state-metrics-0: 2025-10-13 20:41:20.266626 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266633 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.266639 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266645 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266650 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266656 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.266662 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266668 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.266673 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266679 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: 2025-10-13 20:41:20.266684 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266690 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266696 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266701 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266707 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266713 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: 2025-10-13 20:41:20.266718 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266724 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266730 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266735 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266741 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266747 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266752 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266758 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.266764 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266769 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.266775 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266781 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266786 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266799 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.266804 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266810 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.266816 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266821 | controller | - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.266827 | controller | 1 additional commands' 2025-10-13 20:41:20.266833 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.266838 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.266844 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.266850 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.266855 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.266869 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.266877 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.266885 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.266892 | controller | | wc -l)' 2025-10-13 20:41:20.266900 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.266907 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.266912 | controller | nodeselector:"' 2025-10-13 20:41:20.266918 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.266924 | controller | - ' exit 1' 2025-10-13 20:41:20.266929 | controller | - ' fi' 2025-10-13 20:41:20.266935 | controller | - ' ]' 2025-10-13 20:41:20.266941 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.266946 | controller | have new nodeselector' 2025-10-13 20:41:20.266952 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | Found 23 pods with bad 2025-10-13 20:41:20.266958 | controller | or missing nodeselector:' 2025-10-13 20:41:20.266963 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.266969 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266975 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.266980 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266986 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.266992 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.266997 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267003 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267009 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267014 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267020 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267026 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267032 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.267040 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267046 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.267055 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267061 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.267066 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267072 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.267078 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267083 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267089 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267095 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.267100 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267106 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.267112 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267117 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: 2025-10-13 20:41:20.267123 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267129 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267134 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267143 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267148 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267154 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267160 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267165 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267171 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267177 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267183 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267189 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.267205 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267211 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.267225 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267233 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267240 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267248 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.267255 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267262 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267267 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267273 | controller | - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.267279 | controller | 1 additional commands' 2025-10-13 20:41:20.267285 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.267290 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.267296 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.267305 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.267311 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.267316 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.267322 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.267328 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.267333 | controller | | wc -l)' 2025-10-13 20:41:20.267339 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.267345 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.267350 | controller | nodeselector:"' 2025-10-13 20:41:20.267356 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.267362 | controller | - ' exit 1' 2025-10-13 20:41:20.267367 | controller | - ' fi' 2025-10-13 20:41:20.267373 | controller | - ' ]' 2025-10-13 20:41:20.267379 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.267384 | controller | have new nodeselector' 2025-10-13 20:41:20.267397 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | Found 21 pods with bad 2025-10-13 20:41:20.267415 | controller | or missing nodeselector:' 2025-10-13 20:41:20.267424 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.267430 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267436 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.267441 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267447 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.267453 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267458 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267464 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267470 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267475 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267481 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267487 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267493 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.267498 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267504 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.267509 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267515 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.267521 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267526 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.267532 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267538 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267543 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267549 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.267555 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267563 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.267569 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267575 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267588 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267596 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267604 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267612 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267619 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267626 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267631 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267637 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.267643 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267648 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.267654 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267660 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267665 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267671 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.267677 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267682 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267688 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267694 | controller | - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.267699 | controller | 1 additional commands' 2025-10-13 20:41:20.267705 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.267711 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.267716 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.267722 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.267728 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.267733 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.267739 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.267745 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.267750 | controller | | wc -l)' 2025-10-13 20:41:20.267756 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.267762 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.267767 | controller | nodeselector:"' 2025-10-13 20:41:20.267773 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.267778 | controller | - ' exit 1' 2025-10-13 20:41:20.267784 | controller | - ' fi' 2025-10-13 20:41:20.267790 | controller | - ' ]' 2025-10-13 20:41:20.267795 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.267801 | controller | have new nodeselector' 2025-10-13 20:41:20.267807 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | Found 20 pods with bad 2025-10-13 20:41:20.267818 | controller | or missing nodeselector:' 2025-10-13 20:41:20.267824 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.267830 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267835 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.267841 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267847 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.267852 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267861 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267867 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267872 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267878 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267884 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.267889 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267895 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.267901 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267906 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.267912 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267918 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.267931 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267939 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267946 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267954 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.267962 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267967 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.267973 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267979 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267984 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.267990 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.267996 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268002 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268011 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268017 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268022 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268028 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.268034 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268039 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.268045 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268051 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268059 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268065 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.268071 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268077 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268082 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268091 | controller | - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.268096 | controller | 1 additional commands' 2025-10-13 20:41:20.268102 | controller | - ' logger.go:42: 20:17:27 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.268108 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.268114 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.268119 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.268125 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.268131 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.268136 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.268142 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.268148 | controller | | wc -l)' 2025-10-13 20:41:20.268153 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.268159 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.268165 | controller | nodeselector:"' 2025-10-13 20:41:20.268170 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.268176 | controller | - ' exit 1' 2025-10-13 20:41:20.268182 | controller | - ' fi' 2025-10-13 20:41:20.268187 | controller | - ' ]' 2025-10-13 20:41:20.268193 | controller | - ' logger.go:42: 20:17:27 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.268199 | controller | have new nodeselector' 2025-10-13 20:41:20.268207 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | Found 20 pods with bad 2025-10-13 20:41:20.268213 | controller | or missing nodeselector:' 2025-10-13 20:41:20.268218 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.268224 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268230 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.268235 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268241 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.268247 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268252 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268258 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268272 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268280 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268287 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.268295 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268302 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.268311 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268317 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.268323 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268328 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.268334 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268343 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268349 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268354 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.268360 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268366 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.268371 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268377 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268383 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268388 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268398 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268418 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268424 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268430 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268435 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268441 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.268449 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268455 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.268461 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268467 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268472 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268478 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.268484 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268489 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268495 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268501 | controller | - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.268506 | controller | 1 additional commands' 2025-10-13 20:41:20.268512 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.268518 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.268523 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.268529 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.268535 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.268540 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.268546 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.268554 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.268560 | controller | | wc -l)' 2025-10-13 20:41:20.268566 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.268572 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.268577 | controller | nodeselector:"' 2025-10-13 20:41:20.268583 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.268589 | controller | - ' exit 1' 2025-10-13 20:41:20.268594 | controller | - ' fi' 2025-10-13 20:41:20.268600 | controller | - ' ]' 2025-10-13 20:41:20.268605 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.268611 | controller | have new nodeselector' 2025-10-13 20:41:20.268617 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | Found 19 pods with bad 2025-10-13 20:41:20.268622 | controller | or missing nodeselector:' 2025-10-13 20:41:20.268628 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.268644 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268653 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.268661 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268668 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.268676 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268682 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268688 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268694 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268699 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268705 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.268711 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268716 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.268722 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268728 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.268733 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268739 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.268745 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268750 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268756 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268762 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.268767 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268773 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.268779 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268784 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268790 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268796 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268801 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268810 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268816 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268822 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.268827 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268833 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.268839 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268844 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268850 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268856 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.268861 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268867 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.268873 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.268878 | controller | - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.268884 | controller | 1 additional commands' 2025-10-13 20:41:20.268890 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.268895 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.268901 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.268907 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.268912 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.268918 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.268924 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.268929 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.268935 | controller | | wc -l)' 2025-10-13 20:41:20.268941 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.268955 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.268965 | controller | nodeselector:"' 2025-10-13 20:41:20.268973 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.268983 | controller | - ' exit 1' 2025-10-13 20:41:20.268990 | controller | - ' fi' 2025-10-13 20:41:20.268996 | controller | - ' ]' 2025-10-13 20:41:20.269002 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.269007 | controller | have new nodeselector' 2025-10-13 20:41:20.269013 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | Found 19 pods with bad 2025-10-13 20:41:20.269019 | controller | or missing nodeselector:' 2025-10-13 20:41:20.269024 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.269030 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269036 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.269041 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269047 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.269053 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269058 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269067 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269073 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269079 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269084 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.269090 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269096 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.269101 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269107 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.269113 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269118 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.269124 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269130 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269135 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269141 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.269147 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269152 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.269158 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269164 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269169 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269175 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269181 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269186 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269192 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269201 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.269207 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269213 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.269218 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269224 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269230 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269236 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.269241 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269247 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269253 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269259 | controller | - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.269264 | controller | 1 additional commands' 2025-10-13 20:41:20.269270 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.269276 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.269284 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.269295 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.269308 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.269316 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.269324 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.269332 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.269339 | controller | | wc -l)' 2025-10-13 20:41:20.269345 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.269351 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.269356 | controller | nodeselector:"' 2025-10-13 20:41:20.269362 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.269368 | controller | - ' exit 1' 2025-10-13 20:41:20.269374 | controller | - ' fi' 2025-10-13 20:41:20.269379 | controller | - ' ]' 2025-10-13 20:41:20.269385 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.269391 | controller | have new nodeselector' 2025-10-13 20:41:20.269412 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | Found 19 pods with bad 2025-10-13 20:41:20.269421 | controller | or missing nodeselector:' 2025-10-13 20:41:20.269426 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.269432 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269438 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.269444 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269449 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.269455 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269461 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269467 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269476 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269481 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269487 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.269493 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269499 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.269504 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269510 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.269516 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269521 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.269527 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269533 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269539 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269544 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.269550 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269556 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.269564 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269570 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269576 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269581 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269587 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269593 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269598 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269604 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.269610 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269616 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.269621 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269627 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269633 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269638 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.269644 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269650 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269655 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269669 | controller | - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.269677 | controller | 1 additional commands' 2025-10-13 20:41:20.269685 | controller | - ' logger.go:42: 20:17:32 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.269692 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.269700 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.269706 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.269712 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.269717 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.269723 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.269729 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.269735 | controller | | wc -l)' 2025-10-13 20:41:20.269740 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.269746 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.269752 | controller | nodeselector:"' 2025-10-13 20:41:20.269758 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.269763 | controller | - ' exit 1' 2025-10-13 20:41:20.269769 | controller | - ' fi' 2025-10-13 20:41:20.269775 | controller | - ' ]' 2025-10-13 20:41:20.269780 | controller | - ' logger.go:42: 20:17:32 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.269786 | controller | have new nodeselector' 2025-10-13 20:41:20.269792 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | Found 18 pods with bad 2025-10-13 20:41:20.269797 | controller | or missing nodeselector:' 2025-10-13 20:41:20.269803 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.269809 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269815 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.269824 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269830 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.269836 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269841 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269847 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269853 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269859 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269864 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.269874 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269879 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.269885 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269891 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.269899 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269905 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.269910 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269916 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269922 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269927 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.269933 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269939 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.269945 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269950 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269956 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269962 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269968 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269973 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.269979 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269985 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.269990 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.269996 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: 2025-10-13 20:41:20.270009 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270017 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.270025 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270033 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270040 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270046 | controller | - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.270051 | controller | 1 additional commands' 2025-10-13 20:41:20.270063 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.270069 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.270075 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.270081 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.270086 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.270092 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.270098 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.270103 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.270109 | controller | | wc -l)' 2025-10-13 20:41:20.270115 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.270120 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.270126 | controller | nodeselector:"' 2025-10-13 20:41:20.270132 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.270137 | controller | - ' exit 1' 2025-10-13 20:41:20.270143 | controller | - ' fi' 2025-10-13 20:41:20.270149 | controller | - ' ]' 2025-10-13 20:41:20.270155 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.270160 | controller | have new nodeselector' 2025-10-13 20:41:20.270166 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.270172 | controller | or missing nodeselector:' 2025-10-13 20:41:20.270178 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.270183 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270189 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.270195 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270200 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.270206 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270212 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270217 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270223 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270229 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270234 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.270240 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270246 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.270252 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270257 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.270263 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270269 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.270274 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270280 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270286 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270291 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.270300 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270308 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.270314 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270320 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270326 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270331 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270337 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270350 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270358 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270366 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.270374 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270381 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.270386 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270395 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270413 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270421 | controller | - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.270453 | controller | 1 additional commands' 2025-10-13 20:41:20.270461 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.270468 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.270474 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.270480 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.270486 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.270491 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.270497 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.270503 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.270508 | controller | | wc -l)' 2025-10-13 20:41:20.270514 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.270524 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.270529 | controller | nodeselector:"' 2025-10-13 20:41:20.270535 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.270541 | controller | - ' exit 1' 2025-10-13 20:41:20.270546 | controller | - ' fi' 2025-10-13 20:41:20.270552 | controller | - ' ]' 2025-10-13 20:41:20.270558 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.270563 | controller | have new nodeselector' 2025-10-13 20:41:20.270569 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.270575 | controller | or missing nodeselector:' 2025-10-13 20:41:20.270581 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.270586 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270592 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.270600 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270609 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.270615 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270620 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270626 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270632 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270637 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270643 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.270649 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270654 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.270660 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270666 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.270671 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270677 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.270683 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270688 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270694 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270700 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.270705 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270711 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.270717 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270722 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270728 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270743 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270751 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270758 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270766 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270774 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.270780 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270786 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.270792 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270798 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270803 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270809 | controller | - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.270815 | controller | 1 additional commands' 2025-10-13 20:41:20.270820 | controller | - ' logger.go:42: 20:17:36 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.270826 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.270832 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.270838 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.270847 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.270852 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.270858 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.270864 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.270869 | controller | | wc -l)' 2025-10-13 20:41:20.270875 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.270881 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.270887 | controller | nodeselector:"' 2025-10-13 20:41:20.270892 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.270898 | controller | - ' exit 1' 2025-10-13 20:41:20.270904 | controller | - ' fi' 2025-10-13 20:41:20.270909 | controller | - ' ]' 2025-10-13 20:41:20.270915 | controller | - ' logger.go:42: 20:17:36 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.270921 | controller | have new nodeselector' 2025-10-13 20:41:20.270927 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.270932 | controller | or missing nodeselector:' 2025-10-13 20:41:20.270938 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.270944 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270949 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.270955 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270961 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.270967 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270972 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270978 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270984 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.270989 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.270995 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.271001 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271006 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.271012 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271018 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.271024 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271029 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.271035 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271041 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271047 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271052 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.271058 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271064 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.271070 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271089 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271098 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271106 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271114 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271122 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271128 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271134 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.271139 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271145 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.271151 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271157 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271163 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271168 | controller | - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.271174 | controller | 1 additional commands' 2025-10-13 20:41:20.271180 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.271186 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.271192 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.271197 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.271203 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.271209 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.271215 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.271220 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.271226 | controller | | wc -l)' 2025-10-13 20:41:20.271232 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.271238 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.271243 | controller | nodeselector:"' 2025-10-13 20:41:20.271249 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.271255 | controller | - ' exit 1' 2025-10-13 20:41:20.271261 | controller | - ' fi' 2025-10-13 20:41:20.271267 | controller | - ' ]' 2025-10-13 20:41:20.271273 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.271278 | controller | have new nodeselector' 2025-10-13 20:41:20.271284 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.271290 | controller | or missing nodeselector:' 2025-10-13 20:41:20.271296 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.271302 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271307 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.271313 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271319 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.271325 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271330 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271342 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271348 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271354 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271359 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.271365 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271371 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.271377 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271383 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.271388 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271397 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.271415 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271423 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271429 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271435 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.271441 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271454 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.271463 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271471 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271483 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271493 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271499 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271505 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271510 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271519 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.271525 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271530 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.271536 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271542 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271547 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271553 | controller | - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.271559 | controller | 1 additional commands' 2025-10-13 20:41:20.271565 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.271571 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.271576 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.271582 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.271588 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.271593 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.271599 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.271608 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.271614 | controller | | wc -l)' 2025-10-13 20:41:20.271620 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.271626 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.271631 | controller | nodeselector:"' 2025-10-13 20:41:20.271637 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.271643 | controller | - ' exit 1' 2025-10-13 20:41:20.271648 | controller | - ' fi' 2025-10-13 20:41:20.271654 | controller | - ' ]' 2025-10-13 20:41:20.271660 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.271666 | controller | have new nodeselector' 2025-10-13 20:41:20.271674 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.271680 | controller | or missing nodeselector:' 2025-10-13 20:41:20.271686 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.271694 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271700 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.271705 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271714 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.271719 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271725 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271731 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271736 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271742 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271748 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.271754 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271759 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.271765 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271771 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.271776 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271782 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.271788 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271793 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271807 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271815 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.271823 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271830 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.271838 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271844 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271850 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271856 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271865 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271870 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271876 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271882 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.271888 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271893 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.271899 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271905 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.271910 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.271916 | controller | - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.271922 | controller | 1 additional commands' 2025-10-13 20:41:20.271928 | controller | - ' logger.go:42: 20:17:40 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.271933 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.271939 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.271945 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.271951 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.271956 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.271962 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.271968 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.271974 | controller | | wc -l)' 2025-10-13 20:41:20.271979 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.271985 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.271991 | controller | nodeselector:"' 2025-10-13 20:41:20.271996 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.272002 | controller | - ' exit 1' 2025-10-13 20:41:20.272008 | controller | - ' fi' 2025-10-13 20:41:20.272014 | controller | - ' ]' 2025-10-13 20:41:20.272019 | controller | - ' logger.go:42: 20:17:40 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.272025 | controller | have new nodeselector' 2025-10-13 20:41:20.272031 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.272036 | controller | or missing nodeselector:' 2025-10-13 20:41:20.272042 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.272048 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272054 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.272059 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272065 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.272071 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272076 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272082 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272088 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272093 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272102 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.272107 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272113 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.272119 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272125 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.272130 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272136 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.272149 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272157 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272165 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272173 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.272180 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272186 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.272192 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272198 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272203 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272209 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272215 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272220 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272226 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272232 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.272238 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272243 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.272249 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272255 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272260 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272266 | controller | - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.272272 | controller | 1 additional commands' 2025-10-13 20:41:20.272278 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.272283 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.272289 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.272309 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.272315 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.272321 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.272327 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.272332 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.272338 | controller | | wc -l)' 2025-10-13 20:41:20.272344 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.272352 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.272358 | controller | nodeselector:"' 2025-10-13 20:41:20.272364 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.272369 | controller | - ' exit 1' 2025-10-13 20:41:20.272375 | controller | - ' fi' 2025-10-13 20:41:20.272381 | controller | - ' ]' 2025-10-13 20:41:20.272387 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.272395 | controller | have new nodeselector' 2025-10-13 20:41:20.272413 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.272422 | controller | or missing nodeselector:' 2025-10-13 20:41:20.272428 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.272433 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272439 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.272445 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272450 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.272456 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272462 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272468 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272473 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272479 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272485 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.272490 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272496 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.272502 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272507 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.272521 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272529 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.272536 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272544 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272552 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272558 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.272564 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272570 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.272576 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272581 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272587 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272593 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272598 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272604 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272610 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272615 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.272624 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272630 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.272636 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272641 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272647 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272653 | controller | - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.272658 | controller | 1 additional commands' 2025-10-13 20:41:20.272664 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.272670 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.272675 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.272681 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.272687 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.272693 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.272698 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.272704 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.272710 | controller | | wc -l)' 2025-10-13 20:41:20.272715 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.272721 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.272727 | controller | nodeselector:"' 2025-10-13 20:41:20.272732 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.272738 | controller | - ' exit 1' 2025-10-13 20:41:20.272744 | controller | - ' fi' 2025-10-13 20:41:20.272749 | controller | - ' ]' 2025-10-13 20:41:20.272755 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.272761 | controller | have new nodeselector' 2025-10-13 20:41:20.272767 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | Found 17 pods with bad 2025-10-13 20:41:20.272772 | controller | or missing nodeselector:' 2025-10-13 20:41:20.272778 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.272784 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272789 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.272798 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272804 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: 2025-10-13 20:41:20.272810 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272815 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272821 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272827 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272832 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272838 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.272844 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272857 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.272868 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272876 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.272884 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272891 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.272896 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272902 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272908 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272919 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.272925 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272933 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: 2025-10-13 20:41:20.272939 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272944 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272950 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272956 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272961 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272967 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.272973 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272979 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.272984 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.272992 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.272998 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273004 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273010 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273015 | controller | - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.273021 | controller | 1 additional commands' 2025-10-13 20:41:20.273027 | controller | - ' logger.go:42: 20:17:44 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.273032 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.273038 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.273044 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.273049 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.273055 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.273061 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.273066 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.273072 | controller | | wc -l)' 2025-10-13 20:41:20.273078 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.273083 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.273089 | controller | nodeselector:"' 2025-10-13 20:41:20.273095 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.273101 | controller | - ' exit 1' 2025-10-13 20:41:20.273106 | controller | - ' fi' 2025-10-13 20:41:20.273115 | controller | - ' ]' 2025-10-13 20:41:20.273120 | controller | - ' logger.go:42: 20:17:44 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.273126 | controller | have new nodeselector' 2025-10-13 20:41:20.273132 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | Found 15 pods with bad 2025-10-13 20:41:20.273137 | controller | or missing nodeselector:' 2025-10-13 20:41:20.273143 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.273149 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273155 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.273160 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273166 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273172 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273177 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273183 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273189 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | glance-default-external-api-0: 2025-10-13 20:41:20.273195 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273208 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: 2025-10-13 20:41:20.273216 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273224 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.273231 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273239 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.273244 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273250 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273256 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273261 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.273267 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273273 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273278 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273284 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273290 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273295 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273301 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273307 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.273313 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273318 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.273324 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273329 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273335 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273341 | controller | - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.273347 | controller | 1 additional commands' 2025-10-13 20:41:20.273352 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.273361 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.273367 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.273373 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.273378 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.273384 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.273390 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.273398 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.273525 | controller | | wc -l)' 2025-10-13 20:41:20.273533 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.273538 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.273544 | controller | nodeselector:"' 2025-10-13 20:41:20.273550 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.273556 | controller | - ' exit 1' 2025-10-13 20:41:20.273561 | controller | - ' fi' 2025-10-13 20:41:20.273567 | controller | - ' ]' 2025-10-13 20:41:20.273573 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.273578 | controller | have new nodeselector' 2025-10-13 20:41:20.273588 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | Found 11 pods with bad 2025-10-13 20:41:20.273593 | controller | or missing nodeselector:' 2025-10-13 20:41:20.273599 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.273605 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273610 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.273616 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273622 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273628 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273633 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.273639 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273645 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.273650 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273656 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273662 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273675 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.273684 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273691 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273699 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273707 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273714 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273719 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.273725 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273731 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.273741 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273747 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273752 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273758 | controller | - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.273764 | controller | 1 additional commands' 2025-10-13 20:41:20.273769 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.273775 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.273781 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.273787 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.273792 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.273798 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.273804 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.273809 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.273815 | controller | | wc -l)' 2025-10-13 20:41:20.273821 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.273826 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.273832 | controller | nodeselector:"' 2025-10-13 20:41:20.273838 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.273843 | controller | - ' exit 1' 2025-10-13 20:41:20.273852 | controller | - ' fi' 2025-10-13 20:41:20.273858 | controller | - ' ]' 2025-10-13 20:41:20.273864 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.273869 | controller | have new nodeselector' 2025-10-13 20:41:20.273875 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | Found 11 pods with bad 2025-10-13 20:41:20.273881 | controller | or missing nodeselector:' 2025-10-13 20:41:20.273887 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.273892 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273898 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.273904 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273909 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273915 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273921 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.273926 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273932 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.273938 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273943 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273949 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273955 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: 2025-10-13 20:41:20.273961 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273967 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273972 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273981 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.273987 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.273992 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.273998 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274004 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.274009 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274023 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274031 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274064 | controller | - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.274070 | controller | 1 additional commands' 2025-10-13 20:41:20.274076 | controller | - ' logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.274081 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.274087 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.274093 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.274098 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.274104 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.274110 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.274115 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.274121 | controller | | wc -l)' 2025-10-13 20:41:20.274129 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.274135 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.274141 | controller | nodeselector:"' 2025-10-13 20:41:20.274146 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.274154 | controller | - ' exit 1' 2025-10-13 20:41:20.274160 | controller | - ' fi' 2025-10-13 20:41:20.274166 | controller | - ' ]' 2025-10-13 20:41:20.274171 | controller | - ' logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.274177 | controller | have new nodeselector' 2025-10-13 20:41:20.274183 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | Found 10 pods with bad 2025-10-13 20:41:20.274188 | controller | or missing nodeselector:' 2025-10-13 20:41:20.274194 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.274200 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274205 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: 2025-10-13 20:41:20.274211 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274217 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274223 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274228 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.274234 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274240 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.274245 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274251 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274260 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274266 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274271 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274277 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274283 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274289 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.274294 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274300 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.274306 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274311 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274317 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274322 | controller | - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.274328 | controller | 1 additional commands' 2025-10-13 20:41:20.274334 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.274339 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.274345 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.274351 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.274356 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.274362 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.274368 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.274383 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.274394 | controller | | wc -l)' 2025-10-13 20:41:20.274417 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.274429 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.274435 | controller | nodeselector:"' 2025-10-13 20:41:20.274441 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.274447 | controller | - ' exit 1' 2025-10-13 20:41:20.274452 | controller | - ' fi' 2025-10-13 20:41:20.274459 | controller | - ' ]' 2025-10-13 20:41:20.274487 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.274493 | controller | have new nodeselector' 2025-10-13 20:41:20.274499 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | Found 9 pods with bad 2025-10-13 20:41:20.274505 | controller | or missing nodeselector:' 2025-10-13 20:41:20.274511 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.274516 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274522 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274528 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274534 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.274543 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274549 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.274555 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274572 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274578 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274584 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274589 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274595 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274601 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274607 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.274613 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274618 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.274624 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274630 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274636 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274641 | controller | - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.274647 | controller | 1 additional commands' 2025-10-13 20:41:20.274653 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.274659 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.274665 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.274676 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.274682 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.274687 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.274693 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.274699 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.274705 | controller | | wc -l)' 2025-10-13 20:41:20.274711 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.274716 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.274722 | controller | nodeselector:"' 2025-10-13 20:41:20.274728 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.274734 | controller | - ' exit 1' 2025-10-13 20:41:20.274740 | controller | - ' fi' 2025-10-13 20:41:20.274745 | controller | - ' ]' 2025-10-13 20:41:20.274751 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.274757 | controller | have new nodeselector' 2025-10-13 20:41:20.274765 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | Found 9 pods with bad 2025-10-13 20:41:20.274773 | controller | or missing nodeselector:' 2025-10-13 20:41:20.274779 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.274785 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274791 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274796 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274802 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.274808 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274823 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.274834 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274842 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274850 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274857 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274863 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274869 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274875 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274880 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.274886 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274892 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.274897 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274903 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.274909 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.274915 | controller | - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.274920 | controller | 1 additional commands' 2025-10-13 20:41:20.274926 | controller | - ' logger.go:42: 20:17:52 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.274932 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.274937 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.274943 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.274949 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.274954 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.274960 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.274966 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.274971 | controller | | wc -l)' 2025-10-13 20:41:20.274977 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.274983 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.274988 | controller | nodeselector:"' 2025-10-13 20:41:20.274994 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.275000 | controller | - ' exit 1' 2025-10-13 20:41:20.275006 | controller | - ' fi' 2025-10-13 20:41:20.275011 | controller | - ' ]' 2025-10-13 20:41:20.275017 | controller | - ' logger.go:42: 20:17:52 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.275023 | controller | have new nodeselector' 2025-10-13 20:41:20.275028 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | Found 8 pods with bad 2025-10-13 20:41:20.275034 | controller | or missing nodeselector:' 2025-10-13 20:41:20.275040 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.275045 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275051 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275057 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275062 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.275068 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275077 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.275082 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275088 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275094 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275099 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275105 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275111 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275116 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275122 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.275128 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275133 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.275139 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275145 | controller | - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.275150 | controller | 1 additional commands' 2025-10-13 20:41:20.275156 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.275169 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.275177 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.275185 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.275193 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.275200 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.275206 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.275212 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.275217 | controller | | wc -l)' 2025-10-13 20:41:20.275223 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.275229 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.275235 | controller | nodeselector:"' 2025-10-13 20:41:20.275240 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.275246 | controller | - ' exit 1' 2025-10-13 20:41:20.275252 | controller | - ' fi' 2025-10-13 20:41:20.275257 | controller | - ' ]' 2025-10-13 20:41:20.275263 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.275269 | controller | have new nodeselector' 2025-10-13 20:41:20.275275 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | Found 8 pods with bad 2025-10-13 20:41:20.275280 | controller | or missing nodeselector:' 2025-10-13 20:41:20.275289 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.275295 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275301 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275306 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275312 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.275318 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275324 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.275332 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275338 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275344 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275349 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275355 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275361 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275366 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275372 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.275378 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275384 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.275389 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275398 | controller | - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.275431 | controller | 1 additional commands' 2025-10-13 20:41:20.275438 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.275444 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.275449 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.275455 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.275461 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.275466 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.275472 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.275478 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.275483 | controller | | wc -l)' 2025-10-13 20:41:20.275489 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.275495 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.275500 | controller | nodeselector:"' 2025-10-13 20:41:20.275506 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.275512 | controller | - ' exit 1' 2025-10-13 20:41:20.275518 | controller | - ' fi' 2025-10-13 20:41:20.275523 | controller | - ' ]' 2025-10-13 20:41:20.275529 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.275535 | controller | have new nodeselector' 2025-10-13 20:41:20.275540 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | Found 8 pods with bad 2025-10-13 20:41:20.275546 | controller | or missing nodeselector:' 2025-10-13 20:41:20.275552 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: 2025-10-13 20:41:20.275565 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275573 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275581 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275589 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.275597 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275604 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.275610 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275620 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275626 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275631 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275637 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275643 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275648 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275654 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.275660 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275665 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.275674 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275680 | controller | - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.275686 | controller | 1 additional commands' 2025-10-13 20:41:20.275691 | controller | - ' logger.go:42: 20:17:56 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.275697 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.275703 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.275708 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.275714 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.275719 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.275725 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.275731 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.275737 | controller | | wc -l)' 2025-10-13 20:41:20.275742 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.275748 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.275754 | controller | nodeselector:"' 2025-10-13 20:41:20.275759 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.275765 | controller | - ' exit 1' 2025-10-13 20:41:20.275771 | controller | - ' fi' 2025-10-13 20:41:20.275776 | controller | - ' ]' 2025-10-13 20:41:20.275782 | controller | - ' logger.go:42: 20:17:56 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.275788 | controller | have new nodeselector' 2025-10-13 20:41:20.275793 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.275799 | controller | or missing nodeselector:' 2025-10-13 20:41:20.275805 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275811 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275816 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.275822 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275830 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.275836 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275842 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275847 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275853 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275861 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275867 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.275873 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275878 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.275884 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275890 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.275895 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.275901 | controller | - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.275907 | controller | 1 additional commands' 2025-10-13 20:41:20.275921 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.275929 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.275936 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.275944 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.275951 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.275957 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.275963 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.275972 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.275977 | controller | | wc -l)' 2025-10-13 20:41:20.275983 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.275989 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.275994 | controller | nodeselector:"' 2025-10-13 20:41:20.276000 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.276006 | controller | - ' exit 1' 2025-10-13 20:41:20.276011 | controller | - ' fi' 2025-10-13 20:41:20.276017 | controller | - ' ]' 2025-10-13 20:41:20.276023 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.276028 | controller | have new nodeselector' 2025-10-13 20:41:20.276034 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.276040 | controller | or missing nodeselector:' 2025-10-13 20:41:20.276045 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276051 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276057 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.276062 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276068 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.276074 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276079 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276085 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276091 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276096 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276102 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276108 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276113 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.276122 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276128 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.276134 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276139 | controller | - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.276145 | controller | 1 additional commands' 2025-10-13 20:41:20.276151 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.276156 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.276162 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.276168 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.276173 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.276179 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.276185 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.276190 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.276196 | controller | | wc -l)' 2025-10-13 20:41:20.276202 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.276207 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.276213 | controller | nodeselector:"' 2025-10-13 20:41:20.276219 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.276224 | controller | - ' exit 1' 2025-10-13 20:41:20.276230 | controller | - ' fi' 2025-10-13 20:41:20.276236 | controller | - ' ]' 2025-10-13 20:41:20.276241 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.276247 | controller | have new nodeselector' 2025-10-13 20:41:20.276252 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.276258 | controller | or missing nodeselector:' 2025-10-13 20:41:20.276264 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276269 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276283 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.276291 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276299 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.276306 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276314 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276320 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276325 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276331 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276341 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276347 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276352 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.276358 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276364 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.276370 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276383 | controller | - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.276389 | controller | 1 additional commands' 2025-10-13 20:41:20.276398 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.276419 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.276425 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.276430 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.276436 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.276442 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.276448 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.276453 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.276459 | controller | | wc -l)' 2025-10-13 20:41:20.276465 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.276471 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.276476 | controller | nodeselector:"' 2025-10-13 20:41:20.276482 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.276488 | controller | - ' exit 1' 2025-10-13 20:41:20.276494 | controller | - ' fi' 2025-10-13 20:41:20.276499 | controller | - ' ]' 2025-10-13 20:41:20.276505 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.276511 | controller | have new nodeselector' 2025-10-13 20:41:20.276516 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.276522 | controller | or missing nodeselector:' 2025-10-13 20:41:20.276528 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276534 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276539 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.276545 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276551 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.276557 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276562 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276568 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276573 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276579 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276585 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276591 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276596 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.276602 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276608 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.276613 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276619 | controller | - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.276625 | controller | 1 additional commands' 2025-10-13 20:41:20.276630 | controller | - ' logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.276639 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.276645 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.276658 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.276666 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.276674 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.276682 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.276690 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.276695 | controller | | wc -l)' 2025-10-13 20:41:20.276701 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.276707 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.276712 | controller | nodeselector:"' 2025-10-13 20:41:20.276718 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.276724 | controller | - ' exit 1' 2025-10-13 20:41:20.276730 | controller | - ' fi' 2025-10-13 20:41:20.276735 | controller | - ' ]' 2025-10-13 20:41:20.276741 | controller | - ' logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.276747 | controller | have new nodeselector' 2025-10-13 20:41:20.276752 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.276758 | controller | or missing nodeselector:' 2025-10-13 20:41:20.276764 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276769 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276775 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.276781 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276786 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.276792 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276798 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276803 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276809 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276815 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276820 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276826 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276832 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.276838 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276843 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.276849 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.276855 | controller | - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.276860 | controller | 1 additional commands' 2025-10-13 20:41:20.276866 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.276872 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.276877 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.276886 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.276895 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.276900 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.276906 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.276912 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.276917 | controller | | wc -l)' 2025-10-13 20:41:20.276923 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.276929 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.276934 | controller | nodeselector:"' 2025-10-13 20:41:20.276940 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.276946 | controller | - ' exit 1' 2025-10-13 20:41:20.276952 | controller | - ' fi' 2025-10-13 20:41:20.276957 | controller | - ' ]' 2025-10-13 20:41:20.276963 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.276969 | controller | have new nodeselector' 2025-10-13 20:41:20.276977 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.276983 | controller | or missing nodeselector:' 2025-10-13 20:41:20.276989 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.276994 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277000 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.277006 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277012 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.277025 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277033 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277041 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277049 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277056 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277062 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277067 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277073 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.277079 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277084 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.277090 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277096 | controller | - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.277102 | controller | 1 additional commands' 2025-10-13 20:41:20.277107 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.277113 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.277119 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.277124 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.277130 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.277136 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.277141 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.277150 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.277156 | controller | | wc -l)' 2025-10-13 20:41:20.277162 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.277167 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.277173 | controller | nodeselector:"' 2025-10-13 20:41:20.277179 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.277184 | controller | - ' exit 1' 2025-10-13 20:41:20.277190 | controller | - ' fi' 2025-10-13 20:41:20.277196 | controller | - ' ]' 2025-10-13 20:41:20.277201 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.277207 | controller | have new nodeselector' 2025-10-13 20:41:20.277213 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.277218 | controller | or missing nodeselector:' 2025-10-13 20:41:20.277224 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277230 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277236 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.277241 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277247 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.277253 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277258 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277264 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277270 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277275 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277281 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277287 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277293 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.277298 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277304 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.277310 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277315 | controller | - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.277321 | controller | 1 additional commands' 2025-10-13 20:41:20.277327 | controller | - ' logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.277332 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.277338 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.277344 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.277349 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.277365 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.277374 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.277382 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.277389 | controller | | wc -l)' 2025-10-13 20:41:20.277414 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.277423 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.277433 | controller | nodeselector:"' 2025-10-13 20:41:20.277439 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.277444 | controller | - ' exit 1' 2025-10-13 20:41:20.277450 | controller | - ' fi' 2025-10-13 20:41:20.277456 | controller | - ' ]' 2025-10-13 20:41:20.277462 | controller | - ' logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.277467 | controller | have new nodeselector' 2025-10-13 20:41:20.277473 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.277479 | controller | or missing nodeselector:' 2025-10-13 20:41:20.277485 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277490 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277496 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.277504 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277510 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.277516 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277521 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277527 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277533 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277539 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277544 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277550 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277556 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.277561 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277567 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.277573 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277578 | controller | - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.277584 | controller | 1 additional commands' 2025-10-13 20:41:20.277590 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.277595 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.277601 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.277607 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.277612 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.277618 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.277624 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.277629 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.277635 | controller | | wc -l)' 2025-10-13 20:41:20.277641 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.277646 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.277652 | controller | nodeselector:"' 2025-10-13 20:41:20.277658 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.277664 | controller | - ' exit 1' 2025-10-13 20:41:20.277669 | controller | - ' fi' 2025-10-13 20:41:20.277675 | controller | - ' ]' 2025-10-13 20:41:20.277683 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.277689 | controller | have new nodeselector' 2025-10-13 20:41:20.277695 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.277700 | controller | or missing nodeselector:' 2025-10-13 20:41:20.277706 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277712 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277717 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.277723 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277729 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.277734 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277740 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277746 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277759 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277767 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277775 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277783 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277790 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.277796 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277802 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.277807 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277813 | controller | - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.277819 | controller | 1 additional commands' 2025-10-13 20:41:20.277825 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.277830 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.277836 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.277842 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.277847 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.277853 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.277859 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.277865 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.277870 | controller | | wc -l)' 2025-10-13 20:41:20.277876 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.277882 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.277890 | controller | nodeselector:"' 2025-10-13 20:41:20.277896 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.277902 | controller | - ' exit 1' 2025-10-13 20:41:20.277908 | controller | - ' fi' 2025-10-13 20:41:20.277914 | controller | - ' ]' 2025-10-13 20:41:20.277919 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.277925 | controller | have new nodeselector' 2025-10-13 20:41:20.277933 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.277939 | controller | or missing nodeselector:' 2025-10-13 20:41:20.277947 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277953 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277959 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.277964 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277970 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.277976 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277981 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277987 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.277993 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.277998 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278004 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278010 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278016 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.278021 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278027 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.278033 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278038 | controller | - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.278044 | controller | 1 additional commands' 2025-10-13 20:41:20.278050 | controller | - ' logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.278056 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.278061 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.278067 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.278072 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.278078 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.278084 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.278090 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.278102 | controller | | wc -l)' 2025-10-13 20:41:20.278110 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.278118 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.278125 | controller | nodeselector:"' 2025-10-13 20:41:20.278133 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.278138 | controller | - ' exit 1' 2025-10-13 20:41:20.278144 | controller | - ' fi' 2025-10-13 20:41:20.278150 | controller | - ' ]' 2025-10-13 20:41:20.278155 | controller | - ' logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.278161 | controller | have new nodeselector' 2025-10-13 20:41:20.278167 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.278172 | controller | or missing nodeselector:' 2025-10-13 20:41:20.278178 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278184 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278190 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.278199 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278204 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.278210 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278216 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278222 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278227 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278233 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278239 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278244 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278250 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.278256 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278261 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.278267 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278273 | controller | - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.278278 | controller | 1 additional commands' 2025-10-13 20:41:20.278284 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.278290 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.278295 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.278301 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.278307 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.278312 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.278318 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.278324 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.278329 | controller | | wc -l)' 2025-10-13 20:41:20.278335 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.278341 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.278346 | controller | nodeselector:"' 2025-10-13 20:41:20.278352 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.278358 | controller | - ' exit 1' 2025-10-13 20:41:20.278363 | controller | - ' fi' 2025-10-13 20:41:20.278369 | controller | - ' ]' 2025-10-13 20:41:20.278375 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.278380 | controller | have new nodeselector' 2025-10-13 20:41:20.278386 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.278392 | controller | or missing nodeselector:' 2025-10-13 20:41:20.278397 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278403 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278409 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.278414 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278420 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.278426 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278456 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278462 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278468 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278474 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278479 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278505 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278514 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.278522 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278529 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.278537 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278544 | controller | - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.278551 | controller | 1 additional commands' 2025-10-13 20:41:20.278557 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.278563 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.278568 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.278574 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.278580 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.278585 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.278591 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.278597 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.278602 | controller | | wc -l)' 2025-10-13 20:41:20.278608 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.278614 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.278620 | controller | nodeselector:"' 2025-10-13 20:41:20.278625 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.278631 | controller | - ' exit 1' 2025-10-13 20:41:20.278637 | controller | - ' fi' 2025-10-13 20:41:20.278642 | controller | - ' ]' 2025-10-13 20:41:20.278648 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.278654 | controller | have new nodeselector' 2025-10-13 20:41:20.278659 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | Found 7 pods with bad 2025-10-13 20:41:20.278665 | controller | or missing nodeselector:' 2025-10-13 20:41:20.278671 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278677 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278682 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.278688 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278694 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.278699 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278705 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278711 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278716 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278725 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278734 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278740 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278746 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.278752 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278757 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.278763 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278769 | controller | - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.278774 | controller | 1 additional commands' 2025-10-13 20:41:20.278780 | controller | - ' logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.278786 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.278791 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.278797 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.278803 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.278808 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.278814 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.278820 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.278825 | controller | | wc -l)' 2025-10-13 20:41:20.278831 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.278837 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.278842 | controller | nodeselector:"' 2025-10-13 20:41:20.278856 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.278864 | controller | - ' exit 1' 2025-10-13 20:41:20.278872 | controller | - ' fi' 2025-10-13 20:41:20.278880 | controller | - ' ]' 2025-10-13 20:41:20.278887 | controller | - ' logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.278893 | controller | have new nodeselector' 2025-10-13 20:41:20.278899 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | Found 6 pods with bad 2025-10-13 20:41:20.278904 | controller | or missing nodeselector:' 2025-10-13 20:41:20.278910 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.278916 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278922 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.278927 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278933 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278939 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278945 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278950 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278957 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.278964 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278970 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.278981 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.278987 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.278995 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279001 | controller | - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.279007 | controller | 1 additional commands' 2025-10-13 20:41:20.279013 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.279021 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.279026 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.279032 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.279038 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.279043 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.279049 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.279055 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.279061 | controller | | wc -l)' 2025-10-13 20:41:20.279066 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.279074 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.279080 | controller | nodeselector:"' 2025-10-13 20:41:20.279086 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.279091 | controller | - ' exit 1' 2025-10-13 20:41:20.279097 | controller | - ' fi' 2025-10-13 20:41:20.279103 | controller | - ' ]' 2025-10-13 20:41:20.279108 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.279114 | controller | have new nodeselector' 2025-10-13 20:41:20.279122 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | Found 6 pods with bad 2025-10-13 20:41:20.279128 | controller | or missing nodeselector:' 2025-10-13 20:41:20.279134 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.279139 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279147 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.279153 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279159 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279164 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279170 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279176 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279181 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279187 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279193 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.279199 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279204 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.279210 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279216 | controller | - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.279221 | controller | 1 additional commands' 2025-10-13 20:41:20.279434 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.279447 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.279458 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.279464 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.279470 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.279475 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.279481 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.279487 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.279492 | controller | | wc -l)' 2025-10-13 20:41:20.279498 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.279504 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.279509 | controller | nodeselector:"' 2025-10-13 20:41:20.279515 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.279521 | controller | - ' exit 1' 2025-10-13 20:41:20.279526 | controller | - ' fi' 2025-10-13 20:41:20.279532 | controller | - ' ]' 2025-10-13 20:41:20.279538 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.279543 | controller | have new nodeselector' 2025-10-13 20:41:20.279549 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | Found 6 pods with bad 2025-10-13 20:41:20.279555 | controller | or missing nodeselector:' 2025-10-13 20:41:20.279560 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.279566 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279572 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.279577 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279583 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279589 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279594 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279600 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279606 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279612 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279617 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.279623 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279629 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.279634 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279640 | controller | - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.279646 | controller | 1 additional commands' 2025-10-13 20:41:20.279651 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.279657 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.279663 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.279668 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.279677 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.279683 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.279688 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.279697 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.279702 | controller | | wc -l)' 2025-10-13 20:41:20.279708 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.279714 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.279719 | controller | nodeselector:"' 2025-10-13 20:41:20.279725 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.279731 | controller | - ' exit 1' 2025-10-13 20:41:20.279736 | controller | - ' fi' 2025-10-13 20:41:20.279742 | controller | - ' ]' 2025-10-13 20:41:20.279748 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.279753 | controller | have new nodeselector' 2025-10-13 20:41:20.279759 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | Found 6 pods with bad 2025-10-13 20:41:20.279765 | controller | or missing nodeselector:' 2025-10-13 20:41:20.279770 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.279776 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279782 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.279787 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279801 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279809 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279816 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279824 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279831 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.279837 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279843 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.279849 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279854 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.279860 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.279866 | controller | - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.279871 | controller | 1 additional commands' 2025-10-13 20:41:20.279877 | controller | - ' logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.279883 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.279888 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.279894 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.279900 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.279905 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.279911 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.279917 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.279922 | controller | | wc -l)' 2025-10-13 20:41:20.279928 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.279934 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.279939 | controller | nodeselector:"' 2025-10-13 20:41:20.279945 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.279954 | controller | - ' exit 1' 2025-10-13 20:41:20.279960 | controller | - ' fi' 2025-10-13 20:41:20.279965 | controller | - ' ]' 2025-10-13 20:41:20.279971 | controller | - ' logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.279977 | controller | have new nodeselector' 2025-10-13 20:41:20.279982 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | Found 6 pods with bad 2025-10-13 20:41:20.279988 | controller | or missing nodeselector:' 2025-10-13 20:41:20.279994 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.279999 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280005 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.280011 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280017 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280022 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280028 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280034 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280039 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280045 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280051 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.280056 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280062 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.280068 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280073 | controller | - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.280079 | controller | 1 additional commands' 2025-10-13 20:41:20.280085 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.280091 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.280096 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.280102 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.280107 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.280113 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.280119 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.280125 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.280130 | controller | | wc -l)' 2025-10-13 20:41:20.280149 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.280157 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.280165 | controller | nodeselector:"' 2025-10-13 20:41:20.280173 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.280180 | controller | - ' exit 1' 2025-10-13 20:41:20.280185 | controller | - ' fi' 2025-10-13 20:41:20.280191 | controller | - ' ]' 2025-10-13 20:41:20.280197 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.280202 | controller | have new nodeselector' 2025-10-13 20:41:20.280208 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | Found 6 pods with bad 2025-10-13 20:41:20.280214 | controller | or missing nodeselector:' 2025-10-13 20:41:20.280223 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.280229 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280235 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.280240 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280246 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280252 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280257 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280263 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280269 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280274 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280280 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.280286 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280291 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.280297 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280303 | controller | - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.280308 | controller | 1 additional commands' 2025-10-13 20:41:20.280314 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.280319 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.280325 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.280331 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.280336 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.280342 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.280348 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.280353 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.280359 | controller | | wc -l)' 2025-10-13 20:41:20.280365 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.280370 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.280376 | controller | nodeselector:"' 2025-10-13 20:41:20.280382 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.280387 | controller | - ' exit 1' 2025-10-13 20:41:20.280396 | controller | - ' fi' 2025-10-13 20:41:20.280415 | controller | - ' ]' 2025-10-13 20:41:20.280423 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.280429 | controller | have new nodeselector' 2025-10-13 20:41:20.280435 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | Found 6 pods with bad 2025-10-13 20:41:20.280441 | controller | or missing nodeselector:' 2025-10-13 20:41:20.280446 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: 2025-10-13 20:41:20.280452 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280458 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.280463 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280469 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280478 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280484 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280489 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280495 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280501 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280506 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.280512 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280518 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.280531 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280539 | controller | - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.280547 | controller | 1 additional commands' 2025-10-13 20:41:20.280554 | controller | - ' logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.280562 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.280568 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.280574 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.280579 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.280585 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.280591 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.280596 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.280602 | controller | | wc -l)' 2025-10-13 20:41:20.280608 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.280613 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.280619 | controller | nodeselector:"' 2025-10-13 20:41:20.280625 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.280630 | controller | - ' exit 1' 2025-10-13 20:41:20.280636 | controller | - ' fi' 2025-10-13 20:41:20.280642 | controller | - ' ]' 2025-10-13 20:41:20.280648 | controller | - ' logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.280653 | controller | have new nodeselector' 2025-10-13 20:41:20.280659 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | Found 5 pods with bad 2025-10-13 20:41:20.280665 | controller | or missing nodeselector:' 2025-10-13 20:41:20.280674 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: 2025-10-13 20:41:20.280680 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280685 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280691 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280697 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280702 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280708 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280714 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280719 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: 2025-10-13 20:41:20.280725 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280731 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.280739 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280745 | controller | - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.280750 | controller | 1 additional commands' 2025-10-13 20:41:20.280756 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.280762 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.280767 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.280773 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.280779 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.280784 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.280790 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.280796 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.280801 | controller | | wc -l)' 2025-10-13 20:41:20.280807 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.280813 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.280818 | controller | nodeselector:"' 2025-10-13 20:41:20.280824 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.280830 | controller | - ' exit 1' 2025-10-13 20:41:20.280835 | controller | - ' fi' 2025-10-13 20:41:20.280841 | controller | - ' ]' 2025-10-13 20:41:20.280847 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.280852 | controller | have new nodeselector' 2025-10-13 20:41:20.280858 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | Found 3 pods with bad 2025-10-13 20:41:20.280864 | controller | or missing nodeselector:' 2025-10-13 20:41:20.280869 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280875 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280881 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280886 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280899 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.280907 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280915 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.280923 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.280929 | controller | - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.280935 | controller | 1 additional commands' 2025-10-13 20:41:20.280941 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.280947 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.280952 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.280958 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.280964 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.280969 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.280975 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.280984 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.280992 | controller | | wc -l)' 2025-10-13 20:41:20.280998 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.281004 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.281010 | controller | nodeselector:"' 2025-10-13 20:41:20.281015 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.281021 | controller | - ' exit 1' 2025-10-13 20:41:20.281027 | controller | - ' fi' 2025-10-13 20:41:20.281032 | controller | - ' ]' 2025-10-13 20:41:20.281038 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.281044 | controller | have new nodeselector' 2025-10-13 20:41:20.281049 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | Found 3 pods with bad 2025-10-13 20:41:20.281055 | controller | or missing nodeselector:' 2025-10-13 20:41:20.281061 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.281066 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.281072 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.281078 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.281610 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.281620 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.281626 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.281632 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.281638 | controller | - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.281643 | controller | 1 additional commands' 2025-10-13 20:41:20.281649 | controller | - ' logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.281655 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.281660 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.281666 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.281672 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.281677 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.281683 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.281692 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.281698 | controller | | wc -l)' 2025-10-13 20:41:20.281703 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.281709 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.281715 | controller | nodeselector:"' 2025-10-13 20:41:20.281720 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.281726 | controller | - ' exit 1' 2025-10-13 20:41:20.281732 | controller | - ' fi' 2025-10-13 20:41:20.281738 | controller | - ' ]' 2025-10-13 20:41:20.281744 | controller | - ' logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.281749 | controller | have new nodeselector' 2025-10-13 20:41:20.281757 | controller | - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | Found 2 pods with bad 2025-10-13 20:41:20.281763 | controller | or missing nodeselector:' 2025-10-13 20:41:20.281769 | controller | - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.281775 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.281780 | controller | - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux 2025-10-13 20:41:20.281789 | controller | node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.281795 | controller | - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: 2025-10-13 20:41:20.281812 | controller | map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' 2025-10-13 20:41:20.281821 | controller | - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | command failure, skipping 2025-10-13 20:41:20.281829 | controller | 1 additional commands' 2025-10-13 20:41:20.281837 | controller | - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.281845 | controller | echo "Checking all running pods have new nodeselector"' 2025-10-13 20:41:20.281851 | controller | - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' 2025-10-13 20:41:20.281857 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq 2025-10-13 20:41:20.281862 | controller | --field-selector=status.phase=Running -o=go-template --template=''{{ range .items 2025-10-13 20:41:20.281868 | controller | }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' 2025-10-13 20:41:20.281874 | controller | | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.281879 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.281885 | controller | | wc -l)' 2025-10-13 20:41:20.281891 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.281896 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing 2025-10-13 20:41:20.281902 | controller | nodeselector:"' 2025-10-13 20:41:20.281908 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.281913 | controller | - ' exit 1' 2025-10-13 20:41:20.281919 | controller | - ' fi' 2025-10-13 20:41:20.281925 | controller | - ' ]' 2025-10-13 20:41:20.281930 | controller | - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | Checking all running pods 2025-10-13 20:41:20.281936 | controller | have new nodeselector' 2025-10-13 20:41:20.281942 | controller | - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | running command: [sh -c 2025-10-13 20:41:20.281948 | controller | echo "Checking all cronjobs have expected nodeselector"' 2025-10-13 20:41:20.281953 | controller | - ' EXPECTED_NODE_SELECTOR="kubernetes.io/os:linux"' 2025-10-13 20:41:20.281959 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get cronjobs -n $NAMESPACE -o=go-template 2025-10-13 20:41:20.281965 | controller | --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.jobTemplate.spec.template.spec.nodeSelector 2025-10-13 20:41:20.281970 | controller | }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' 2025-10-13 20:41:20.281976 | controller | | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' 2025-10-13 20:41:20.281982 | controller | - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" 2025-10-13 20:41:20.281987 | controller | | wc -l)' 2025-10-13 20:41:20.281993 | controller | - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' 2025-10-13 20:41:20.281999 | controller | - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs with bad or 2025-10-13 20:41:20.282004 | controller | missing nodeselector:"' 2025-10-13 20:41:20.282010 | controller | - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' 2025-10-13 20:41:20.282016 | controller | - ' exit 1' 2025-10-13 20:41:20.282021 | controller | - ' fi' 2025-10-13 20:41:20.282027 | controller | - ' ]' 2025-10-13 20:41:20.282033 | controller | - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | Checking all cronjobs 2025-10-13 20:41:20.282038 | controller | have expected nodeselector' 2025-10-13 20:41:20.282044 | controller | - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | test step completed 4-' 2025-10-13 20:41:20.282050 | controller | - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/5-cleanup | starting test step 2025-10-13 20:41:20.282059 | controller | 5-cleanup' 2025-10-13 20:41:20.282065 | controller | - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | running command: 2025-10-13 20:41:20.282070 | controller | [sh -c oc annotate namespace $NAMESPACE openshift.io/node-selector-' 2025-10-13 20:41:20.282076 | controller | - ' oc delete --ignore-not-found=true -n $NAMESPACE pvc \' 2025-10-13 20:41:20.282082 | controller | - ' srv-swift-storage-0' 2025-10-13 20:41:20.282087 | controller | - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' 2025-10-13 20:41:20.282093 | controller | - ' oc delete secret -l service-cert -n $NAMESPACE' 2025-10-13 20:41:20.282099 | controller | - ' oc delete secret -l ca-cert -n $NAMESPACE' 2025-10-13 20:41:20.282104 | controller | - ' ]' 2025-10-13 20:41:20.282110 | controller | - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | namespace/openstack-kuttl-tests 2025-10-13 20:41:20.282116 | controller | annotated' 2025-10-13 20:41:20.282121 | controller | - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret "combined-ca-bundle" 2025-10-13 20:41:20.282127 | controller | deleted' 2025-10-13 20:41:20.282133 | controller | - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret "cert-barbican-internal-svc" 2025-10-13 20:41:20.282138 | controller | deleted' 2025-10-13 20:41:20.282144 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-barbican-public-route" 2025-10-13 20:41:20.282150 | controller | deleted' 2025-10-13 20:41:20.282155 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-barbican-public-svc" 2025-10-13 20:41:20.282161 | controller | deleted' 2025-10-13 20:41:20.282167 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ceilometer-internal-svc" 2025-10-13 20:41:20.282172 | controller | deleted' 2025-10-13 20:41:20.282178 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-cinder-internal-svc" 2025-10-13 20:41:20.282184 | controller | deleted' 2025-10-13 20:41:20.282189 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-cinder-public-route" 2025-10-13 20:41:20.282195 | controller | deleted' 2025-10-13 20:41:20.282208 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-cinder-public-svc" 2025-10-13 20:41:20.282216 | controller | deleted' 2025-10-13 20:41:20.282224 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-galera-openstack-cell1-svc" 2025-10-13 20:41:20.282232 | controller | deleted' 2025-10-13 20:41:20.282239 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-galera-openstack-svc" 2025-10-13 20:41:20.282246 | controller | deleted' 2025-10-13 20:41:20.282253 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-glance-default-internal-svc" 2025-10-13 20:41:20.282260 | controller | deleted' 2025-10-13 20:41:20.282267 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-glance-default-public-route" 2025-10-13 20:41:20.282273 | controller | deleted' 2025-10-13 20:41:20.282279 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-glance-default-public-svc" 2025-10-13 20:41:20.282285 | controller | deleted' 2025-10-13 20:41:20.282290 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-keystone-internal-svc" 2025-10-13 20:41:20.282296 | controller | deleted' 2025-10-13 20:41:20.282302 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-keystone-public-route" 2025-10-13 20:41:20.282307 | controller | deleted' 2025-10-13 20:41:20.282313 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-keystone-public-svc" 2025-10-13 20:41:20.282319 | controller | deleted' 2025-10-13 20:41:20.282324 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-kube-state-metrics-svc" 2025-10-13 20:41:20.282330 | controller | deleted' 2025-10-13 20:41:20.282336 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-memcached-svc" 2025-10-13 20:41:20.282344 | controller | deleted' 2025-10-13 20:41:20.282350 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-internal-svc" 2025-10-13 20:41:20.282356 | controller | deleted' 2025-10-13 20:41:20.282365 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-ovndbs" 2025-10-13 20:41:20.282370 | controller | deleted' 2025-10-13 20:41:20.282376 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-public-route" 2025-10-13 20:41:20.282382 | controller | deleted' 2025-10-13 20:41:20.282387 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-public-svc" 2025-10-13 20:41:20.282396 | controller | deleted' 2025-10-13 20:41:20.282419 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-internal-svc" 2025-10-13 20:41:20.282425 | controller | deleted' 2025-10-13 20:41:20.282431 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-novncproxy-cell1-public-route" 2025-10-13 20:41:20.282436 | controller | deleted' 2025-10-13 20:41:20.282442 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" 2025-10-13 20:41:20.282448 | controller | deleted' 2025-10-13 20:41:20.282454 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" 2025-10-13 20:41:20.282459 | controller | deleted' 2025-10-13 20:41:20.282465 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-public-route" 2025-10-13 20:41:20.282471 | controller | deleted' 2025-10-13 20:41:20.282476 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-public-svc" 2025-10-13 20:41:20.282482 | controller | deleted' 2025-10-13 20:41:20.282488 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovn-metrics" 2025-10-13 20:41:20.282493 | controller | deleted' 2025-10-13 20:41:20.282499 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovndbcluster-nb-ovndbs" 2025-10-13 20:41:20.282505 | controller | deleted' 2025-10-13 20:41:20.282510 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovndbcluster-sb-ovndbs" 2025-10-13 20:41:20.282516 | controller | deleted' 2025-10-13 20:41:20.282522 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovnnorthd-ovndbs" 2025-10-13 20:41:20.282528 | controller | deleted' 2025-10-13 20:41:20.282545 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-placement-internal-svc" 2025-10-13 20:41:20.282552 | controller | deleted' 2025-10-13 20:41:20.282559 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-placement-public-route" 2025-10-13 20:41:20.282566 | controller | deleted' 2025-10-13 20:41:20.282573 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-placement-public-svc" 2025-10-13 20:41:20.282580 | controller | deleted' 2025-10-13 20:41:20.282590 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-rabbitmq-cell1-svc" 2025-10-13 20:41:20.282596 | controller | deleted' 2025-10-13 20:41:20.282603 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-rabbitmq-svc" 2025-10-13 20:41:20.282609 | controller | deleted' 2025-10-13 20:41:20.282616 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-swift-internal-svc" 2025-10-13 20:41:20.282622 | controller | deleted' 2025-10-13 20:41:20.282628 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-swift-public-route" 2025-10-13 20:41:20.282635 | controller | deleted' 2025-10-13 20:41:20.282641 | controller | - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-swift-public-svc" 2025-10-13 20:41:20.282648 | controller | deleted' 2025-10-13 20:41:20.282654 | controller | - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-internal" 2025-10-13 20:41:20.282667 | controller | deleted' 2025-10-13 20:41:20.282682 | controller | - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-libvirt" 2025-10-13 20:41:20.282690 | controller | deleted' 2025-10-13 20:41:20.282698 | controller | - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-ovn" 2025-10-13 20:41:20.282705 | controller | deleted' 2025-10-13 20:41:20.282713 | controller | - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-public" 2025-10-13 20:41:20.282719 | controller | deleted' 2025-10-13 20:41:20.282725 | controller | - ' logger.go:42: 20:19:03 | ctlplane-nodeselectors/5-cleanup | test step completed 2025-10-13 20:41:20.282731 | controller | 5-cleanup' 2025-10-13 20:41:20.282737 | controller | - ' logger.go:42: 20:19:03 | ctlplane-nodeselectors | skipping kubernetes event 2025-10-13 20:41:20.282742 | controller | logging' 2025-10-13 20:41:20.282748 | controller | - === NAME kuttl 2025-10-13 20:41:20.282754 | controller | - ' harness.go:406: run tests finished' 2025-10-13 20:41:20.282759 | controller | - ' harness.go:514: cleaning up' 2025-10-13 20:41:20.282765 | controller | - ' harness.go:571: removing temp folder: ""' 2025-10-13 20:41:20.282771 | controller | - '--- PASS: kuttl (361.27s)' 2025-10-13 20:41:20.282777 | controller | - ' --- PASS: kuttl/harness (0.00s)' 2025-10-13 20:41:20.282786 | controller | - ' --- PASS: kuttl/harness/ctlplane-nodeselectors (359.74s)' 2025-10-13 20:41:20.282792 | controller | - PASS 2025-10-13 20:41:20.282797 | controller | - No resources found 2025-10-13 20:41:20.282803 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.282809 | controller | - bash scripts/retry_make_crc_storage_cleanup.sh 3 2025-10-13 20:41:20.282815 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.282820 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.282826 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.282832 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.282838 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.282843 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.282849 | controller | - + cat 2025-10-13 20:41:20.282855 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.282861 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.282876 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.282882 | controller | do sleep 1; done" 2025-10-13 20:41:20.282888 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.282893 | controller | - crc-storage Active 2025-10-13 20:41:20.282899 | controller | - oc project crc-storage 2025-10-13 20:41:20.282905 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.282910 | controller | - bash scripts/cleanup-crc-pv.sh 2025-10-13 20:41:20.282916 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.282922 | controller | - ++ grep Bound 2025-10-13 20:41:20.282927 | controller | - ++ awk '{print $6}' 2025-10-13 20:41:20.282933 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.282939 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.282944 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.282950 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.282956 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.282961 | controller | - ++ echo openstack-kuttl-tests/swift-swift-storage-0 2025-10-13 20:41:20.282967 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.282973 | controller | - + NAME=swift-swift-storage-0 2025-10-13 20:41:20.282978 | controller | - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found 2025-10-13 20:41:20.282984 | controller | - persistentvolumeclaim "swift-swift-storage-0" deleted 2025-10-13 20:41:20.282993 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.282998 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.283004 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.283010 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.283015 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.283021 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.283027 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.283032 | controller | - + NAME=mysql-db-openstack-cell1-galera-0 2025-10-13 20:41:20.283038 | controller | - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found 2025-10-13 20:41:20.283044 | controller | - persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted 2025-10-13 20:41:20.283050 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.283055 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.283061 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.283067 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.283072 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.283078 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 2025-10-13 20:41:20.283084 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.283089 | controller | - + NAME=glance-glance-default-internal-api-0 2025-10-13 20:41:20.283095 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found 2025-10-13 20:41:20.283101 | controller | - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted 2025-10-13 20:41:20.283106 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.283112 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.283118 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.283123 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.283129 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.283135 | controller | - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 2025-10-13 20:41:20.283140 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.283146 | controller | - + NAME=glance-glance-default-external-api-0 2025-10-13 20:41:20.283160 | controller | - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found 2025-10-13 20:41:20.283167 | controller | - persistentvolumeclaim "glance-glance-default-external-api-0" deleted 2025-10-13 20:41:20.283175 | controller | - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep 2025-10-13 20:41:20.283183 | controller | Bound | awk '{print $6}'` 2025-10-13 20:41:20.283191 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.283196 | controller | - ++ cut -d / -f 1 2025-10-13 20:41:20.283202 | controller | - + NS=openstack-kuttl-tests 2025-10-13 20:41:20.283208 | controller | - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 2025-10-13 20:41:20.283214 | controller | - ++ cut -d / -f 2 2025-10-13 20:41:20.283219 | controller | - + NAME=mysql-db-openstack-galera-0 2025-10-13 20:41:20.283225 | controller | - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found 2025-10-13 20:41:20.283231 | controller | - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted 2025-10-13 20:41:20.283237 | controller | - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers 2025-10-13 20:41:20.283242 | controller | - ++ awk '{print $1}' 2025-10-13 20:41:20.283248 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283254 | controller | '{print $1}'` 2025-10-13 20:41:20.283259 | controller | - + oc delete pv/local-storage01-crc 2025-10-13 20:41:20.283265 | controller | - persistentvolume "local-storage01-crc" deleted 2025-10-13 20:41:20.283271 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283276 | controller | '{print $1}'` 2025-10-13 20:41:20.283282 | controller | - + oc delete pv/local-storage02-crc 2025-10-13 20:41:20.283291 | controller | - persistentvolume "local-storage02-crc" deleted 2025-10-13 20:41:20.283297 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283302 | controller | '{print $1}'` 2025-10-13 20:41:20.283308 | controller | - + oc delete pv/local-storage03-crc 2025-10-13 20:41:20.283314 | controller | - persistentvolume "local-storage03-crc" deleted 2025-10-13 20:41:20.283320 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283325 | controller | '{print $1}'` 2025-10-13 20:41:20.283331 | controller | - + oc delete pv/local-storage04-crc 2025-10-13 20:41:20.283337 | controller | - persistentvolume "local-storage04-crc" deleted 2025-10-13 20:41:20.283343 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283349 | controller | '{print $1}'` 2025-10-13 20:41:20.283354 | controller | - + oc delete pv/local-storage05-crc 2025-10-13 20:41:20.283360 | controller | - persistentvolume "local-storage05-crc" deleted 2025-10-13 20:41:20.283366 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283372 | controller | '{print $1}'` 2025-10-13 20:41:20.283377 | controller | - + oc delete pv/local-storage06-crc 2025-10-13 20:41:20.283383 | controller | - persistentvolume "local-storage06-crc" deleted 2025-10-13 20:41:20.283389 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283397 | controller | '{print $1}'` 2025-10-13 20:41:20.283418 | controller | - + oc delete pv/local-storage07-crc 2025-10-13 20:41:20.283424 | controller | - persistentvolume "local-storage07-crc" deleted 2025-10-13 20:41:20.283430 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283436 | controller | '{print $1}'` 2025-10-13 20:41:20.283442 | controller | - + oc delete pv/local-storage08-crc 2025-10-13 20:41:20.283447 | controller | - persistentvolume "local-storage08-crc" deleted 2025-10-13 20:41:20.283453 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283459 | controller | '{print $1}'` 2025-10-13 20:41:20.283465 | controller | - + oc delete pv/local-storage09-crc 2025-10-13 20:41:20.283470 | controller | - persistentvolume "local-storage09-crc" deleted 2025-10-13 20:41:20.283476 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283482 | controller | '{print $1}'` 2025-10-13 20:41:20.283488 | controller | - + oc delete pv/local-storage10-crc 2025-10-13 20:41:20.283493 | controller | - persistentvolume "local-storage10-crc" deleted 2025-10-13 20:41:20.283499 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283505 | controller | '{print $1}'` 2025-10-13 20:41:20.283514 | controller | - + oc delete pv/local-storage11-crc 2025-10-13 20:41:20.283520 | controller | - persistentvolume "local-storage11-crc" deleted 2025-10-13 20:41:20.283526 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283531 | controller | '{print $1}'` 2025-10-13 20:41:20.283537 | controller | - + oc delete pv/local-storage12-crc 2025-10-13 20:41:20.283543 | controller | - persistentvolume "local-storage12-crc" deleted 2025-10-13 20:41:20.283549 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283554 | controller | '{print $1}'` 2025-10-13 20:41:20.283560 | controller | - + oc delete pv/local-storage13-crc 2025-10-13 20:41:20.283566 | controller | - persistentvolume "local-storage13-crc" deleted 2025-10-13 20:41:20.283572 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283577 | controller | '{print $1}'` 2025-10-13 20:41:20.283583 | controller | - + oc delete pv/local-storage14-crc 2025-10-13 20:41:20.283589 | controller | - persistentvolume "local-storage14-crc" deleted 2025-10-13 20:41:20.283595 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283600 | controller | '{print $1}'` 2025-10-13 20:41:20.283609 | controller | - + oc delete pv/local-storage15-crc 2025-10-13 20:41:20.283615 | controller | - persistentvolume "local-storage15-crc" deleted 2025-10-13 20:41:20.283621 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283626 | controller | '{print $1}'` 2025-10-13 20:41:20.283632 | controller | - + oc delete pv/local-storage16-crc 2025-10-13 20:41:20.283638 | controller | - persistentvolume "local-storage16-crc" deleted 2025-10-13 20:41:20.283644 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283657 | controller | '{print $1}'` 2025-10-13 20:41:20.283666 | controller | - + oc delete pv/local-storage17-crc 2025-10-13 20:41:20.283674 | controller | - persistentvolume "local-storage17-crc" deleted 2025-10-13 20:41:20.283681 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283689 | controller | '{print $1}'` 2025-10-13 20:41:20.283696 | controller | - + oc delete pv/local-storage18-crc 2025-10-13 20:41:20.283702 | controller | - persistentvolume "local-storage18-crc" deleted 2025-10-13 20:41:20.283707 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283713 | controller | '{print $1}'` 2025-10-13 20:41:20.283719 | controller | - + oc delete pv/local-storage19-crc 2025-10-13 20:41:20.283725 | controller | - persistentvolume "local-storage19-crc" deleted 2025-10-13 20:41:20.283731 | controller | - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk 2025-10-13 20:41:20.283736 | controller | '{print $1}'` 2025-10-13 20:41:20.283742 | controller | - + oc delete pv/local-storage20-crc 2025-10-13 20:41:20.283748 | controller | - persistentvolume "local-storage20-crc" deleted 2025-10-13 20:41:20.283754 | controller | - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi 2025-10-13 20:41:20.283759 | controller | - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE 2025-10-13 20:41:20.283765 | controller | - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 6m10s 2025-10-13 20:41:20.283771 | controller | - storageclass.storage.k8s.io "local-storage" deleted 2025-10-13 20:41:20.283777 | controller | - bash scripts/delete-pv.sh 2025-10-13 20:41:20.283782 | controller | - +++ dirname scripts/delete-pv.sh 2025-10-13 20:41:20.283788 | controller | - ++ cd scripts 2025-10-13 20:41:20.283794 | controller | - ++ pwd -P 2025-10-13 20:41:20.283800 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.283806 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.283811 | controller | - ++ set -ex 2025-10-13 20:41:20.283817 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.283823 | controller | - ++ cat 2025-10-13 20:41:20.283829 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.283835 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.283840 | controller | - ++ cat 2025-10-13 20:41:20.283846 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.283852 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.283858 | controller | - ++ cat 2025-10-13 20:41:20.283863 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.283869 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.283875 | controller | - ++ cat 2025-10-13 20:41:20.283881 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.283886 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.283892 | controller | - + PV_NUM=20 2025-10-13 20:41:20.283902 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.283907 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.283913 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.283919 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.283925 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.283930 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.283936 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.283944 | controller | crc delete 2025-10-13 20:41:20.283950 | controller | - ++ set -ex 2025-10-13 20:41:20.283956 | controller | - ++ NODE=crc 2025-10-13 20:41:20.283962 | controller | - ++ OPERATION=delete 2025-10-13 20:41:20.283967 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.283973 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.283979 | controller | - ++ cat 2025-10-13 20:41:20.283984 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.283990 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.283998 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.284004 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.284009 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.284015 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.284023 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.284028 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.284034 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.284040 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.284046 | controller | --timeout 500s 2025-10-13 20:41:20.284051 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.284057 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.284063 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.284068 | controller | - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.284074 | controller | - bash scripts/retry_make_crc_storage.sh 3 2025-10-13 20:41:20.284080 | controller | - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.284085 | controller | - bash scripts/gen-namespace.sh 2025-10-13 20:41:20.284091 | controller | - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' 2025-10-13 20:41:20.284097 | controller | - + '[' -z crc-storage ']' 2025-10-13 20:41:20.284102 | controller | - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage 2025-10-13 20:41:20.284108 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' 2025-10-13 20:41:20.284114 | controller | - + cat 2025-10-13 20:41:20.284120 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:41:20.284125 | controller | - namespace/crc-storage unchanged 2025-10-13 20:41:20.284141 | controller | - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); 2025-10-13 20:41:20.284150 | controller | do sleep 1; done" 2025-10-13 20:41:20.284158 | controller | - NAME DISPLAY NAME STATUS 2025-10-13 20:41:20.284165 | controller | - crc-storage Active 2025-10-13 20:41:20.284173 | controller | - oc project crc-storage 2025-10-13 20:41:20.284179 | controller | - Already on project "crc-storage" on server "https://api.crc.testing:6443". 2025-10-13 20:41:20.284184 | controller | - bash scripts/create-pv.sh 2025-10-13 20:41:20.284190 | controller | - +++ dirname scripts/create-pv.sh 2025-10-13 20:41:20.284196 | controller | - ++ cd scripts 2025-10-13 20:41:20.284202 | controller | - ++ pwd -P 2025-10-13 20:41:20.284207 | controller | - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts 2025-10-13 20:41:20.284213 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh 2025-10-13 20:41:20.284219 | controller | - ++ set -ex 2025-10-13 20:41:20.284224 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.284230 | controller | - ++ cat 2025-10-13 20:41:20.284236 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.284241 | controller | - configmap/crc-storage unchanged 2025-10-13 20:41:20.284250 | controller | - ++ cat 2025-10-13 20:41:20.284256 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.284262 | controller | - serviceaccount/crc-storage unchanged 2025-10-13 20:41:20.284267 | controller | - ++ cat 2025-10-13 20:41:20.284273 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.284279 | controller | - role.rbac.authorization.k8s.io/crc-storage-role unchanged 2025-10-13 20:41:20.284284 | controller | - ++ cat 2025-10-13 20:41:20.284290 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.284296 | controller | - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged 2025-10-13 20:41:20.284301 | controller | - + PV_NUM=20 2025-10-13 20:41:20.284307 | controller | - + TIMEOUT=500s 2025-10-13 20:41:20.284313 | controller | - ++ oc get pv -o json 2025-10-13 20:41:20.284318 | controller | - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' 2025-10-13 20:41:20.284324 | controller | - + released= 2025-10-13 20:41:20.284330 | controller | - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' 2025-10-13 20:41:20.284335 | controller | -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.284341 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.284347 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.284352 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.284358 | controller | - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh 2025-10-13 20:41:20.284364 | controller | crc create 2025-10-13 20:41:20.284370 | controller | - ++ set -ex 2025-10-13 20:41:20.284375 | controller | - ++ NODE=crc 2025-10-13 20:41:20.284381 | controller | - ++ OPERATION=create 2025-10-13 20:41:20.284387 | controller | - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found 2025-10-13 20:41:20.284395 | controller | - job.batch "crc-storage-crc" deleted 2025-10-13 20:41:20.284412 | controller | - ++ cat 2025-10-13 20:41:20.284421 | controller | - ++ oc apply -f - 2025-10-13 20:41:20.284427 | controller | - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" 2025-10-13 20:41:20.284432 | controller | must not set securityContext.privileged=true), allowPrivilegeEscalation != false 2025-10-13 20:41:20.284438 | controller | (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted 2025-10-13 20:41:20.284444 | controller | capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), 2025-10-13 20:41:20.284450 | controller | restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), 2025-10-13 20:41:20.284455 | controller | runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), 2025-10-13 20:41:20.284461 | controller | runAsUser=0 (pod and container "storage" must not set runAsUser=0)' 2025-10-13 20:41:20.284467 | controller | - job.batch/crc-storage-crc created 2025-10-13 20:41:20.284476 | controller | - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete 2025-10-13 20:41:20.284481 | controller | --timeout 500s 2025-10-13 20:41:20.284487 | controller | - job.batch/crc-storage-crc condition met 2025-10-13 20:41:20.284493 | controller | - bash scripts/gen-crc-pv-kustomize.sh 2025-10-13 20:41:20.284498 | controller | - + OUT=/home/zuul/ci-framework-data/artifacts/manifests 2025-10-13 20:41:20.284504 | controller | - + '[' -z '"local-storage"' ']' 2025-10-13 20:41:20.284510 | controller | - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' 2025-10-13 20:41:20.284516 | controller | - + PV_NUM=20 2025-10-13 20:41:20.284521 | controller | - + STORAGE_CAPACITY=10 2025-10-13 20:41:20.284527 | controller | - ++ oc get node -o name -l node-role.kubernetes.io/worker 2025-10-13 20:41:20.284533 | controller | - ++ head -c-1 2025-10-13 20:41:20.284538 | controller | - ++ sed -e 's|node/||' 2025-10-13 20:41:20.284544 | controller | - ++ tr '\n' ' ' 2025-10-13 20:41:20.284550 | controller | - + NODE_NAMES=crc 2025-10-13 20:41:20.284555 | controller | - + '[' -z crc ']' 2025-10-13 20:41:20.284561 | controller | - + cat 2025-10-13 20:41:20.284567 | controller | - + for node in $NODE_NAMES 2025-10-13 20:41:20.284572 | controller | - ++ seq -w 20 2025-10-13 20:41:20.284578 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284584 | controller | - + cat 2025-10-13 20:41:20.284589 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284595 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284604 | controller | - + cat 2025-10-13 20:41:20.284609 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284615 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284621 | controller | - + cat 2025-10-13 20:41:20.284626 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284632 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284638 | controller | - + cat 2025-10-13 20:41:20.284643 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284649 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284655 | controller | - + cat 2025-10-13 20:41:20.284660 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284666 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284672 | controller | - + cat 2025-10-13 20:41:20.284677 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284683 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284689 | controller | - + cat 2025-10-13 20:41:20.284694 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284700 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284706 | controller | - + cat 2025-10-13 20:41:20.284711 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284717 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284723 | controller | - + cat 2025-10-13 20:41:20.284728 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284734 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284740 | controller | - + cat 2025-10-13 20:41:20.284745 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284751 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284757 | controller | - + cat 2025-10-13 20:41:20.284762 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284768 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284774 | controller | - + cat 2025-10-13 20:41:20.284779 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284785 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284798 | controller | - + cat 2025-10-13 20:41:20.284806 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284814 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284822 | controller | - + cat 2025-10-13 20:41:20.284829 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284836 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284841 | controller | - + cat 2025-10-13 20:41:20.284847 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284853 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284858 | controller | - + cat 2025-10-13 20:41:20.284864 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284870 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284875 | controller | - + cat 2025-10-13 20:41:20.284881 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284887 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284892 | controller | - + cat 2025-10-13 20:41:20.284898 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284910 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284916 | controller | - + cat 2025-10-13 20:41:20.284922 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284927 | controller | - + for i in `seq -w $PV_NUM` 2025-10-13 20:41:20.284933 | controller | - + cat 2025-10-13 20:41:20.284939 | controller | - ++ sed -e 's/^"//' -e 's/"$//' 2025-10-13 20:41:20.284944 | controller | - + cat 2025-10-13 20:41:20.284950 | controller | - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:41:20.284956 | controller | - storageclass.storage.k8s.io/local-storage created 2025-10-13 20:41:20.284963 | controller | - persistentvolume/local-storage01-crc created 2025-10-13 20:41:20.284970 | controller | - persistentvolume/local-storage02-crc created 2025-10-13 20:41:20.284976 | controller | - persistentvolume/local-storage03-crc created 2025-10-13 20:41:20.284983 | controller | - persistentvolume/local-storage04-crc created 2025-10-13 20:41:20.284989 | controller | - persistentvolume/local-storage05-crc created 2025-10-13 20:41:20.284995 | controller | - persistentvolume/local-storage06-crc created 2025-10-13 20:41:20.285001 | controller | - persistentvolume/local-storage07-crc created 2025-10-13 20:41:20.285006 | controller | - persistentvolume/local-storage08-crc created 2025-10-13 20:41:20.285015 | controller | - persistentvolume/local-storage09-crc created 2025-10-13 20:41:20.285021 | controller | - persistentvolume/local-storage10-crc created 2025-10-13 20:41:20.285027 | controller | - persistentvolume/local-storage11-crc created 2025-10-13 20:41:20.285032 | controller | - persistentvolume/local-storage12-crc created 2025-10-13 20:41:20.285038 | controller | - persistentvolume/local-storage13-crc created 2025-10-13 20:41:20.285044 | controller | - persistentvolume/local-storage14-crc created 2025-10-13 20:41:20.285049 | controller | - persistentvolume/local-storage15-crc created 2025-10-13 20:41:20.285055 | controller | - persistentvolume/local-storage16-crc created 2025-10-13 20:41:20.285060 | controller | - persistentvolume/local-storage17-crc created 2025-10-13 20:41:20.285066 | controller | - persistentvolume/local-storage18-crc created 2025-10-13 20:41:20.285072 | controller | - persistentvolume/local-storage19-crc created 2025-10-13 20:41:20.285077 | controller | - persistentvolume/local-storage20-crc created 2025-10-13 20:41:20.285083 | controller | - persistentvolumeclaim/ansible-ee-logs unchanged 2025-10-13 20:41:20.285089 | controller | - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.285095 | controller | - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.285103 | controller | - '2025/10/13 20:19:25 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.285109 | controller | ]' 2025-10-13 20:41:20.285115 | controller | - === RUN kuttl 2025-10-13 20:41:20.285121 | controller | - ' harness.go:463: starting setup' 2025-10-13 20:41:20.285126 | controller | - ' harness.go:255: running tests using configured kubeconfig.' 2025-10-13 20:41:20.285132 | controller | - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' 2025-10-13 20:41:20.285138 | controller | - ' logger.go:42: 20:19:25 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.285143 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' 2025-10-13 20:41:20.285149 | controller | - ' logger.go:42: 20:19:26 | | netconfig.network.openstack.org/netconfig configured' 2025-10-13 20:41:20.285155 | controller | - ' logger.go:42: 20:19:26 | | running command: [oc apply -n openstack-kuttl-tests 2025-10-13 20:41:20.285161 | controller | -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' 2025-10-13 20:41:20.285166 | controller | - ' logger.go:42: 20:19:26 | | dnsmasq.network.openstack.org/dnsmasq configured' 2025-10-13 20:41:20.285172 | controller | - ' logger.go:42: 20:19:26 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa 2025-10-13 20:41:20.285178 | controller | ]; then' 2025-10-13 20:41:20.285184 | controller | - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' 2025-10-13 20:41:20.285189 | controller | - ' fi' 2025-10-13 20:41:20.285195 | controller | - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' 2025-10-13 20:41:20.285201 | controller | - ' --save-config \' 2025-10-13 20:41:20.285206 | controller | - ' --dry-run=client \' 2025-10-13 20:41:20.285212 | controller | - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.285218 | controller | - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' 2025-10-13 20:41:20.285223 | controller | - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' 2025-10-13 20:41:20.285229 | controller | - ' -n openstack-kuttl-tests \' 2025-10-13 20:41:20.285235 | controller | - ' -o yaml | \' 2025-10-13 20:41:20.285240 | controller | - ' oc apply -f -' 2025-10-13 20:41:20.285246 | controller | - ' ]' 2025-10-13 20:41:20.285252 | controller | - ' logger.go:42: 20:19:27 | | secret/dataplane-ansible-ssh-private-key-secret 2025-10-13 20:41:20.285258 | controller | configured' 2025-10-13 20:41:20.285263 | controller | - ' harness.go:363: running tests' 2025-10-13 20:41:20.285269 | controller | - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each 2025-10-13 20:41:20.285277 | controller | step' 2025-10-13 20:41:20.285291 | controller | - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests 2025-10-13 20:41:20.285299 | controller | has 19 tests' 2025-10-13 20:41:20.285306 | controller | - === RUN kuttl/harness 2025-10-13 20:41:20.285314 | controller | - === RUN kuttl/harness/ctlplane-tls-cert-rotation 2025-10-13 20:41:20.285321 | controller | - === PAUSE kuttl/harness/ctlplane-tls-cert-rotation 2025-10-13 20:41:20.285327 | controller | - === CONT kuttl/harness/ctlplane-tls-cert-rotation 2025-10-13 20:41:20.285333 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation | Skipping creation of 2025-10-13 20:41:20.285338 | controller | user-supplied namespace: openstack-kuttl-tests' 2025-10-13 20:41:20.285344 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285350 | controller | | starting test step 0-deploy-openstack-tls-ingress-only' 2025-10-13 20:41:20.285356 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285361 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/tls/tls_ingress 2025-10-13 20:41:20.285367 | controller | | oc apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.285373 | controller | - ' ]' 2025-10-13 20:41:20.285379 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285384 | controller | | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.285390 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.285399 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285419 | controller | | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate 2025-10-13 20:41:20.285425 | controller | for production! For production use at least 5G!' 2025-10-13 20:41:20.285431 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285436 | controller | | openstackcontrolplane.core.openstack.org/openstack created' 2025-10-13 20:41:20.285442 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285448 | controller | | running command: [sh -c echo "Waiting for OpenStack control plane to be ready..."' 2025-10-13 20:41:20.285453 | controller | - ' oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s 2025-10-13 20:41:20.285459 | controller | -l core.openstack.org/openstackcontrolplane' 2025-10-13 20:41:20.285465 | controller | - ' ]' 2025-10-13 20:41:20.285471 | controller | - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285479 | controller | | Waiting for OpenStack control plane to be ready...' 2025-10-13 20:41:20.285485 | controller | - ' logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285491 | controller | | openstackcontrolplane.core.openstack.org/openstack condition met' 2025-10-13 20:41:20.285497 | controller | - ' logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285502 | controller | | running command: [sh -c echo "Fail if internal https endpoints are registered"' 2025-10-13 20:41:20.285510 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -c "openstack endpoint 2025-10-13 20:41:20.285516 | controller | list --interface internal -f value -c URL" | grep ''https:'' && exit 1' 2025-10-13 20:41:20.285522 | controller | - ' exit 0' 2025-10-13 20:41:20.285528 | controller | - ' ]' 2025-10-13 20:41:20.285533 | controller | - ' logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285539 | controller | | Fail if internal https endpoints are registered' 2025-10-13 20:41:20.285545 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285554 | controller | | running command: [sh -c echo "check ovn sb internalDbAddress use tcp"' 2025-10-13 20:41:20.285560 | controller | - ' oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} 2025-10-13 20:41:20.285565 | controller | | grep -q tcp' 2025-10-13 20:41:20.285571 | controller | - ' ]' 2025-10-13 20:41:20.285577 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285582 | controller | | check ovn sb internalDbAddress use tcp' 2025-10-13 20:41:20.285588 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285594 | controller | | running command: [sh -c echo "check ovn sb DB connection use tcp"' 2025-10-13 20:41:20.285602 | controller | - ' oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c "ovn-sbctl 2025-10-13 20:41:20.285608 | controller | --no-leader-only get-connection | grep -q ptcp"' 2025-10-13 20:41:20.285614 | controller | - ' ]' 2025-10-13 20:41:20.285619 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285625 | controller | | check ovn sb DB connection use tcp' 2025-10-13 20:41:20.285631 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285637 | controller | | Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter' 2025-10-13 20:41:20.285642 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285648 | controller | | running command: [sh -c echo "check nova transport_url use tcp"' 2025-10-13 20:41:20.285662 | controller | - ' oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c "grep 2025-10-13 20:41:20.285670 | controller | transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q ''ssl=0''"' 2025-10-13 20:41:20.285677 | controller | - ' ]' 2025-10-13 20:41:20.285685 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285693 | controller | | check nova transport_url use tcp' 2025-10-13 20:41:20.285700 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285705 | controller | | running command: [sh -c echo "check neutron ovn_sb_connection url tcp address"' 2025-10-13 20:41:20.285711 | controller | - ' oc exec -i deployment/neutron -n $NAMESPACE -- bash -c "grep ovn_sb_connection 2025-10-13 20:41:20.285717 | controller | /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp"' 2025-10-13 20:41:20.285722 | controller | - ' ]' 2025-10-13 20:41:20.285728 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285734 | controller | | check neutron ovn_sb_connection url tcp address' 2025-10-13 20:41:20.285740 | controller | - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285745 | controller | | Defaulted container "neutron-api" out of: neutron-api, neutron-httpd' 2025-10-13 20:41:20.285751 | controller | - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285757 | controller | | running command: [sh -c echo "Waiting for OpenStack control plane to be ready..."' 2025-10-13 20:41:20.285763 | controller | - ' oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s 2025-10-13 20:41:20.285768 | controller | -l core.openstack.org/openstackcontrolplane' 2025-10-13 20:41:20.285774 | controller | - ' ]' 2025-10-13 20:41:20.285780 | controller | - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285785 | controller | | Waiting for OpenStack control plane to be ready...' 2025-10-13 20:41:20.285791 | controller | - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285797 | controller | | openstackcontrolplane.core.openstack.org/openstack condition met' 2025-10-13 20:41:20.285806 | controller | - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285812 | controller | | running command: [sh -c echo "Fail if internal https endpoints are registered"' 2025-10-13 20:41:20.285817 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -c "openstack endpoint 2025-10-13 20:41:20.285823 | controller | list --interface internal -f value -c URL" | grep ''https:'' && exit 1' 2025-10-13 20:41:20.285829 | controller | - ' exit 0' 2025-10-13 20:41:20.285834 | controller | - ' ]' 2025-10-13 20:41:20.285840 | controller | - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285846 | controller | | Fail if internal https endpoints are registered' 2025-10-13 20:41:20.285851 | controller | - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285857 | controller | | running command: [sh -c echo "check ovn sb internalDbAddress use tcp"' 2025-10-13 20:41:20.285863 | controller | - ' oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} 2025-10-13 20:41:20.285868 | controller | | grep -q tcp' 2025-10-13 20:41:20.285874 | controller | - ' ]' 2025-10-13 20:41:20.285880 | controller | - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285885 | controller | | check ovn sb internalDbAddress use tcp' 2025-10-13 20:41:20.285891 | controller | - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285897 | controller | | running command: [sh -c echo "check ovn sb DB connection use tcp"' 2025-10-13 20:41:20.285903 | controller | - ' oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c "ovn-sbctl 2025-10-13 20:41:20.285908 | controller | --no-leader-only get-connection | grep -q ptcp"' 2025-10-13 20:41:20.285914 | controller | - ' ]' 2025-10-13 20:41:20.285923 | controller | - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285928 | controller | | check ovn sb DB connection use tcp' 2025-10-13 20:41:20.285934 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285940 | controller | | Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter' 2025-10-13 20:41:20.285945 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285951 | controller | | running command: [sh -c echo "check nova transport_url use tcp"' 2025-10-13 20:41:20.285957 | controller | - ' oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c "grep 2025-10-13 20:41:20.285962 | controller | transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q ''ssl=0''"' 2025-10-13 20:41:20.285968 | controller | - ' ]' 2025-10-13 20:41:20.285974 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285979 | controller | | check nova transport_url use tcp' 2025-10-13 20:41:20.285985 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.285991 | controller | | running command: [sh -c echo "check neutron ovn_sb_connection url tcp address"' 2025-10-13 20:41:20.286004 | controller | - ' oc exec -i deployment/neutron -n $NAMESPACE -- bash -c "grep ovn_sb_connection 2025-10-13 20:41:20.286011 | controller | /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp"' 2025-10-13 20:41:20.286019 | controller | - ' ]' 2025-10-13 20:41:20.286027 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.286034 | controller | | check neutron ovn_sb_connection url tcp address' 2025-10-13 20:41:20.286040 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.286046 | controller | | Defaulted container "neutron-api" out of: neutron-api, neutron-httpd' 2025-10-13 20:41:20.286055 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only 2025-10-13 20:41:20.286061 | controller | | test step completed 0-deploy-openstack-tls-ingress-only' 2025-10-13 20:41:20.286067 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/1-deploy-openstack | starting 2025-10-13 20:41:20.286072 | controller | test step 1-deploy-openstack' 2025-10-13 20:41:20.286078 | controller | - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/1-deploy-openstack | running 2025-10-13 20:41:20.286084 | controller | command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane 2025-10-13 20:41:20.286089 | controller | | oc apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.286095 | controller | - ' ]' 2025-10-13 20:41:20.286101 | controller | - ' logger.go:42: 20:23:26 | ctlplane-tls-cert-rotation/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack 2025-10-13 20:41:20.286106 | controller | configured' 2025-10-13 20:41:20.286112 | controller | - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/1-deploy-openstack | test 2025-10-13 20:41:20.286118 | controller | step completed 1-deploy-openstack' 2025-10-13 20:41:20.286124 | controller | - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286129 | controller | starting test step 2-get-endpoints-certs' 2025-10-13 20:41:20.286135 | controller | - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286141 | controller | running command: [sh -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.286146 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.286152 | controller | > /tmp/endpoint_fingerprints_before' 2025-10-13 20:41:20.286158 | controller | - ' ]' 2025-10-13 20:41:20.286163 | controller | - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286169 | controller | Get fingerprints of all service certs' 2025-10-13 20:41:20.286175 | controller | - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286180 | controller | ++ openstack endpoint list -c URL -f value' 2025-10-13 20:41:20.286186 | controller | - ' logger.go:42: 20:26:11 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286192 | controller | ++ awk -F/ ''{print $3}''' 2025-10-13 20:41:20.286198 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286203 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.286209 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286215 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.286220 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286226 | controller | ++ echo nova-internal.openstack-kuttl-tests.svc:8774' 2025-10-13 20:41:20.286232 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286237 | controller | + host_port=nova-internal.openstack-kuttl-tests.svc:8774' 2025-10-13 20:41:20.286243 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286249 | controller | + [[ ! nova-internal.openstack-kuttl-tests.svc:8774 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.286257 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286263 | controller | ++ openssl s_client -connect nova-internal.openstack-kuttl-tests.svc:8774' 2025-10-13 20:41:20.286269 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286274 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.286280 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286286 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.286294 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286300 | controller | + finger_print=69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE' 2025-10-13 20:41:20.286308 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286314 | controller | + [[ -n 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE ]]' 2025-10-13 20:41:20.286319 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286325 | controller | + echo ''nova-internal.openstack-kuttl-tests.svc:8774 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE''' 2025-10-13 20:41:20.286331 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286337 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.286350 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286358 | controller | ++ echo glance-default-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.286366 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286374 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.286381 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286386 | controller | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.286395 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286412 | controller | + [[ ! glance-default-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ 2025-10-13 20:41:20.286421 | controller | ]]' 2025-10-13 20:41:20.286427 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286433 | controller | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.286439 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286444 | controller | ++ openssl s_client -connect glance-default-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.286450 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286456 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.286461 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286467 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.286473 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286478 | controller | + finger_print=3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB' 2025-10-13 20:41:20.286484 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286490 | controller | + [[ -n 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB ]]' 2025-10-13 20:41:20.286495 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286501 | controller | + echo ''glance-default-public-openstack-kuttl-tests.apps-crc.testing:443 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB''' 2025-10-13 20:41:20.286507 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286513 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.286518 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286524 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.286530 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286535 | controller | ++ echo swift-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.286544 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286550 | controller | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.286556 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286561 | controller | + [[ ! swift-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.286580 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286587 | controller | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.286593 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286600 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.286606 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286619 | controller | ++ openssl s_client -connect swift-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.286625 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286631 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.286638 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286644 | controller | + finger_print=FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A' 2025-10-13 20:41:20.286650 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286657 | controller | + [[ -n FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A ]]' 2025-10-13 20:41:20.286663 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286669 | controller | + echo ''swift-public-openstack-kuttl-tests.apps-crc.testing:443 FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A''' 2025-10-13 20:41:20.286676 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286682 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.286688 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286703 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.286711 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286718 | controller | ++ echo glance-default-internal.openstack-kuttl-tests.svc:9292' 2025-10-13 20:41:20.286726 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286734 | controller | + host_port=glance-default-internal.openstack-kuttl-tests.svc:9292' 2025-10-13 20:41:20.286740 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286746 | controller | + [[ ! glance-default-internal.openstack-kuttl-tests.svc:9292 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.286752 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286757 | controller | ++ openssl s_client -connect glance-default-internal.openstack-kuttl-tests.svc:9292' 2025-10-13 20:41:20.286763 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286769 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.286774 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286780 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.286789 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286795 | controller | + finger_print=82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69' 2025-10-13 20:41:20.286800 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286809 | controller | + [[ -n 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69 ]]' 2025-10-13 20:41:20.286815 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286820 | controller | + echo ''glance-default-internal.openstack-kuttl-tests.svc:9292 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69''' 2025-10-13 20:41:20.286826 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286832 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.286837 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286843 | controller | ++ echo cinder-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.286849 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286854 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.286860 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286866 | controller | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.286871 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286877 | controller | + [[ ! cinder-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.286883 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286888 | controller | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.286894 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286899 | controller | ++ openssl s_client -connect cinder-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.286907 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286913 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.286919 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286925 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.286930 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286936 | controller | + finger_print=30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF' 2025-10-13 20:41:20.286942 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286947 | controller | + [[ -n 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF ]]' 2025-10-13 20:41:20.286953 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286959 | controller | + echo ''cinder-public-openstack-kuttl-tests.apps-crc.testing:443 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF''' 2025-10-13 20:41:20.286964 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286970 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.286976 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286981 | controller | ++ echo placement-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.286987 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.286993 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.286998 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287011 | controller | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.287019 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287027 | controller | + [[ ! placement-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.287039 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287046 | controller | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.287051 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287057 | controller | ++ openssl s_client -connect placement-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.287063 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287068 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.287074 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287080 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.287086 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287091 | controller | + finger_print=5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5' 2025-10-13 20:41:20.287097 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287103 | controller | + [[ -n 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5 ]]' 2025-10-13 20:41:20.287108 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287114 | controller | + echo ''placement-public-openstack-kuttl-tests.apps-crc.testing:443 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5''' 2025-10-13 20:41:20.287120 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287125 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.287131 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287137 | controller | ++ echo neutron-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.287142 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287148 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.287154 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287159 | controller | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.287165 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287171 | controller | + [[ ! neutron-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.287176 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287182 | controller | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.287188 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287193 | controller | ++ openssl s_client -connect neutron-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.287202 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287207 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.287213 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287219 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.287224 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287230 | controller | + finger_print=67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77' 2025-10-13 20:41:20.287236 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287241 | controller | + [[ -n 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77 ]]' 2025-10-13 20:41:20.287247 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287255 | controller | + echo ''neutron-public-openstack-kuttl-tests.apps-crc.testing:443 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77''' 2025-10-13 20:41:20.287261 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287267 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.287272 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287278 | controller | ++ echo cinder-internal.openstack-kuttl-tests.svc:8776' 2025-10-13 20:41:20.287283 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287289 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.287295 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287300 | controller | + host_port=cinder-internal.openstack-kuttl-tests.svc:8776' 2025-10-13 20:41:20.287314 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287322 | controller | + [[ ! cinder-internal.openstack-kuttl-tests.svc:8776 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.287330 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287337 | controller | ++ openssl s_client -connect cinder-internal.openstack-kuttl-tests.svc:8776' 2025-10-13 20:41:20.287345 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287350 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.287356 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287362 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.287367 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287373 | controller | + finger_print=01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93' 2025-10-13 20:41:20.287379 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287384 | controller | + [[ -n 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93 ]]' 2025-10-13 20:41:20.287390 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287399 | controller | + echo ''cinder-internal.openstack-kuttl-tests.svc:8776 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93''' 2025-10-13 20:41:20.287419 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287425 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.287431 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287437 | controller | ++ echo barbican-internal.openstack-kuttl-tests.svc:9311' 2025-10-13 20:41:20.287442 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287448 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.287454 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287460 | controller | + host_port=barbican-internal.openstack-kuttl-tests.svc:9311' 2025-10-13 20:41:20.287465 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287471 | controller | + [[ ! barbican-internal.openstack-kuttl-tests.svc:9311 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.287477 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287482 | controller | ++ openssl s_client -connect barbican-internal.openstack-kuttl-tests.svc:9311' 2025-10-13 20:41:20.287488 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287497 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.287506 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287512 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.287518 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287525 | controller | + finger_print=2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72' 2025-10-13 20:41:20.287531 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287537 | controller | + [[ -n 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72 ]]' 2025-10-13 20:41:20.287543 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287548 | controller | + echo ''barbican-internal.openstack-kuttl-tests.svc:9311 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72''' 2025-10-13 20:41:20.287554 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287560 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.287565 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287571 | controller | ++ echo swift-internal.openstack-kuttl-tests.svc:8080' 2025-10-13 20:41:20.287577 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287582 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.287588 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287594 | controller | + host_port=swift-internal.openstack-kuttl-tests.svc:8080' 2025-10-13 20:41:20.287600 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287605 | controller | + [[ ! swift-internal.openstack-kuttl-tests.svc:8080 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.287611 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287617 | controller | ++ openssl s_client -connect swift-internal.openstack-kuttl-tests.svc:8080' 2025-10-13 20:41:20.287622 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287628 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.287634 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287639 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.287653 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287661 | controller | + finger_print=F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9' 2025-10-13 20:41:20.287669 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287676 | controller | + [[ -n F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9 ]]' 2025-10-13 20:41:20.287684 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287690 | controller | + echo ''swift-internal.openstack-kuttl-tests.svc:8080 F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9''' 2025-10-13 20:41:20.287696 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287702 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.287707 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287713 | controller | ++ echo keystone-internal.openstack-kuttl-tests.svc:5000' 2025-10-13 20:41:20.287719 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287724 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.287730 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287739 | controller | + host_port=keystone-internal.openstack-kuttl-tests.svc:5000' 2025-10-13 20:41:20.287745 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287751 | controller | + [[ ! keystone-internal.openstack-kuttl-tests.svc:5000 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.287757 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287762 | controller | ++ openssl s_client -connect keystone-internal.openstack-kuttl-tests.svc:5000' 2025-10-13 20:41:20.287768 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287774 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.287779 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287785 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.287791 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287796 | controller | + finger_print=08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23' 2025-10-13 20:41:20.287802 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287808 | controller | + [[ -n 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23 ]]' 2025-10-13 20:41:20.287813 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287819 | controller | + echo ''keystone-internal.openstack-kuttl-tests.svc:5000 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23''' 2025-10-13 20:41:20.287828 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287833 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.287839 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287845 | controller | ++ echo barbican-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.287850 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287856 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.287862 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287867 | controller | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.287873 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287879 | controller | + [[ ! barbican-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.287884 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287890 | controller | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.287896 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287901 | controller | ++ openssl s_client -connect barbican-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.287907 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287912 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.287918 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287924 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.287929 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287935 | controller | + finger_print=5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A' 2025-10-13 20:41:20.287941 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287947 | controller | + [[ -n 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A ]]' 2025-10-13 20:41:20.287964 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287972 | controller | + echo ''barbican-public-openstack-kuttl-tests.apps-crc.testing:443 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A''' 2025-10-13 20:41:20.287980 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.287988 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.287995 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288000 | controller | ++ echo nova-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.288006 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288012 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.288017 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288023 | controller | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.288029 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288034 | controller | + [[ ! nova-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.288040 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288046 | controller | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.288051 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288057 | controller | ++ openssl s_client -connect nova-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.288063 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288068 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.288074 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288079 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.288085 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288091 | controller | + finger_print=00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99' 2025-10-13 20:41:20.288096 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288102 | controller | + [[ -n 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99 ]]' 2025-10-13 20:41:20.288111 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288117 | controller | + echo ''nova-public-openstack-kuttl-tests.apps-crc.testing:443 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99''' 2025-10-13 20:41:20.288123 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288128 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.288134 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288139 | controller | ++ echo placement-internal.openstack-kuttl-tests.svc:8778' 2025-10-13 20:41:20.288145 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288163 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.288169 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288180 | controller | + host_port=placement-internal.openstack-kuttl-tests.svc:8778' 2025-10-13 20:41:20.288186 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288192 | controller | + [[ ! placement-internal.openstack-kuttl-tests.svc:8778 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.288197 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288206 | controller | ++ openssl s_client -connect placement-internal.openstack-kuttl-tests.svc:8778' 2025-10-13 20:41:20.288211 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288217 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.288223 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288228 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.288234 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288240 | controller | + finger_print=CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36' 2025-10-13 20:41:20.288245 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288251 | controller | + [[ -n CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36 ]]' 2025-10-13 20:41:20.288259 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288265 | controller | + echo ''placement-internal.openstack-kuttl-tests.svc:8778 CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36''' 2025-10-13 20:41:20.288270 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288284 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.288291 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288299 | controller | ++ echo keystone-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.288307 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288314 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.288320 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288326 | controller | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing' 2025-10-13 20:41:20.288332 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288337 | controller | + [[ ! keystone-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.288343 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288349 | controller | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.288354 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288360 | controller | ++ openssl s_client -connect keystone-public-openstack-kuttl-tests.apps-crc.testing:443' 2025-10-13 20:41:20.288366 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288371 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.288377 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288383 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.288388 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288397 | controller | + finger_print=51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3' 2025-10-13 20:41:20.288414 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288423 | controller | + [[ -n 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3 ]]' 2025-10-13 20:41:20.288429 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288434 | controller | + echo ''keystone-public-openstack-kuttl-tests.apps-crc.testing:443 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3''' 2025-10-13 20:41:20.288444 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288452 | controller | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' 2025-10-13 20:41:20.288458 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288464 | controller | ++ echo neutron-internal.openstack-kuttl-tests.svc:9696' 2025-10-13 20:41:20.288470 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288475 | controller | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' 2025-10-13 20:41:20.288481 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288487 | controller | + host_port=neutron-internal.openstack-kuttl-tests.svc:9696' 2025-10-13 20:41:20.288492 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288498 | controller | + [[ ! neutron-internal.openstack-kuttl-tests.svc:9696 =~ :[0-9]+$ ]]' 2025-10-13 20:41:20.288504 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288509 | controller | ++ openssl s_client -connect neutron-internal.openstack-kuttl-tests.svc:9696' 2025-10-13 20:41:20.288515 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288521 | controller | ++ sed ''s/.* Fingerprint=//''' 2025-10-13 20:41:20.288526 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288532 | controller | ++ openssl x509 -fingerprint -noout -in /dev/stdin' 2025-10-13 20:41:20.288538 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288543 | controller | + finger_print=6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83' 2025-10-13 20:41:20.288549 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288555 | controller | + [[ -n 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83 ]]' 2025-10-13 20:41:20.288560 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288566 | controller | + echo ''neutron-internal.openstack-kuttl-tests.svc:9696 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83''' 2025-10-13 20:41:20.288572 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288577 | controller | running command: [sh -c echo "Waiting for OpenStack control plane to be ready..."' 2025-10-13 20:41:20.288583 | controller | - ' oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s 2025-10-13 20:41:20.288589 | controller | -l core.openstack.org/openstackcontrolplane' 2025-10-13 20:41:20.288594 | controller | - ' ]' 2025-10-13 20:41:20.288600 | controller | - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288613 | controller | Waiting for OpenStack control plane to be ready...' 2025-10-13 20:41:20.288621 | controller | - ' logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288629 | controller | openstackcontrolplane.core.openstack.org/openstack condition met' 2025-10-13 20:41:20.288637 | controller | - ' logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288644 | controller | running command: [sh -c echo "Fail if internal http endpoints are registered"' 2025-10-13 20:41:20.288650 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -c "openstack endpoint 2025-10-13 20:41:20.288656 | controller | list --interface internal -f value -c URL" | grep ''http:'' && exit 1' 2025-10-13 20:41:20.288662 | controller | - ' exit 0' 2025-10-13 20:41:20.288667 | controller | - ' ]' 2025-10-13 20:41:20.288673 | controller | - ' logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288679 | controller | Fail if internal http endpoints are registered' 2025-10-13 20:41:20.288684 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288693 | controller | running command: [sh -c echo "check ovn sb internalDbAddress use ssl"' 2025-10-13 20:41:20.288699 | controller | - ' oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} 2025-10-13 20:41:20.288707 | controller | | grep -q ssl' 2025-10-13 20:41:20.288713 | controller | - ' ]' 2025-10-13 20:41:20.288719 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288725 | controller | check ovn sb internalDbAddress use ssl' 2025-10-13 20:41:20.288730 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288736 | controller | running command: [sh -c echo "check ovn sb DB connection use ssl"' 2025-10-13 20:41:20.288742 | controller | - ' oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c "ovn-sbctl 2025-10-13 20:41:20.288747 | controller | --no-leader-only get-connection | grep -q pssl"' 2025-10-13 20:41:20.288753 | controller | - ' ]' 2025-10-13 20:41:20.288759 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288764 | controller | check ovn sb DB connection use ssl' 2025-10-13 20:41:20.288770 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288776 | controller | Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter' 2025-10-13 20:41:20.288782 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288787 | controller | running command: [sh -c echo "check nova transport_url use ssl"' 2025-10-13 20:41:20.288793 | controller | - ' oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c "grep 2025-10-13 20:41:20.288799 | controller | transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q ''ssl=1''"' 2025-10-13 20:41:20.288804 | controller | - ' ]' 2025-10-13 20:41:20.288810 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288816 | controller | check nova transport_url use ssl' 2025-10-13 20:41:20.288821 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288827 | controller | running command: [sh -c echo "check neutron ovn_sb_connection url ssl"' 2025-10-13 20:41:20.288833 | controller | - ' oc exec -i deployment/neutron -n $NAMESPACE -- bash -c "grep ovn_sb_connection 2025-10-13 20:41:20.288838 | controller | /etc/neutron/neutron.conf.d/01-neutron.conf| grep -q ssl"' 2025-10-13 20:41:20.288844 | controller | - ' ]' 2025-10-13 20:41:20.288850 | controller | - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288856 | controller | check neutron ovn_sb_connection url ssl' 2025-10-13 20:41:20.288861 | controller | - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288867 | controller | Defaulted container "neutron-api" out of: neutron-api, neutron-httpd' 2025-10-13 20:41:20.288873 | controller | - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | 2025-10-13 20:41:20.288878 | controller | test step completed 2-get-endpoints-certs' 2025-10-13 20:41:20.288884 | controller | - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration 2025-10-13 20:41:20.288890 | controller | | starting test step 3-change-cert-duration' 2025-10-13 20:41:20.288895 | controller | - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration 2025-10-13 20:41:20.288901 | controller | | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_duration 2025-10-13 20:41:20.288907 | controller | | oc apply -n $NAMESPACE -f -' 2025-10-13 20:41:20.288912 | controller | - ' ]' 2025-10-13 20:41:20.288918 | controller | - ' logger.go:42: 20:26:18 | ctlplane-tls-cert-rotation/3-change-cert-duration 2025-10-13 20:41:20.288924 | controller | | openstackcontrolplane.core.openstack.org/openstack configured' 2025-10-13 20:41:20.288929 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/3-change-cert-duration 2025-10-13 20:41:20.288935 | controller | | test step completed 3-change-cert-duration' 2025-10-13 20:41:20.288943 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | starting test step 2025-10-13 20:41:20.288949 | controller | 4-' 2025-10-13 20:41:20.288955 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.288961 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.288966 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.288972 | controller | - ' ]' 2025-10-13 20:41:20.288985 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.288993 | controller | of non API service certificates...' 2025-10-13 20:41:20.289000 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289008 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.289015 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.289021 | controller | on port 15691...' 2025-10-13 20:41:20.289027 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.289032 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.289038 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.289044 | controller | on port 5671...' 2025-10-13 20:41:20.289049 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.289055 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.289061 | controller | - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.289066 | controller | on port 15671...' 2025-10-13 20:41:20.289072 | controller | - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.289078 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.289083 | controller | - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289089 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.289095 | controller | - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.289103 | controller | on port 6642...' 2025-10-13 20:41:20.289109 | controller | - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.289115 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.289120 | controller | - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.289126 | controller | on port 6644...' 2025-10-13 20:41:20.289132 | controller | - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.289138 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.289143 | controller | - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.289149 | controller | on port 1981...' 2025-10-13 20:41:20.289155 | controller | - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.289160 | controller | on port 1981 match the secret.' 2025-10-13 20:41:20.289166 | controller | - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289172 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.289177 | controller | - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.289183 | controller | on port 6641...' 2025-10-13 20:41:20.289189 | controller | - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289195 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.289200 | controller | - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.289209 | controller | on port 6643...' 2025-10-13 20:41:20.289215 | controller | - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289220 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.289226 | controller | - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.289232 | controller | on port 1981...' 2025-10-13 20:41:20.289238 | controller | - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289243 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.289249 | controller | - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289255 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.289260 | controller | - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.289266 | controller | on port 3000...' 2025-10-13 20:41:20.289272 | controller | - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289277 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.289283 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289289 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.289294 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.289300 | controller | on port 5671...' 2025-10-13 20:41:20.289306 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289311 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.289317 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.289323 | controller | on port 15671...' 2025-10-13 20:41:20.289328 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289334 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.289347 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.289355 | controller | on port 15691...' 2025-10-13 20:41:20.289363 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289370 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.289377 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.289383 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.289389 | controller | - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.289398 | controller | on port 3306...' 2025-10-13 20:41:20.289418 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289424 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.289430 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.289436 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.289441 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.289447 | controller | on port 3306...' 2025-10-13 20:41:20.289453 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289458 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.289464 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.289470 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.289476 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.289485 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.289490 | controller | - ' ]' 2025-10-13 20:41:20.289496 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.289502 | controller | all service certs' 2025-10-13 20:41:20.289508 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.289517 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.289522 | controller | - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.289528 | controller | 1 additional commands' 2025-10-13 20:41:20.289534 | controller | - ' logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.289539 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.289545 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.289551 | controller | - ' ]' 2025-10-13 20:41:20.289557 | controller | - ' logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.289563 | controller | of non API service certificates...' 2025-10-13 20:41:20.289568 | controller | - ' logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289574 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.289580 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.289586 | controller | on port 15691...' 2025-10-13 20:41:20.289594 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289600 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.289605 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.289611 | controller | on port 5671...' 2025-10-13 20:41:20.289617 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289623 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.289628 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.289634 | controller | on port 15671...' 2025-10-13 20:41:20.289640 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289645 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.289651 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289657 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.289662 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.289670 | controller | on port 6642...' 2025-10-13 20:41:20.289676 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289682 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.289688 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.289693 | controller | on port 6644...' 2025-10-13 20:41:20.289699 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289705 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.289710 | controller | - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.289716 | controller | on port 1981...' 2025-10-13 20:41:20.289722 | controller | - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289727 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.289733 | controller | - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289750 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.289758 | controller | - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.289766 | controller | on port 6641...' 2025-10-13 20:41:20.289774 | controller | - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289781 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.289787 | controller | - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.289793 | controller | on port 6643...' 2025-10-13 20:41:20.289798 | controller | - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289804 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.289810 | controller | - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.289816 | controller | on port 1981...' 2025-10-13 20:41:20.289821 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289827 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.289833 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289838 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.289844 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.289850 | controller | on port 3000...' 2025-10-13 20:41:20.289856 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289861 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.289867 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.289873 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.289878 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.289884 | controller | on port 5671...' 2025-10-13 20:41:20.289890 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289895 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.289901 | controller | - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.289907 | controller | on port 15671...' 2025-10-13 20:41:20.289912 | controller | - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289918 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.289924 | controller | - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.289929 | controller | on port 15691...' 2025-10-13 20:41:20.289935 | controller | - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289941 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.289946 | controller | - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.289952 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.289958 | controller | - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.289963 | controller | on port 3306...' 2025-10-13 20:41:20.289969 | controller | - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.289975 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.289980 | controller | - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.289986 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.289992 | controller | - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.290003 | controller | on port 3306...' 2025-10-13 20:41:20.290009 | controller | - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290015 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.290020 | controller | - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.290026 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.290032 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.290037 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.290043 | controller | - ' ]' 2025-10-13 20:41:20.290049 | controller | - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.290054 | controller | all service certs' 2025-10-13 20:41:20.290060 | controller | - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.290066 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.290072 | controller | - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.290077 | controller | 1 additional commands' 2025-10-13 20:41:20.290083 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.290089 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.290094 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.290100 | controller | - ' ]' 2025-10-13 20:41:20.290106 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.290119 | controller | of non API service certificates...' 2025-10-13 20:41:20.290127 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290135 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.290143 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.290150 | controller | on port 15691...' 2025-10-13 20:41:20.290155 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290161 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.290167 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.290172 | controller | on port 5671...' 2025-10-13 20:41:20.290178 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290184 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.290190 | controller | - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.290195 | controller | on port 15671...' 2025-10-13 20:41:20.290201 | controller | - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290206 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.290212 | controller | - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290218 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.290223 | controller | - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.290232 | controller | on port 6642...' 2025-10-13 20:41:20.290238 | controller | - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290244 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.290249 | controller | - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.290255 | controller | on port 6644...' 2025-10-13 20:41:20.290261 | controller | - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290269 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.290275 | controller | - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.290283 | controller | on port 1981...' 2025-10-13 20:41:20.290289 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290294 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.290300 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290306 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.290311 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.290317 | controller | on port 6641...' 2025-10-13 20:41:20.290323 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290328 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.290334 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.290340 | controller | on port 6643...' 2025-10-13 20:41:20.290345 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290351 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.290357 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.290362 | controller | on port 1981...' 2025-10-13 20:41:20.290368 | controller | - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290374 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.290380 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290385 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.290394 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.290414 | controller | on port 3000...' 2025-10-13 20:41:20.290423 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290429 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.290434 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290440 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.290446 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.290452 | controller | on port 5671...' 2025-10-13 20:41:20.290457 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290463 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.290469 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.290474 | controller | on port 15671...' 2025-10-13 20:41:20.290480 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290486 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.290491 | controller | - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.290515 | controller | on port 15691...' 2025-10-13 20:41:20.290523 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290531 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.290538 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.290546 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.290552 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.290561 | controller | on port 3306...' 2025-10-13 20:41:20.290566 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290572 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.290578 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.290584 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.290589 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.290595 | controller | on port 3306...' 2025-10-13 20:41:20.290619 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290626 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.290633 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.290639 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.290645 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.290655 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.290661 | controller | - ' ]' 2025-10-13 20:41:20.290668 | controller | - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.290674 | controller | all service certs' 2025-10-13 20:41:20.290680 | controller | - ' logger.go:42: 20:26:36 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.290687 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.290693 | controller | - ' logger.go:42: 20:26:36 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.290699 | controller | 1 additional commands' 2025-10-13 20:41:20.290706 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.290712 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.290719 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.290725 | controller | - ' ]' 2025-10-13 20:41:20.290731 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.290738 | controller | of non API service certificates...' 2025-10-13 20:41:20.290744 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290750 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.290757 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.290763 | controller | on port 15691...' 2025-10-13 20:41:20.290769 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290776 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.290782 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.290789 | controller | on port 5671...' 2025-10-13 20:41:20.290795 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290801 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.290808 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.290814 | controller | on port 15671...' 2025-10-13 20:41:20.290820 | controller | - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290827 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.290833 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290839 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.290846 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.290857 | controller | on port 6642...' 2025-10-13 20:41:20.290863 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290869 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.290875 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.290880 | controller | on port 6644...' 2025-10-13 20:41:20.290886 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290892 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.290897 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.290903 | controller | on port 1981...' 2025-10-13 20:41:20.290909 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290914 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.290920 | controller | - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.290933 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.290941 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.290949 | controller | on port 6641...' 2025-10-13 20:41:20.290957 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290965 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.290971 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.290976 | controller | on port 6643...' 2025-10-13 20:41:20.290983 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.290988 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.290994 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.291000 | controller | on port 1981...' 2025-10-13 20:41:20.291005 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291011 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.291017 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291022 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.291028 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.291034 | controller | on port 3000...' 2025-10-13 20:41:20.291039 | controller | - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291045 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.291051 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291056 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.291062 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.291068 | controller | on port 5671...' 2025-10-13 20:41:20.291074 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291079 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.291085 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.291091 | controller | on port 15671...' 2025-10-13 20:41:20.291096 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291102 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.291108 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.291117 | controller | on port 15691...' 2025-10-13 20:41:20.291122 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291128 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.291134 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.291140 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.291145 | controller | - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.291151 | controller | on port 3306...' 2025-10-13 20:41:20.291157 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291162 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.291168 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.291174 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.291180 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.291185 | controller | on port 3306...' 2025-10-13 20:41:20.291191 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291197 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.291202 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.291208 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.291214 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.291219 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.291225 | controller | - ' ]' 2025-10-13 20:41:20.291231 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.291236 | controller | all service certs' 2025-10-13 20:41:20.291242 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.291248 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.291254 | controller | - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.291259 | controller | 1 additional commands' 2025-10-13 20:41:20.291265 | controller | - ' logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.291271 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.291276 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.291282 | controller | - ' ]' 2025-10-13 20:41:20.291288 | controller | - ' logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.291301 | controller | of non API service certificates...' 2025-10-13 20:41:20.291309 | controller | - ' logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291317 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.291324 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.291331 | controller | on port 15691...' 2025-10-13 20:41:20.291337 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291342 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.291348 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.291354 | controller | on port 5671...' 2025-10-13 20:41:20.291360 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291365 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.291371 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.291380 | controller | on port 15671...' 2025-10-13 20:41:20.291386 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291391 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.291412 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291422 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.291431 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.291439 | controller | on port 6642...' 2025-10-13 20:41:20.291445 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291450 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.291456 | controller | - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.291462 | controller | on port 6644...' 2025-10-13 20:41:20.291468 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291473 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.291479 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.291485 | controller | on port 1981...' 2025-10-13 20:41:20.291490 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291496 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.291502 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291507 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.291513 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.291521 | controller | on port 6641...' 2025-10-13 20:41:20.291527 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291532 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.291538 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.291544 | controller | on port 6643...' 2025-10-13 20:41:20.291549 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291555 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.291561 | controller | - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.291566 | controller | on port 1981...' 2025-10-13 20:41:20.291572 | controller | - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291578 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.291583 | controller | - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291589 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.291595 | controller | - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.291600 | controller | on port 3000...' 2025-10-13 20:41:20.291606 | controller | - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291612 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.291617 | controller | - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291623 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.291629 | controller | - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.291634 | controller | on port 5671...' 2025-10-13 20:41:20.291640 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291651 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.291657 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.291662 | controller | on port 15671...' 2025-10-13 20:41:20.291668 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291674 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.291679 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.291685 | controller | on port 15691...' 2025-10-13 20:41:20.291698 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291706 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.291714 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.291722 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.291728 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.291734 | controller | on port 3306...' 2025-10-13 20:41:20.291740 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291745 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.291751 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.291757 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.291762 | controller | - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.291768 | controller | on port 3306...' 2025-10-13 20:41:20.291774 | controller | - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291779 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.291785 | controller | - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.291791 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.291797 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.291805 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.291811 | controller | - ' ]' 2025-10-13 20:41:20.291817 | controller | - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.291822 | controller | all service certs' 2025-10-13 20:41:20.291828 | controller | - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.291834 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.291840 | controller | - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.291845 | controller | 1 additional commands' 2025-10-13 20:41:20.291851 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.291857 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.291862 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.291868 | controller | - ' ]' 2025-10-13 20:41:20.291874 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.291879 | controller | of non API service certificates...' 2025-10-13 20:41:20.291885 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291891 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.291896 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.291902 | controller | on port 15691...' 2025-10-13 20:41:20.291908 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291917 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.291923 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.291929 | controller | on port 5671...' 2025-10-13 20:41:20.291934 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291940 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.291946 | controller | - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.291951 | controller | on port 15671...' 2025-10-13 20:41:20.291957 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291963 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.291968 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.291974 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.291980 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.291986 | controller | on port 6642...' 2025-10-13 20:41:20.291991 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.291997 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.292003 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.292011 | controller | on port 6644...' 2025-10-13 20:41:20.292017 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292022 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.292028 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.292034 | controller | on port 1981...' 2025-10-13 20:41:20.292039 | controller | - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292045 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.292051 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.292057 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.292069 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.292077 | controller | on port 6641...' 2025-10-13 20:41:20.292085 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292093 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.292099 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.292104 | controller | on port 6643...' 2025-10-13 20:41:20.292110 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292116 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.292121 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.292127 | controller | on port 1981...' 2025-10-13 20:41:20.292133 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292139 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.292144 | controller | - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.292150 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.292156 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.292161 | controller | on port 3000...' 2025-10-13 20:41:20.292167 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292176 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.292182 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.292188 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.292195 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.292203 | controller | on port 5671...' 2025-10-13 20:41:20.292210 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292218 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.292225 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.292232 | controller | on port 15671...' 2025-10-13 20:41:20.292240 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292247 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.292254 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.292261 | controller | on port 15691...' 2025-10-13 20:41:20.292268 | controller | - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292275 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.292283 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.292290 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.292305 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.292311 | controller | on port 3306...' 2025-10-13 20:41:20.292319 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292326 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.292334 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.292341 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.292348 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.292356 | controller | on port 3306...' 2025-10-13 20:41:20.292363 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292371 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.292378 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.292386 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.292398 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.292427 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.292437 | controller | - ' ]' 2025-10-13 20:41:20.292450 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.292501 | controller | all service certs' 2025-10-13 20:41:20.292523 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.292531 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.292540 | controller | - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.292548 | controller | 1 additional commands' 2025-10-13 20:41:20.292562 | controller | - ' logger.go:42: 20:26:53 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.292582 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.292596 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.292606 | controller | - ' ]' 2025-10-13 20:41:20.292618 | controller | - ' logger.go:42: 20:26:53 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.292674 | controller | of non API service certificates...' 2025-10-13 20:41:20.292694 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.292703 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.292713 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.292725 | controller | on port 15691...' 2025-10-13 20:41:20.292737 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292745 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.292757 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.292766 | controller | on port 5671...' 2025-10-13 20:41:20.292775 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292786 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.292797 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.292805 | controller | on port 15671...' 2025-10-13 20:41:20.292813 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292820 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.292828 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.292834 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.292840 | controller | - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.292849 | controller | on port 6642...' 2025-10-13 20:41:20.292855 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292861 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.292867 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.292875 | controller | on port 6644...' 2025-10-13 20:41:20.292881 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292886 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.292892 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.292898 | controller | on port 1981...' 2025-10-13 20:41:20.292904 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292909 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.292915 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.292921 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.292927 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.292932 | controller | on port 6641...' 2025-10-13 20:41:20.292938 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292944 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.292950 | controller | - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.292955 | controller | on port 6643...' 2025-10-13 20:41:20.292961 | controller | - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292967 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.292973 | controller | - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.292978 | controller | on port 1981...' 2025-10-13 20:41:20.292984 | controller | - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.292993 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.292999 | controller | - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293004 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.293010 | controller | - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.293016 | controller | on port 3000...' 2025-10-13 20:41:20.293022 | controller | - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293027 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.293033 | controller | - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293039 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.293045 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.293050 | controller | on port 5671...' 2025-10-13 20:41:20.293056 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293062 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.293068 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.293073 | controller | on port 15671...' 2025-10-13 20:41:20.293079 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293085 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.293091 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.293096 | controller | on port 15691...' 2025-10-13 20:41:20.293110 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293119 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.293127 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.293135 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.293143 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.293150 | controller | on port 3306...' 2025-10-13 20:41:20.293156 | controller | - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293161 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.293167 | controller | - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.293173 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.293179 | controller | - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.293184 | controller | on port 3306...' 2025-10-13 20:41:20.293190 | controller | - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293196 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.293202 | controller | - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.293207 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.293213 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.293219 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.293225 | controller | - ' ]' 2025-10-13 20:41:20.293231 | controller | - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.293236 | controller | all service certs' 2025-10-13 20:41:20.293242 | controller | - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.293248 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.293254 | controller | - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.293262 | controller | 1 additional commands' 2025-10-13 20:41:20.293268 | controller | - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.293274 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.293280 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.293285 | controller | - ' ]' 2025-10-13 20:41:20.293291 | controller | - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.293297 | controller | of non API service certificates...' 2025-10-13 20:41:20.293303 | controller | - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293309 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.293314 | controller | - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.293320 | controller | on port 15691...' 2025-10-13 20:41:20.293326 | controller | - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293331 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.293337 | controller | - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.293343 | controller | on port 5671...' 2025-10-13 20:41:20.293349 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293354 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.293360 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.293366 | controller | on port 15671...' 2025-10-13 20:41:20.293372 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293377 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.293383 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293389 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.293415 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.293428 | controller | on port 6642...' 2025-10-13 20:41:20.293434 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293440 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.293446 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.293452 | controller | on port 6644...' 2025-10-13 20:41:20.293458 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293463 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.293469 | controller | - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.293479 | controller | on port 1981...' 2025-10-13 20:41:20.293484 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293490 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.293496 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293502 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.293516 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.293524 | controller | on port 6641...' 2025-10-13 20:41:20.293532 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293540 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.293548 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.293559 | controller | on port 6643...' 2025-10-13 20:41:20.293565 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293571 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.293576 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.293582 | controller | on port 1981...' 2025-10-13 20:41:20.293588 | controller | - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293594 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.293599 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293605 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.293611 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.293617 | controller | on port 3000...' 2025-10-13 20:41:20.293622 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293628 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.293634 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293640 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.293645 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.293651 | controller | on port 5671...' 2025-10-13 20:41:20.293657 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293663 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.293668 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.293674 | controller | on port 15671...' 2025-10-13 20:41:20.293680 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293686 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.293691 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.293697 | controller | on port 15691...' 2025-10-13 20:41:20.293703 | controller | - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293709 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.293714 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.293720 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.293726 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.293732 | controller | on port 3306...' 2025-10-13 20:41:20.293737 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293743 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.293749 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.293755 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.293761 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.293766 | controller | on port 3306...' 2025-10-13 20:41:20.293772 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293778 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.293787 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.293792 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.293798 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.293812 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.293818 | controller | - ' ]' 2025-10-13 20:41:20.293824 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.293829 | controller | all service certs' 2025-10-13 20:41:20.293835 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.293841 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.293847 | controller | - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.293852 | controller | 1 additional commands' 2025-10-13 20:41:20.293858 | controller | - ' logger.go:42: 20:27:04 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.293864 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.293870 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.293875 | controller | - ' ]' 2025-10-13 20:41:20.293881 | controller | - ' logger.go:42: 20:27:04 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.293887 | controller | of non API service certificates...' 2025-10-13 20:41:20.293901 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293909 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.293917 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.293925 | controller | on port 15691...' 2025-10-13 20:41:20.293933 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293939 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.293944 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.293950 | controller | on port 5671...' 2025-10-13 20:41:20.293956 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293962 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.293968 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.293973 | controller | on port 15671...' 2025-10-13 20:41:20.293979 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.293985 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.293991 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.293996 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.294002 | controller | - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.294008 | controller | on port 6642...' 2025-10-13 20:41:20.294014 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294019 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.294025 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.294031 | controller | on port 6644...' 2025-10-13 20:41:20.294037 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294043 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.294048 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.294057 | controller | on port 1981...' 2025-10-13 20:41:20.294063 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294069 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.294075 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294080 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.294089 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.294095 | controller | on port 6641...' 2025-10-13 20:41:20.294101 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294106 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.294112 | controller | - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.294118 | controller | on port 6643...' 2025-10-13 20:41:20.294124 | controller | - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294129 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.294135 | controller | - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.294141 | controller | on port 1981...' 2025-10-13 20:41:20.294147 | controller | - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294152 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.294158 | controller | - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294164 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.294170 | controller | - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.294178 | controller | on port 3000...' 2025-10-13 20:41:20.294184 | controller | - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294189 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.294195 | controller | - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294201 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.294207 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.294213 | controller | on port 5671...' 2025-10-13 20:41:20.294218 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294224 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.294230 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.294236 | controller | on port 15671...' 2025-10-13 20:41:20.294241 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294247 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.294253 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.294259 | controller | on port 15691...' 2025-10-13 20:41:20.294272 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294280 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.294288 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.294296 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.294304 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.294310 | controller | on port 3306...' 2025-10-13 20:41:20.294316 | controller | - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294322 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.294328 | controller | - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.294333 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.294339 | controller | - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.294348 | controller | on port 3306...' 2025-10-13 20:41:20.294354 | controller | - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294360 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.294365 | controller | - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.294371 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.294377 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.294383 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.294389 | controller | - ' ]' 2025-10-13 20:41:20.294397 | controller | - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.294416 | controller | all service certs' 2025-10-13 20:41:20.294425 | controller | - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.294430 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.294436 | controller | - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.294442 | controller | 1 additional commands' 2025-10-13 20:41:20.294448 | controller | - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.294453 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.294459 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.294465 | controller | - ' ]' 2025-10-13 20:41:20.294471 | controller | - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.294477 | controller | of non API service certificates...' 2025-10-13 20:41:20.294482 | controller | - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294488 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.294494 | controller | - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.294500 | controller | on port 15691...' 2025-10-13 20:41:20.294506 | controller | - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294511 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.294517 | controller | - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.294523 | controller | on port 5671...' 2025-10-13 20:41:20.294529 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294535 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.294541 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.294547 | controller | on port 15671...' 2025-10-13 20:41:20.294556 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294562 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.294568 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294574 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.294579 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.294588 | controller | on port 6642...' 2025-10-13 20:41:20.294593 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294599 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.294605 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.294611 | controller | on port 6644...' 2025-10-13 20:41:20.294617 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294622 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.294631 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.294657 | controller | on port 1981...' 2025-10-13 20:41:20.294664 | controller | - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294671 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.294679 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294686 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.294705 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.294713 | controller | on port 6641...' 2025-10-13 20:41:20.294721 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294728 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.294735 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.294742 | controller | on port 6643...' 2025-10-13 20:41:20.294749 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294756 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.294762 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.294769 | controller | on port 1981...' 2025-10-13 20:41:20.294776 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294784 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.294791 | controller | - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294799 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.294806 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.294818 | controller | on port 3000...' 2025-10-13 20:41:20.294823 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294829 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.294835 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.294841 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.294846 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.294852 | controller | on port 5671...' 2025-10-13 20:41:20.294858 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294863 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.294869 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.294875 | controller | on port 15671...' 2025-10-13 20:41:20.294880 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294886 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.294892 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.294897 | controller | on port 15691...' 2025-10-13 20:41:20.294903 | controller | - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294909 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.294914 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.294920 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.294926 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.294935 | controller | on port 3306...' 2025-10-13 20:41:20.294941 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294947 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.294952 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.294958 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.294964 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.294969 | controller | on port 3306...' 2025-10-13 20:41:20.294975 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.294981 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.294986 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.294992 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.294998 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.295003 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.295009 | controller | - ' ]' 2025-10-13 20:41:20.295015 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.295020 | controller | all service certs' 2025-10-13 20:41:20.295026 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.295032 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.295037 | controller | - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.295043 | controller | 1 additional commands' 2025-10-13 20:41:20.295049 | controller | - ' logger.go:42: 20:27:15 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.295054 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.295060 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.295068 | controller | - ' ]' 2025-10-13 20:41:20.295074 | controller | - ' logger.go:42: 20:27:15 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.295080 | controller | of non API service certificates...' 2025-10-13 20:41:20.295094 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295102 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.295110 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.295117 | controller | on port 15691...' 2025-10-13 20:41:20.295123 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295129 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.295135 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.295140 | controller | on port 5671...' 2025-10-13 20:41:20.295146 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295152 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.295158 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.295163 | controller | on port 15671...' 2025-10-13 20:41:20.295169 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295175 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.295180 | controller | - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295186 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.295192 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.295201 | controller | on port 6642...' 2025-10-13 20:41:20.295206 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295212 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.295218 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.295223 | controller | on port 6644...' 2025-10-13 20:41:20.295229 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295235 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.295241 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.295246 | controller | on port 1981...' 2025-10-13 20:41:20.295252 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295258 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.295263 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295269 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.295275 | controller | - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.295283 | controller | on port 6641...' 2025-10-13 20:41:20.295289 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295294 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.295300 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.295306 | controller | on port 6643...' 2025-10-13 20:41:20.295312 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295317 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.295323 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.295329 | controller | on port 1981...' 2025-10-13 20:41:20.295334 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295340 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.295345 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295351 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.295357 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.295363 | controller | on port 3000...' 2025-10-13 20:41:20.295368 | controller | - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295374 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.295380 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295385 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.295391 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.295416 | controller | on port 5671...' 2025-10-13 20:41:20.295429 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295437 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.295442 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.295448 | controller | on port 15671...' 2025-10-13 20:41:20.295454 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295459 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.295465 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.295474 | controller | on port 15691...' 2025-10-13 20:41:20.295488 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295496 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.295504 | controller | - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.295511 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.295519 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.295524 | controller | on port 3306...' 2025-10-13 20:41:20.295530 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295536 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.295541 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.295547 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.295553 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.295559 | controller | on port 3306...' 2025-10-13 20:41:20.295564 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295570 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.295576 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.295581 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.295587 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.295599 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.295605 | controller | - ' ]' 2025-10-13 20:41:20.295610 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.295616 | controller | all service certs' 2025-10-13 20:41:20.295622 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.295627 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.295633 | controller | - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.295639 | controller | 1 additional commands' 2025-10-13 20:41:20.295644 | controller | - ' logger.go:42: 20:27:21 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.295650 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.295656 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.295662 | controller | - ' ]' 2025-10-13 20:41:20.295667 | controller | - ' logger.go:42: 20:27:21 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.295673 | controller | of non API service certificates...' 2025-10-13 20:41:20.295679 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295684 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.295690 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.295696 | controller | on port 15691...' 2025-10-13 20:41:20.295701 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295707 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.295713 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.295719 | controller | on port 5671...' 2025-10-13 20:41:20.295724 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295730 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.295736 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.295741 | controller | on port 15671...' 2025-10-13 20:41:20.295750 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295756 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.295761 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295767 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.295773 | controller | - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.295781 | controller | on port 6642...' 2025-10-13 20:41:20.295786 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295792 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.295798 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.295803 | controller | on port 6644...' 2025-10-13 20:41:20.295809 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295815 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.295820 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.295826 | controller | on port 1981...' 2025-10-13 20:41:20.295832 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295837 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.295843 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295849 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.295862 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.295870 | controller | on port 6641...' 2025-10-13 20:41:20.295878 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295884 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.295890 | controller | - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.295899 | controller | on port 6643...' 2025-10-13 20:41:20.295905 | controller | - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295911 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.295916 | controller | - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.295922 | controller | on port 1981...' 2025-10-13 20:41:20.295928 | controller | - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295933 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.295939 | controller | - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295945 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.295950 | controller | - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.295956 | controller | on port 3000...' 2025-10-13 20:41:20.295962 | controller | - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.295967 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.295973 | controller | - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.295979 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.295984 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.295990 | controller | on port 5671...' 2025-10-13 20:41:20.295996 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296004 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.296010 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.296016 | controller | on port 15671...' 2025-10-13 20:41:20.296021 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296027 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.296033 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.296038 | controller | on port 15691...' 2025-10-13 20:41:20.296044 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296050 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.296055 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.296061 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.296067 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.296072 | controller | on port 3306...' 2025-10-13 20:41:20.296078 | controller | - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296084 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.296089 | controller | - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.296095 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.296101 | controller | - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.296106 | controller | on port 3306...' 2025-10-13 20:41:20.296112 | controller | - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296118 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.296123 | controller | - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.296129 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.296135 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.296140 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.296146 | controller | - ' ]' 2025-10-13 20:41:20.296152 | controller | - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.296157 | controller | all service certs' 2025-10-13 20:41:20.296163 | controller | - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Error from server 2025-10-13 20:41:20.296169 | controller | (NotFound): pods "openstackclient" not found' 2025-10-13 20:41:20.296175 | controller | - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.296180 | controller | 1 additional commands' 2025-10-13 20:41:20.296186 | controller | - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.296192 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.296197 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.296203 | controller | - ' ]' 2025-10-13 20:41:20.296209 | controller | - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.296214 | controller | of non API service certificates...' 2025-10-13 20:41:20.296227 | controller | - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296235 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.296243 | controller | - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.296250 | controller | on port 15691...' 2025-10-13 20:41:20.296255 | controller | - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296264 | controller | from rabbitmq at 10.217.5.241:15691.' 2025-10-13 20:41:20.296270 | controller | - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.296276 | controller | on port 5671...' 2025-10-13 20:41:20.296281 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296287 | controller | from rabbitmq at 10.217.5.241:5671.' 2025-10-13 20:41:20.296292 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.296298 | controller | on port 15671...' 2025-10-13 20:41:20.296304 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296309 | controller | from rabbitmq at 10.217.5.241:15671.' 2025-10-13 20:41:20.296315 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296321 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.296326 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.296332 | controller | on port 6642...' 2025-10-13 20:41:20.296338 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296343 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6642.' 2025-10-13 20:41:20.296349 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.296355 | controller | on port 6644...' 2025-10-13 20:41:20.296360 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296366 | controller | from ovsdbserver-sb-0 at 10.217.5.30:6644.' 2025-10-13 20:41:20.296372 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.296377 | controller | on port 1981...' 2025-10-13 20:41:20.296383 | controller | - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296389 | controller | from ovsdbserver-sb-0 at 10.217.5.30:1981.' 2025-10-13 20:41:20.296398 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296424 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.296432 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.296439 | controller | on port 6641...' 2025-10-13 20:41:20.296445 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296450 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6641.' 2025-10-13 20:41:20.296456 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.296465 | controller | on port 6643...' 2025-10-13 20:41:20.296471 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296477 | controller | from ovsdbserver-nb-0 at 10.217.5.243:6643.' 2025-10-13 20:41:20.296482 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.296488 | controller | on port 1981...' 2025-10-13 20:41:20.296494 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296500 | controller | from ovsdbserver-nb-0 at 10.217.5.243:1981.' 2025-10-13 20:41:20.296505 | controller | - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296511 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.296517 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.296525 | controller | on port 3000...' 2025-10-13 20:41:20.296530 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296539 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.296545 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296550 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.296556 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.296562 | controller | on port 5671...' 2025-10-13 20:41:20.296567 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296573 | controller | from rabbitmq-cell1 at 10.217.5.46:5671.' 2025-10-13 20:41:20.296579 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.296584 | controller | on port 15671...' 2025-10-13 20:41:20.296590 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296596 | controller | from rabbitmq-cell1 at 10.217.5.46:15671.' 2025-10-13 20:41:20.296601 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.296607 | controller | on port 15691...' 2025-10-13 20:41:20.296621 | controller | - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296629 | controller | from rabbitmq-cell1 at 10.217.5.46:15691.' 2025-10-13 20:41:20.296637 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.296644 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.296650 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.296656 | controller | on port 3306...' 2025-10-13 20:41:20.296661 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296667 | controller | from openstack-cell1 at 10.217.4.238:3306.' 2025-10-13 20:41:20.296673 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.296678 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.296684 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.296690 | controller | on port 3306...' 2025-10-13 20:41:20.296695 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.296701 | controller | from openstack at 10.217.5.75:3306.' 2025-10-13 20:41:20.296707 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.296712 | controller | -c echo "Get fingerprints of all service certs"' 2025-10-13 20:41:20.296718 | controller | - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh 2025-10-13 20:41:20.296724 | controller | > /tmp/endpoint_fingerprints_after' 2025-10-13 20:41:20.296730 | controller | - ' ]' 2025-10-13 20:41:20.296735 | controller | - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Get fingerprints of 2025-10-13 20:41:20.296741 | controller | all service certs' 2025-10-13 20:41:20.296747 | controller | - ' logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- | error: unable to upgrade 2025-10-13 20:41:20.296752 | controller | connection: container not found ("openstackclient")' 2025-10-13 20:41:20.296758 | controller | - ' logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.296764 | controller | 1 additional commands' 2025-10-13 20:41:20.296769 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.296775 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.296781 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.296788 | controller | - ' ]' 2025-10-13 20:41:20.296795 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.296807 | controller | of non API service certificates...' 2025-10-13 20:41:20.296815 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296822 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.296830 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.296838 | controller | on port 15691...' 2025-10-13 20:41:20.296845 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.296852 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.296859 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.296865 | controller | on port 5671...' 2025-10-13 20:41:20.296871 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.296876 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.296882 | controller | - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.296888 | controller | on port 15671...' 2025-10-13 20:41:20.296894 | controller | - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.296899 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.296905 | controller | - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296910 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.296916 | controller | - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.296925 | controller | on port 6642...' 2025-10-13 20:41:20.296931 | controller | - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.296937 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.296942 | controller | - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.296948 | controller | on port 6644...' 2025-10-13 20:41:20.296954 | controller | - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.296959 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.296965 | controller | - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.296971 | controller | on port 1981...' 2025-10-13 20:41:20.296976 | controller | - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.296982 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.296988 | controller | - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.296993 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.297007 | controller | - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.297015 | controller | on port 6641...' 2025-10-13 20:41:20.297023 | controller | - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.297030 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.297038 | controller | - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.297045 | controller | on port 6643...' 2025-10-13 20:41:20.297052 | controller | - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.297057 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.297063 | controller | - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.297069 | controller | on port 1981...' 2025-10-13 20:41:20.297075 | controller | - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.297080 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.297089 | controller | - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.297095 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.297101 | controller | - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.297109 | controller | on port 3000...' 2025-10-13 20:41:20.297115 | controller | - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate 2025-10-13 20:41:20.297121 | controller | from ceilometer-internal at 10.217.5.118:3000.' 2025-10-13 20:41:20.297126 | controller | - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.297132 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.297138 | controller | - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.297143 | controller | on port 5671...' 2025-10-13 20:41:20.297149 | controller | - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.297155 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.297161 | controller | - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.297166 | controller | on port 15671...' 2025-10-13 20:41:20.297172 | controller | - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.297178 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.297184 | controller | - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.297191 | controller | on port 15691...' 2025-10-13 20:41:20.297199 | controller | - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.297206 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.297213 | controller | - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.297220 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.297228 | controller | - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.297235 | controller | on port 3306...' 2025-10-13 20:41:20.297243 | controller | - ' logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.297250 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.297258 | controller | - ' logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.297265 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.297273 | controller | - ' logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.297280 | controller | on port 3306...' 2025-10-13 20:41:20.297288 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.297296 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.297303 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.297310 | controller | had certificate mismatches:' 2025-10-13 20:41:20.297318 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.297325 | controller | 15691' 2025-10-13 20:41:20.297341 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.297353 | controller | 5671' 2025-10-13 20:41:20.297359 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.297365 | controller | 15671' 2025-10-13 20:41:20.297370 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.297376 | controller | on port 1981' 2025-10-13 20:41:20.297382 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.297395 | controller | on port 1981' 2025-10-13 20:41:20.297421 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.297434 | controller | on port 5671' 2025-10-13 20:41:20.297442 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.297449 | controller | on port 15671' 2025-10-13 20:41:20.297456 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.297464 | controller | on port 15691' 2025-10-13 20:41:20.297471 | controller | - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.297478 | controller | 2 additional commands' 2025-10-13 20:41:20.297486 | controller | - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.297500 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.297509 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.297516 | controller | - ' ]' 2025-10-13 20:41:20.297524 | controller | - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.297531 | controller | of non API service certificates...' 2025-10-13 20:41:20.297538 | controller | - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.297546 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.297553 | controller | - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.297560 | controller | on port 15691...' 2025-10-13 20:41:20.297567 | controller | - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.297575 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.297582 | controller | - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.297589 | controller | on port 5671...' 2025-10-13 20:41:20.297597 | controller | - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.297602 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.297608 | controller | - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.297614 | controller | on port 15671...' 2025-10-13 20:41:20.297620 | controller | - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.297626 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.297631 | controller | - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.297637 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.297643 | controller | - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.297652 | controller | on port 6642...' 2025-10-13 20:41:20.297658 | controller | - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.297664 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.297670 | controller | - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.297675 | controller | on port 6644...' 2025-10-13 20:41:20.297681 | controller | - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.297687 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.297693 | controller | - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.297699 | controller | on port 1981...' 2025-10-13 20:41:20.297704 | controller | - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.297710 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.297716 | controller | - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.297722 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.297733 | controller | - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.297739 | controller | on port 6641...' 2025-10-13 20:41:20.297745 | controller | - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.297751 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.297756 | controller | - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.297762 | controller | on port 6643...' 2025-10-13 20:41:20.297768 | controller | - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.297774 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.297779 | controller | - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.297785 | controller | on port 1981...' 2025-10-13 20:41:20.297791 | controller | - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.297797 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.297802 | controller | - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.297808 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.297814 | controller | - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.297823 | controller | on port 3000...' 2025-10-13 20:41:20.297829 | controller | - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.297834 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.297840 | controller | - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.297846 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.297852 | controller | - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.297858 | controller | on port 5671...' 2025-10-13 20:41:20.297863 | controller | - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.297869 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.297875 | controller | - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.297881 | controller | on port 15671...' 2025-10-13 20:41:20.297895 | controller | - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.297903 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.297914 | controller | - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.297923 | controller | on port 15691...' 2025-10-13 20:41:20.297931 | controller | - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.297939 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.297947 | controller | - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.297954 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.297973 | controller | - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.297986 | controller | on port 3306...' 2025-10-13 20:41:20.297995 | controller | - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.298001 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.298008 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.298015 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.298023 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.298031 | controller | on port 3306...' 2025-10-13 20:41:20.298043 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.298051 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.298058 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.298072 | controller | had certificate mismatches:' 2025-10-13 20:41:20.298078 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.298084 | controller | 15691' 2025-10-13 20:41:20.298089 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.298095 | controller | 5671' 2025-10-13 20:41:20.298101 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.298107 | controller | 15671' 2025-10-13 20:41:20.298112 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.298118 | controller | on port 1981' 2025-10-13 20:41:20.298124 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.298130 | controller | on port 1981' 2025-10-13 20:41:20.298135 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.298141 | controller | on port 5671' 2025-10-13 20:41:20.298147 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.298153 | controller | on port 15671' 2025-10-13 20:41:20.298159 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.298164 | controller | on port 15691' 2025-10-13 20:41:20.298170 | controller | - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.298176 | controller | 2 additional commands' 2025-10-13 20:41:20.298182 | controller | - ' logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.298187 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.298193 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.298199 | controller | - ' ]' 2025-10-13 20:41:20.298205 | controller | - ' logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.298210 | controller | of non API service certificates...' 2025-10-13 20:41:20.298216 | controller | - ' logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.298222 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.298227 | controller | - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.298233 | controller | on port 15691...' 2025-10-13 20:41:20.298242 | controller | - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.298248 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.298254 | controller | - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.298259 | controller | on port 5671...' 2025-10-13 20:41:20.298265 | controller | - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.298271 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.298277 | controller | - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.298282 | controller | on port 15671...' 2025-10-13 20:41:20.298288 | controller | - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.298294 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.298300 | controller | - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.298305 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.298311 | controller | - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.298322 | controller | on port 6642...' 2025-10-13 20:41:20.298327 | controller | - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.298333 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.298339 | controller | - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.298354 | controller | on port 6644...' 2025-10-13 20:41:20.298363 | controller | - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.298371 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.298379 | controller | - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.298385 | controller | on port 1981...' 2025-10-13 20:41:20.298391 | controller | - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.298415 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.298428 | controller | - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.298435 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.298441 | controller | - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.298447 | controller | on port 6641...' 2025-10-13 20:41:20.298453 | controller | - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.298461 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.298468 | controller | - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.298476 | controller | on port 6643...' 2025-10-13 20:41:20.298496 | controller | - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.298506 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.298514 | controller | - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.298540 | controller | on port 1981...' 2025-10-13 20:41:20.298549 | controller | - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.298561 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.298570 | controller | - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.298578 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.298585 | controller | - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.298594 | controller | on port 3000...' 2025-10-13 20:41:20.298623 | controller | - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.298633 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.298643 | controller | - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.298651 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.298659 | controller | - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.298688 | controller | on port 5671...' 2025-10-13 20:41:20.298698 | controller | - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.298706 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.298718 | controller | - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.298727 | controller | on port 15671...' 2025-10-13 20:41:20.298735 | controller | - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.298746 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.298755 | controller | - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.298771 | controller | on port 15691...' 2025-10-13 20:41:20.298780 | controller | - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.298792 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.298800 | controller | - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.298812 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.298820 | controller | - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.298832 | controller | on port 3306...' 2025-10-13 20:41:20.298840 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.298851 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.298859 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.298870 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.298878 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.298886 | controller | on port 3306...' 2025-10-13 20:41:20.298894 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.298901 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.298909 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.298916 | controller | had certificate mismatches:' 2025-10-13 20:41:20.298923 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.298929 | controller | 15691' 2025-10-13 20:41:20.298935 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.298940 | controller | 5671' 2025-10-13 20:41:20.298946 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.298952 | controller | 15671' 2025-10-13 20:41:20.298957 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.298963 | controller | on port 1981' 2025-10-13 20:41:20.298977 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.298986 | controller | on port 1981' 2025-10-13 20:41:20.298993 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.299001 | controller | on port 5671' 2025-10-13 20:41:20.299008 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.299015 | controller | on port 15671' 2025-10-13 20:41:20.299023 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.299030 | controller | on port 15691' 2025-10-13 20:41:20.299037 | controller | - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.299044 | controller | 2 additional commands' 2025-10-13 20:41:20.299049 | controller | - ' logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.299055 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.299061 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.299066 | controller | - ' ]' 2025-10-13 20:41:20.299072 | controller | - ' logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.299078 | controller | of non API service certificates...' 2025-10-13 20:41:20.299083 | controller | - ' logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299089 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.299095 | controller | - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.299100 | controller | on port 15691...' 2025-10-13 20:41:20.299106 | controller | - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.299115 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.299121 | controller | - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.299127 | controller | on port 5671...' 2025-10-13 20:41:20.299132 | controller | - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.299138 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.299144 | controller | - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.299150 | controller | on port 15671...' 2025-10-13 20:41:20.299155 | controller | - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.299161 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.299167 | controller | - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299172 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.299178 | controller | - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.299187 | controller | on port 6642...' 2025-10-13 20:41:20.299193 | controller | - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.299199 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.299204 | controller | - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.299212 | controller | on port 6644...' 2025-10-13 20:41:20.299218 | controller | - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.299224 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.299229 | controller | - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.299235 | controller | on port 1981...' 2025-10-13 20:41:20.299241 | controller | - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.299247 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.299252 | controller | - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299258 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.299264 | controller | - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.299269 | controller | on port 6641...' 2025-10-13 20:41:20.299275 | controller | - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.299281 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.299288 | controller | - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.299295 | controller | on port 6643...' 2025-10-13 20:41:20.299303 | controller | - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.299311 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.299318 | controller | - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.299326 | controller | on port 1981...' 2025-10-13 20:41:20.299333 | controller | - ' logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.299341 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.299348 | controller | - ' logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299356 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.299363 | controller | - ' logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.299385 | controller | on port 3000...' 2025-10-13 20:41:20.299430 | controller | - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.299449 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.299457 | controller | - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299463 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.299469 | controller | - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.299475 | controller | on port 5671...' 2025-10-13 20:41:20.299480 | controller | - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.299486 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.299492 | controller | - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.299498 | controller | on port 15671...' 2025-10-13 20:41:20.299503 | controller | - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.299509 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.299515 | controller | - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.299520 | controller | on port 15691...' 2025-10-13 20:41:20.299526 | controller | - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.299532 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.299538 | controller | - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.299543 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.299549 | controller | - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.299555 | controller | on port 3306...' 2025-10-13 20:41:20.299560 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.299566 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.299572 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.299577 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.299583 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.299589 | controller | on port 3306...' 2025-10-13 20:41:20.299594 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.299600 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.299606 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.299611 | controller | had certificate mismatches:' 2025-10-13 20:41:20.299617 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.299623 | controller | 15691' 2025-10-13 20:41:20.299629 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.299634 | controller | 5671' 2025-10-13 20:41:20.299640 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.299646 | controller | 15671' 2025-10-13 20:41:20.299651 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.299657 | controller | on port 1981' 2025-10-13 20:41:20.299663 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.299668 | controller | on port 1981' 2025-10-13 20:41:20.299674 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.299680 | controller | on port 5671' 2025-10-13 20:41:20.299686 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.299691 | controller | on port 15671' 2025-10-13 20:41:20.299697 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.299703 | controller | on port 15691' 2025-10-13 20:41:20.299708 | controller | - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.299720 | controller | 2 additional commands' 2025-10-13 20:41:20.299725 | controller | - ' logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.299731 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.299737 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.299742 | controller | - ' ]' 2025-10-13 20:41:20.299748 | controller | - ' logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.299754 | controller | of non API service certificates...' 2025-10-13 20:41:20.299759 | controller | - ' logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299765 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.299771 | controller | - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.299776 | controller | on port 15691...' 2025-10-13 20:41:20.299782 | controller | - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.299788 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.299793 | controller | - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.299799 | controller | on port 5671...' 2025-10-13 20:41:20.299805 | controller | - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.299810 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.299816 | controller | - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.299822 | controller | on port 15671...' 2025-10-13 20:41:20.299836 | controller | - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.299844 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.299852 | controller | - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299860 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.299867 | controller | - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.299875 | controller | on port 6642...' 2025-10-13 20:41:20.299882 | controller | - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.299890 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.299897 | controller | - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.299911 | controller | on port 6644...' 2025-10-13 20:41:20.299917 | controller | - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.299928 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.299934 | controller | - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.299939 | controller | on port 1981...' 2025-10-13 20:41:20.299945 | controller | - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.299951 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.299956 | controller | - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.299962 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.299968 | controller | - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.299977 | controller | on port 6641...' 2025-10-13 20:41:20.299984 | controller | - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.299991 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.299999 | controller | - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.300014 | controller | on port 6643...' 2025-10-13 20:41:20.300021 | controller | - ' logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.300029 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.300037 | controller | - ' logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.300044 | controller | on port 1981...' 2025-10-13 20:41:20.300052 | controller | - ' logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.300067 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.300073 | controller | - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.300079 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.300084 | controller | - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.300090 | controller | on port 3000...' 2025-10-13 20:41:20.300096 | controller | - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.300102 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.300107 | controller | - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.300113 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.300119 | controller | - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.300125 | controller | on port 5671...' 2025-10-13 20:41:20.300130 | controller | - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.300136 | controller | on port 5671 DO NOT match the secret.' 2025-10-13 20:41:20.300142 | controller | - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.300148 | controller | on port 15671...' 2025-10-13 20:41:20.300154 | controller | - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.300159 | controller | on port 15671 DO NOT match the secret.' 2025-10-13 20:41:20.300165 | controller | - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.300171 | controller | on port 15691...' 2025-10-13 20:41:20.300176 | controller | - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.300185 | controller | on port 15691 DO NOT match the secret.' 2025-10-13 20:41:20.300191 | controller | - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.300197 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.300202 | controller | - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.300209 | controller | on port 3306...' 2025-10-13 20:41:20.300217 | controller | - ' logger.go:42: 20:28:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.300224 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.300232 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.300240 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.300247 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.300255 | controller | on port 3306...' 2025-10-13 20:41:20.300282 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.300292 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.300299 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.300307 | controller | had certificate mismatches:' 2025-10-13 20:41:20.300314 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.300321 | controller | 15691' 2025-10-13 20:41:20.300333 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.300339 | controller | 5671' 2025-10-13 20:41:20.300345 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 2025-10-13 20:41:20.300351 | controller | 15671' 2025-10-13 20:41:20.300356 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.300362 | controller | on port 1981' 2025-10-13 20:41:20.300368 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.300373 | controller | on port 1981' 2025-10-13 20:41:20.300379 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.300385 | controller | on port 5671' 2025-10-13 20:41:20.300391 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.300416 | controller | on port 15671' 2025-10-13 20:41:20.300428 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 2025-10-13 20:41:20.300437 | controller | on port 15691' 2025-10-13 20:41:20.300444 | controller | - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.300452 | controller | 2 additional commands' 2025-10-13 20:41:20.300460 | controller | - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.300484 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.300492 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.300500 | controller | - ' ]' 2025-10-13 20:41:20.300513 | controller | - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.300653 | controller | of non API service certificates...' 2025-10-13 20:41:20.300672 | controller | - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.300680 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.300688 | controller | - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.300698 | controller | on port 15691...' 2025-10-13 20:41:20.300713 | controller | - ' logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.300721 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.300732 | controller | - ' logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.300829 | controller | on port 5671...' 2025-10-13 20:41:20.300840 | controller | - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.300849 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.300856 | controller | - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.300864 | controller | on port 15671...' 2025-10-13 20:41:20.300871 | controller | - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.300878 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.300886 | controller | - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.300893 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.300900 | controller | - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.300908 | controller | on port 6642...' 2025-10-13 20:41:20.300915 | controller | - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.300922 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.300930 | controller | - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.300937 | controller | on port 6644...' 2025-10-13 20:41:20.300945 | controller | - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.300956 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.300964 | controller | - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.300969 | controller | on port 1981...' 2025-10-13 20:41:20.300975 | controller | - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.300985 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.300993 | controller | - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301000 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.301008 | controller | - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.301016 | controller | on port 6641...' 2025-10-13 20:41:20.301023 | controller | - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.301031 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.301039 | controller | - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.301055 | controller | on port 6643...' 2025-10-13 20:41:20.301062 | controller | - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.301079 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.301088 | controller | - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.301096 | controller | on port 1981...' 2025-10-13 20:41:20.301103 | controller | - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.301111 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.301118 | controller | - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301125 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.301133 | controller | - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.301140 | controller | on port 3000...' 2025-10-13 20:41:20.301147 | controller | - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.301155 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.301162 | controller | - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301169 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.301177 | controller | - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.301184 | controller | on port 5671...' 2025-10-13 20:41:20.301191 | controller | - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.301203 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.301210 | controller | - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.301218 | controller | on port 15671...' 2025-10-13 20:41:20.301225 | controller | - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.301232 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.301240 | controller | - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.301247 | controller | on port 15691...' 2025-10-13 20:41:20.301254 | controller | - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.301262 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.301269 | controller | - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.301276 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.301283 | controller | - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.301294 | controller | on port 3306...' 2025-10-13 20:41:20.301302 | controller | - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.301313 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.301321 | controller | - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.301329 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.301336 | controller | - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.301352 | controller | on port 3306...' 2025-10-13 20:41:20.301365 | controller | - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.301373 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.301381 | controller | - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.301388 | controller | had certificate mismatches:' 2025-10-13 20:41:20.301426 | controller | - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.301438 | controller | on port 1981' 2025-10-13 20:41:20.301445 | controller | - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.301452 | controller | on port 1981' 2025-10-13 20:41:20.301460 | controller | - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.301467 | controller | 2 additional commands' 2025-10-13 20:41:20.301474 | controller | - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.301482 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.301489 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.301496 | controller | - ' ]' 2025-10-13 20:41:20.301503 | controller | - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.301511 | controller | of non API service certificates...' 2025-10-13 20:41:20.301518 | controller | - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301525 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.301533 | controller | - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.301540 | controller | on port 15691...' 2025-10-13 20:41:20.301547 | controller | - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.301554 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.301562 | controller | - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.301569 | controller | on port 5671...' 2025-10-13 20:41:20.301576 | controller | - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.301584 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.301590 | controller | - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.301596 | controller | on port 15671...' 2025-10-13 20:41:20.301611 | controller | - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.301619 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.301627 | controller | - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301635 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.301642 | controller | - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.301650 | controller | on port 6642...' 2025-10-13 20:41:20.301657 | controller | - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.301664 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.301672 | controller | - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.301684 | controller | on port 6644...' 2025-10-13 20:41:20.301692 | controller | - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.301699 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.301707 | controller | - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.301722 | controller | on port 1981...' 2025-10-13 20:41:20.301730 | controller | - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.301737 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.301744 | controller | - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301752 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.301759 | controller | - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.301766 | controller | on port 6641...' 2025-10-13 20:41:20.301774 | controller | - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.301781 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.301788 | controller | - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.301796 | controller | on port 6643...' 2025-10-13 20:41:20.301803 | controller | - ' logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.301810 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.301817 | controller | - ' logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.301825 | controller | on port 1981...' 2025-10-13 20:41:20.301832 | controller | - ' logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.301839 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.301846 | controller | - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301854 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.301861 | controller | - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.301868 | controller | on port 3000...' 2025-10-13 20:41:20.301876 | controller | - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.301883 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.301890 | controller | - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.301898 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.301906 | controller | - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.301914 | controller | on port 5671...' 2025-10-13 20:41:20.301922 | controller | - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.301930 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.301944 | controller | - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.301964 | controller | on port 15671...' 2025-10-13 20:41:20.301972 | controller | - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.301984 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.302003 | controller | - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.302011 | controller | on port 15691...' 2025-10-13 20:41:20.302019 | controller | - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.302027 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.302034 | controller | - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.302042 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.302054 | controller | - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.302063 | controller | on port 3306...' 2025-10-13 20:41:20.302071 | controller | - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.302083 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.302104 | controller | - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.302113 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.302120 | controller | - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.302128 | controller | on port 3306...' 2025-10-13 20:41:20.302146 | controller | - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.302155 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.302166 | controller | - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.302176 | controller | had certificate mismatches:' 2025-10-13 20:41:20.302184 | controller | - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.302192 | controller | on port 1981' 2025-10-13 20:41:20.302200 | controller | - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.302212 | controller | on port 1981' 2025-10-13 20:41:20.302221 | controller | - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.302229 | controller | 2 additional commands' 2025-10-13 20:41:20.302237 | controller | - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.302248 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.302259 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.302267 | controller | - ' ]' 2025-10-13 20:41:20.302275 | controller | - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.302282 | controller | of non API service certificates...' 2025-10-13 20:41:20.302289 | controller | - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.302297 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.302304 | controller | - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.302311 | controller | on port 15691...' 2025-10-13 20:41:20.302318 | controller | - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.302326 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.302333 | controller | - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.302340 | controller | on port 5671...' 2025-10-13 20:41:20.302348 | controller | - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.302355 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.302362 | controller | - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.302369 | controller | on port 15671...' 2025-10-13 20:41:20.302377 | controller | - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.302384 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.302394 | controller | - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.302415 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.302426 | controller | - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.302438 | controller | on port 6642...' 2025-10-13 20:41:20.302445 | controller | - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.302460 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.302467 | controller | - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.302475 | controller | on port 6644...' 2025-10-13 20:41:20.302483 | controller | - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.302490 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.302498 | controller | - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.302506 | controller | on port 1981...' 2025-10-13 20:41:20.302521 | controller | - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.302535 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.302542 | controller | - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.302550 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.302557 | controller | - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.302564 | controller | on port 6641...' 2025-10-13 20:41:20.302571 | controller | - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.302579 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.302586 | controller | - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.302594 | controller | on port 6643...' 2025-10-13 20:41:20.302601 | controller | - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.302608 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.302615 | controller | - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.302623 | controller | on port 1981...' 2025-10-13 20:41:20.302630 | controller | - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.302637 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.302645 | controller | - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.302652 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.302664 | controller | - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.302671 | controller | on port 3000...' 2025-10-13 20:41:20.302688 | controller | - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.302696 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.302724 | controller | - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.302732 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.302739 | controller | - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.302747 | controller | on port 5671...' 2025-10-13 20:41:20.302755 | controller | - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.302762 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.302770 | controller | - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.302778 | controller | on port 15671...' 2025-10-13 20:41:20.302785 | controller | - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.302797 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.302813 | controller | - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.302820 | controller | on port 15691...' 2025-10-13 20:41:20.302828 | controller | - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.302835 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.302847 | controller | - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.302855 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.302862 | controller | - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.302870 | controller | on port 3306...' 2025-10-13 20:41:20.302877 | controller | - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.302884 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.302892 | controller | - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.302899 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.302906 | controller | - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.302914 | controller | on port 3306...' 2025-10-13 20:41:20.302924 | controller | - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.302931 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.302939 | controller | - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.302946 | controller | had certificate mismatches:' 2025-10-13 20:41:20.302953 | controller | - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.302960 | controller | on port 1981' 2025-10-13 20:41:20.302968 | controller | - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.302975 | controller | on port 1981' 2025-10-13 20:41:20.302982 | controller | - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.302990 | controller | 2 additional commands' 2025-10-13 20:41:20.302997 | controller | - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.303004 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.303011 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.303019 | controller | - ' ]' 2025-10-13 20:41:20.303026 | controller | - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.303034 | controller | of non API service certificates...' 2025-10-13 20:41:20.303041 | controller | - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.303049 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.303056 | controller | - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.303063 | controller | on port 15691...' 2025-10-13 20:41:20.303079 | controller | - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.303086 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.303094 | controller | - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.303101 | controller | on port 5671...' 2025-10-13 20:41:20.303108 | controller | - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.303115 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.303123 | controller | - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.303130 | controller | on port 15671...' 2025-10-13 20:41:20.303137 | controller | - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.303145 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.303152 | controller | - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.303159 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.303167 | controller | - ' logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.303177 | controller | on port 6642...' 2025-10-13 20:41:20.303188 | controller | - ' logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.303195 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.303202 | controller | - ' logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.303210 | controller | on port 6644...' 2025-10-13 20:41:20.303227 | controller | - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.303236 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.303244 | controller | - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.303270 | controller | on port 1981...' 2025-10-13 20:41:20.303280 | controller | - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.303288 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.303296 | controller | - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.303304 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.303313 | controller | - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.303326 | controller | on port 6641...' 2025-10-13 20:41:20.303358 | controller | - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.303372 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.303382 | controller | - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.303390 | controller | on port 6643...' 2025-10-13 20:41:20.303423 | controller | - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.303434 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.303446 | controller | - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.303454 | controller | on port 1981...' 2025-10-13 20:41:20.303462 | controller | - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.303473 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.303542 | controller | - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.303554 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.303563 | controller | - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.303570 | controller | on port 3000...' 2025-10-13 20:41:20.303578 | controller | - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.303591 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.303600 | controller | - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.303611 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.303622 | controller | - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.303630 | controller | on port 5671...' 2025-10-13 20:41:20.303638 | controller | - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.303647 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.303655 | controller | - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.303667 | controller | on port 15671...' 2025-10-13 20:41:20.303679 | controller | - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.303692 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.303701 | controller | - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.303713 | controller | on port 15691...' 2025-10-13 20:41:20.303726 | controller | - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.303733 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.303741 | controller | - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.303748 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.303755 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.303763 | controller | on port 3306...' 2025-10-13 20:41:20.303770 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.303777 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.303785 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.303792 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.303799 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.303807 | controller | on port 3306...' 2025-10-13 20:41:20.303814 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.303821 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.303828 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.303836 | controller | had certificate mismatches:' 2025-10-13 20:41:20.303843 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.303850 | controller | on port 1981' 2025-10-13 20:41:20.303858 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.303865 | controller | on port 1981' 2025-10-13 20:41:20.303872 | controller | - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.303879 | controller | 2 additional commands' 2025-10-13 20:41:20.303887 | controller | - ' logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.303902 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.303910 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.303918 | controller | - ' ]' 2025-10-13 20:41:20.303925 | controller | - ' logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.303933 | controller | of non API service certificates...' 2025-10-13 20:41:20.303940 | controller | - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.303947 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.303956 | controller | - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.303964 | controller | on port 15691...' 2025-10-13 20:41:20.303972 | controller | - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.303981 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.303988 | controller | - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.303996 | controller | on port 5671...' 2025-10-13 20:41:20.304003 | controller | - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.304010 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.304017 | controller | - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.304025 | controller | on port 15671...' 2025-10-13 20:41:20.304032 | controller | - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.304039 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.304047 | controller | - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304054 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.304064 | controller | - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.304072 | controller | on port 6642...' 2025-10-13 20:41:20.304079 | controller | - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.304086 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.304094 | controller | - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.304101 | controller | on port 6644...' 2025-10-13 20:41:20.304108 | controller | - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.304116 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.304123 | controller | - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.304130 | controller | on port 1981...' 2025-10-13 20:41:20.304137 | controller | - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.304144 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.304152 | controller | - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304160 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.304167 | controller | - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.304175 | controller | on port 6641...' 2025-10-13 20:41:20.304183 | controller | - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.304190 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.304196 | controller | - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.304202 | controller | on port 6643...' 2025-10-13 20:41:20.304208 | controller | - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.304222 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.304233 | controller | - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.304243 | controller | on port 1981...' 2025-10-13 20:41:20.304249 | controller | - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.304255 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.304260 | controller | - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304266 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.304272 | controller | - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.304277 | controller | on port 3000...' 2025-10-13 20:41:20.304283 | controller | - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.304289 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.304295 | controller | - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304300 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.304306 | controller | - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.304312 | controller | on port 5671...' 2025-10-13 20:41:20.304317 | controller | - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.304323 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.304329 | controller | - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.304334 | controller | on port 15671...' 2025-10-13 20:41:20.304349 | controller | - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.304358 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.304365 | controller | - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.304377 | controller | on port 15691...' 2025-10-13 20:41:20.304384 | controller | - ' logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.304389 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.304415 | controller | - ' logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.304428 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.304436 | controller | - ' logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.304444 | controller | on port 3306...' 2025-10-13 20:41:20.304451 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.304459 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.304465 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.304471 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.304476 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.304482 | controller | on port 3306...' 2025-10-13 20:41:20.304488 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.304493 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.304499 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.304505 | controller | had certificate mismatches:' 2025-10-13 20:41:20.304510 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.304516 | controller | on port 1981' 2025-10-13 20:41:20.304522 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.304527 | controller | on port 1981' 2025-10-13 20:41:20.304533 | controller | - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.304539 | controller | 2 additional commands' 2025-10-13 20:41:20.304544 | controller | - ' logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.304550 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.304556 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.304561 | controller | - ' ]' 2025-10-13 20:41:20.304567 | controller | - ' logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.304573 | controller | of non API service certificates...' 2025-10-13 20:41:20.304578 | controller | - ' logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304584 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.304590 | controller | - ' logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.304595 | controller | on port 15691...' 2025-10-13 20:41:20.304601 | controller | - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.304607 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.304613 | controller | - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.304618 | controller | on port 5671...' 2025-10-13 20:41:20.304624 | controller | - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.304630 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.304635 | controller | - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.304641 | controller | on port 15671...' 2025-10-13 20:41:20.304647 | controller | - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.304652 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.304658 | controller | - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304667 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.304673 | controller | - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.304682 | controller | on port 6642...' 2025-10-13 20:41:20.304688 | controller | - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.304693 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.304699 | controller | - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.304705 | controller | on port 6644...' 2025-10-13 20:41:20.304710 | controller | - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.304716 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.304722 | controller | - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.304727 | controller | on port 1981...' 2025-10-13 20:41:20.304733 | controller | - ' logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.304739 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.304744 | controller | - ' logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304750 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.304756 | controller | - ' logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.304770 | controller | on port 6641...' 2025-10-13 20:41:20.304779 | controller | - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.304786 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.304794 | controller | - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.304802 | controller | on port 6643...' 2025-10-13 20:41:20.304809 | controller | - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.304816 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.304823 | controller | - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.304829 | controller | on port 1981...' 2025-10-13 20:41:20.304836 | controller | - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.304843 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.304849 | controller | - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304855 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.304860 | controller | - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.304866 | controller | on port 3000...' 2025-10-13 20:41:20.304872 | controller | - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.304878 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.304883 | controller | - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.304889 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.304895 | controller | - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.304901 | controller | on port 5671...' 2025-10-13 20:41:20.304906 | controller | - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.304918 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.304924 | controller | - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.304930 | controller | on port 15671...' 2025-10-13 20:41:20.304936 | controller | - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.304947 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.304953 | controller | - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.304958 | controller | on port 15691...' 2025-10-13 20:41:20.304964 | controller | - ' logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.304970 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.304976 | controller | - ' logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.304981 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.304987 | controller | - ' logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.304993 | controller | on port 3306...' 2025-10-13 20:41:20.304999 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.305004 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.305010 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.305016 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.305021 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.305027 | controller | on port 3306...' 2025-10-13 20:41:20.305033 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.305038 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.305044 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.305050 | controller | had certificate mismatches:' 2025-10-13 20:41:20.305055 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.305061 | controller | on port 1981' 2025-10-13 20:41:20.305067 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.305073 | controller | on port 1981' 2025-10-13 20:41:20.305078 | controller | - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.305084 | controller | 2 additional commands' 2025-10-13 20:41:20.305090 | controller | - ' logger.go:42: 20:29:08 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.305095 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.305101 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.305107 | controller | - ' ]' 2025-10-13 20:41:20.305112 | controller | - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.305118 | controller | of non API service certificates...' 2025-10-13 20:41:20.305124 | controller | - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305129 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.305135 | controller | - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.305141 | controller | on port 15691...' 2025-10-13 20:41:20.305146 | controller | - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.305152 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.305165 | controller | - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.305173 | controller | on port 5671...' 2025-10-13 20:41:20.305181 | controller | - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.305189 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.305196 | controller | - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.305204 | controller | on port 15671...' 2025-10-13 20:41:20.305211 | controller | - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.305220 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.305226 | controller | - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305231 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.305237 | controller | - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.305253 | controller | on port 6642...' 2025-10-13 20:41:20.305259 | controller | - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.305264 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.305270 | controller | - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.305276 | controller | on port 6644...' 2025-10-13 20:41:20.305281 | controller | - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.305287 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.305293 | controller | - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.305299 | controller | on port 1981...' 2025-10-13 20:41:20.305304 | controller | - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.305310 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.305316 | controller | - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305321 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.305327 | controller | - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.305333 | controller | on port 6641...' 2025-10-13 20:41:20.305338 | controller | - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.305344 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.305350 | controller | - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.305355 | controller | on port 6643...' 2025-10-13 20:41:20.305361 | controller | - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.305367 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.305373 | controller | - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.305378 | controller | on port 1981...' 2025-10-13 20:41:20.305384 | controller | - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.305390 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.305415 | controller | - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305427 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.305435 | controller | - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.305442 | controller | on port 3000...' 2025-10-13 20:41:20.305448 | controller | - ' logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.305454 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.305459 | controller | - ' logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305465 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.305471 | controller | - ' logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.305476 | controller | on port 5671...' 2025-10-13 20:41:20.305482 | controller | - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.305488 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.305493 | controller | - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.305503 | controller | on port 15671...' 2025-10-13 20:41:20.305509 | controller | - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.305514 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.305520 | controller | - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.305526 | controller | on port 15691...' 2025-10-13 20:41:20.305531 | controller | - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.305537 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.305543 | controller | - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.305549 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.305554 | controller | - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.305560 | controller | on port 3306...' 2025-10-13 20:41:20.305573 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.305581 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.305589 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.305597 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.305604 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.305612 | controller | on port 3306...' 2025-10-13 20:41:20.305619 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.305627 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.305633 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.305638 | controller | had certificate mismatches:' 2025-10-13 20:41:20.305644 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.305650 | controller | on port 1981' 2025-10-13 20:41:20.305655 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.305661 | controller | on port 1981' 2025-10-13 20:41:20.305667 | controller | - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.305673 | controller | 2 additional commands' 2025-10-13 20:41:20.305678 | controller | - ' logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.305684 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.305694 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.305700 | controller | - ' ]' 2025-10-13 20:41:20.305706 | controller | - ' logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.305711 | controller | of non API service certificates...' 2025-10-13 20:41:20.305717 | controller | - ' logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305723 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.305728 | controller | - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.305734 | controller | on port 15691...' 2025-10-13 20:41:20.305740 | controller | - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.305745 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.305751 | controller | - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.305757 | controller | on port 5671...' 2025-10-13 20:41:20.305763 | controller | - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.305768 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.305774 | controller | - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.305783 | controller | on port 15671...' 2025-10-13 20:41:20.305789 | controller | - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.305794 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.305800 | controller | - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305806 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.305812 | controller | - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.305820 | controller | on port 6642...' 2025-10-13 20:41:20.305826 | controller | - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.305831 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.305837 | controller | - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.305843 | controller | on port 6644...' 2025-10-13 20:41:20.305848 | controller | - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.305854 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.305860 | controller | - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.305866 | controller | on port 1981...' 2025-10-13 20:41:20.305871 | controller | - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.305877 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.305883 | controller | - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305888 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.305894 | controller | - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.305900 | controller | on port 6641...' 2025-10-13 20:41:20.305905 | controller | - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.305911 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.305917 | controller | - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.305923 | controller | on port 6643...' 2025-10-13 20:41:20.305928 | controller | - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.305934 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.305940 | controller | - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.305945 | controller | on port 1981...' 2025-10-13 20:41:20.305951 | controller | - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.305965 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.305973 | controller | - ' logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.305980 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.305988 | controller | - ' logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.305995 | controller | on port 3000...' 2025-10-13 20:41:20.306002 | controller | - ' logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.306008 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.306013 | controller | - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.306019 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.306025 | controller | - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.306030 | controller | on port 5671...' 2025-10-13 20:41:20.306037 | controller | - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.306048 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.306056 | controller | - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.306064 | controller | on port 15671...' 2025-10-13 20:41:20.306071 | controller | - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.306079 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.306086 | controller | - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.306093 | controller | on port 15691...' 2025-10-13 20:41:20.306101 | controller | - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.306108 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.306116 | controller | - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.306123 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.306130 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.306137 | controller | on port 3306...' 2025-10-13 20:41:20.306143 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.306148 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.306154 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.306160 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.306165 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.306171 | controller | on port 3306...' 2025-10-13 20:41:20.306177 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.306182 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.306188 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.306194 | controller | had certificate mismatches:' 2025-10-13 20:41:20.306200 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.306205 | controller | on port 1981' 2025-10-13 20:41:20.306211 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.306216 | controller | on port 1981' 2025-10-13 20:41:20.306222 | controller | - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.306228 | controller | 2 additional commands' 2025-10-13 20:41:20.306234 | controller | - ' logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.306239 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.306256 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.306262 | controller | - ' ]' 2025-10-13 20:41:20.306267 | controller | - ' logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.306279 | controller | of non API service certificates...' 2025-10-13 20:41:20.306285 | controller | - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.306291 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.306297 | controller | - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.306302 | controller | on port 15691...' 2025-10-13 20:41:20.306308 | controller | - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.306314 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.306319 | controller | - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.306325 | controller | on port 5671...' 2025-10-13 20:41:20.306331 | controller | - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.306340 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.306345 | controller | - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.306351 | controller | on port 15671...' 2025-10-13 20:41:20.306357 | controller | - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.306363 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.306368 | controller | - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.306374 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.306390 | controller | - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.306427 | controller | on port 6642...' 2025-10-13 20:41:20.306435 | controller | - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.306441 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.306447 | controller | - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.306453 | controller | on port 6644...' 2025-10-13 20:41:20.306458 | controller | - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.306464 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.306470 | controller | - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.306476 | controller | on port 1981...' 2025-10-13 20:41:20.306482 | controller | - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.306487 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.306493 | controller | - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.306499 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.306505 | controller | - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.306514 | controller | on port 6641...' 2025-10-13 20:41:20.306520 | controller | - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.306525 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.306531 | controller | - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.306537 | controller | on port 6643...' 2025-10-13 20:41:20.306543 | controller | - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.306549 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.306555 | controller | - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.306561 | controller | on port 1981...' 2025-10-13 20:41:20.306567 | controller | - ' logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.306573 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.306581 | controller | - ' logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.306587 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.306593 | controller | - ' logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.306601 | controller | on port 3000...' 2025-10-13 20:41:20.306607 | controller | - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.306612 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.306618 | controller | - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.306624 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.306630 | controller | - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.306641 | controller | on port 5671...' 2025-10-13 20:41:20.306647 | controller | - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.306653 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.306659 | controller | - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.306665 | controller | on port 15671...' 2025-10-13 20:41:20.306670 | controller | - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.306676 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.306682 | controller | - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.306688 | controller | on port 15691...' 2025-10-13 20:41:20.306694 | controller | - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.306699 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.306705 | controller | - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.306711 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.306717 | controller | - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.306723 | controller | on port 3306...' 2025-10-13 20:41:20.306754 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.306762 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.306769 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.306775 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.306780 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.306786 | controller | on port 3306...' 2025-10-13 20:41:20.306792 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.306798 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.306803 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.306809 | controller | had certificate mismatches:' 2025-10-13 20:41:20.306815 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.306830 | controller | on port 1981' 2025-10-13 20:41:20.306838 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.306846 | controller | on port 1981' 2025-10-13 20:41:20.306854 | controller | - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.306862 | controller | 2 additional commands' 2025-10-13 20:41:20.306869 | controller | - ' logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.306875 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.306886 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.306891 | controller | - ' ]' 2025-10-13 20:41:20.306897 | controller | - ' logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.306903 | controller | of non API service certificates...' 2025-10-13 20:41:20.306909 | controller | - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.306915 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.306920 | controller | - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.306926 | controller | on port 15691...' 2025-10-13 20:41:20.306932 | controller | - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.306938 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.306944 | controller | - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.306953 | controller | on port 5671...' 2025-10-13 20:41:20.306958 | controller | - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.306966 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.306973 | controller | - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.306979 | controller | on port 15671...' 2025-10-13 20:41:20.306986 | controller | - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.306992 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.306998 | controller | - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.307004 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.307010 | controller | - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.307018 | controller | on port 6642...' 2025-10-13 20:41:20.307024 | controller | - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.307030 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.307035 | controller | - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.307041 | controller | on port 6644...' 2025-10-13 20:41:20.307047 | controller | - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.307053 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.307059 | controller | - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.307064 | controller | on port 1981...' 2025-10-13 20:41:20.307070 | controller | - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.307076 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.307082 | controller | - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.307087 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.307093 | controller | - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.307099 | controller | on port 6641...' 2025-10-13 20:41:20.307106 | controller | - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.307113 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.307121 | controller | - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.307128 | controller | on port 6643...' 2025-10-13 20:41:20.307136 | controller | - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.307143 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.307151 | controller | - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.307159 | controller | on port 1981...' 2025-10-13 20:41:20.307167 | controller | - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.307174 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.307186 | controller | - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.307213 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.307223 | controller | - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.307252 | controller | on port 3000...' 2025-10-13 20:41:20.307271 | controller | - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.307280 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.307288 | controller | - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.307302 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.307325 | controller | - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.307334 | controller | on port 5671...' 2025-10-13 20:41:20.307345 | controller | - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.307355 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.307362 | controller | - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.307370 | controller | on port 15671...' 2025-10-13 20:41:20.307379 | controller | - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.307391 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.307438 | controller | - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.307448 | controller | on port 15691...' 2025-10-13 20:41:20.307456 | controller | - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.307469 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.307488 | controller | - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.307497 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.307506 | controller | - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.307518 | controller | on port 3306...' 2025-10-13 20:41:20.307538 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.307546 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.307558 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.307577 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.307585 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.307594 | controller | on port 3306...' 2025-10-13 20:41:20.307605 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.307625 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.307634 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.307643 | controller | had certificate mismatches:' 2025-10-13 20:41:20.307654 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.307674 | controller | on port 1981' 2025-10-13 20:41:20.307686 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.307705 | controller | on port 1981' 2025-10-13 20:41:20.307713 | controller | - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.307725 | controller | 2 additional commands' 2025-10-13 20:41:20.307743 | controller | - ' logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.307751 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.307759 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.307766 | controller | - ' ]' 2025-10-13 20:41:20.307773 | controller | - ' logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.307780 | controller | of non API service certificates...' 2025-10-13 20:41:20.307787 | controller | - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.307793 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.307799 | controller | - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.307804 | controller | on port 15691...' 2025-10-13 20:41:20.307810 | controller | - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.307822 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.307827 | controller | - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.307833 | controller | on port 5671...' 2025-10-13 20:41:20.307839 | controller | - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.307844 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.307850 | controller | - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.307856 | controller | on port 15671...' 2025-10-13 20:41:20.307861 | controller | - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.307867 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.307873 | controller | - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.307878 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.307884 | controller | - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.307890 | controller | on port 6642...' 2025-10-13 20:41:20.307895 | controller | - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.307901 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.307907 | controller | - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.307913 | controller | on port 6644...' 2025-10-13 20:41:20.307918 | controller | - ' logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.307927 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.307933 | controller | - ' logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.307939 | controller | on port 1981...' 2025-10-13 20:41:20.307954 | controller | - ' logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.307963 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.307970 | controller | - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.307978 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.307986 | controller | - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.307995 | controller | on port 6641...' 2025-10-13 20:41:20.308001 | controller | - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.308006 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.308012 | controller | - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.308018 | controller | on port 6643...' 2025-10-13 20:41:20.308024 | controller | - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.308029 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.308035 | controller | - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.308041 | controller | on port 1981...' 2025-10-13 20:41:20.308046 | controller | - ' logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.308052 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.308058 | controller | - ' logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308063 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.308069 | controller | - ' logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.308075 | controller | on port 3000...' 2025-10-13 20:41:20.308080 | controller | - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.308086 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.308095 | controller | - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308101 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.308106 | controller | - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.308112 | controller | on port 5671...' 2025-10-13 20:41:20.308118 | controller | - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.308123 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.308129 | controller | - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.308135 | controller | on port 15671...' 2025-10-13 20:41:20.308141 | controller | - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.308146 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.308152 | controller | - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.308158 | controller | on port 15691...' 2025-10-13 20:41:20.308163 | controller | - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.308172 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.308178 | controller | - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.308184 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.308189 | controller | - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.308195 | controller | on port 3306...' 2025-10-13 20:41:20.308201 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.308206 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.308212 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.308218 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.308223 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.308229 | controller | on port 3306...' 2025-10-13 20:41:20.308235 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.308240 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.308246 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.308252 | controller | had certificate mismatches:' 2025-10-13 20:41:20.308257 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.308263 | controller | on port 1981' 2025-10-13 20:41:20.308269 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.308275 | controller | on port 1981' 2025-10-13 20:41:20.308280 | controller | - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.308286 | controller | 2 additional commands' 2025-10-13 20:41:20.308291 | controller | - ' logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.308298 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.308305 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.308312 | controller | - ' ]' 2025-10-13 20:41:20.308320 | controller | - ' logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.308327 | controller | of non API service certificates...' 2025-10-13 20:41:20.308343 | controller | - ' logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308352 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.308359 | controller | - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.308379 | controller | on port 15691...' 2025-10-13 20:41:20.308387 | controller | - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.308397 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.308433 | controller | - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.308447 | controller | on port 5671...' 2025-10-13 20:41:20.308453 | controller | - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.308459 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.308464 | controller | - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.308470 | controller | on port 15671...' 2025-10-13 20:41:20.308475 | controller | - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.308481 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.308487 | controller | - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308492 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.308498 | controller | - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.308504 | controller | on port 6642...' 2025-10-13 20:41:20.308509 | controller | - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.308515 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.308521 | controller | - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.308527 | controller | on port 6644...' 2025-10-13 20:41:20.308532 | controller | - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.308538 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.308544 | controller | - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.308550 | controller | on port 1981...' 2025-10-13 20:41:20.308556 | controller | - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.308562 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.308568 | controller | - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308573 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.308579 | controller | - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.308585 | controller | on port 6641...' 2025-10-13 20:41:20.308590 | controller | - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.308596 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.308602 | controller | - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.308608 | controller | on port 6643...' 2025-10-13 20:41:20.308614 | controller | - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.308619 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.308625 | controller | - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.308635 | controller | on port 1981...' 2025-10-13 20:41:20.308640 | controller | - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.308646 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.308652 | controller | - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308657 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.308663 | controller | - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.308669 | controller | on port 3000...' 2025-10-13 20:41:20.308677 | controller | - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.308683 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.308689 | controller | - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308694 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.308700 | controller | - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.308706 | controller | on port 5671...' 2025-10-13 20:41:20.308712 | controller | - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.308717 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.308723 | controller | - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.308729 | controller | on port 15671...' 2025-10-13 20:41:20.308734 | controller | - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.308740 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.308746 | controller | - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.308751 | controller | on port 15691...' 2025-10-13 20:41:20.308757 | controller | - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.308772 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.308780 | controller | - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.308788 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.308795 | controller | - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.308803 | controller | on port 3306...' 2025-10-13 20:41:20.308809 | controller | - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.308815 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.308820 | controller | - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.308826 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.308832 | controller | - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.308837 | controller | on port 3306...' 2025-10-13 20:41:20.308843 | controller | - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.308849 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.308854 | controller | - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.308860 | controller | had certificate mismatches:' 2025-10-13 20:41:20.308866 | controller | - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.308871 | controller | on port 1981' 2025-10-13 20:41:20.308877 | controller | - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.308883 | controller | on port 1981' 2025-10-13 20:41:20.308888 | controller | - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.308894 | controller | 2 additional commands' 2025-10-13 20:41:20.308900 | controller | - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.308905 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.308911 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.308917 | controller | - ' ]' 2025-10-13 20:41:20.308923 | controller | - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.308928 | controller | of non API service certificates...' 2025-10-13 20:41:20.308934 | controller | - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.308940 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.308948 | controller | - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.308954 | controller | on port 15691...' 2025-10-13 20:41:20.308959 | controller | - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.308965 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.308971 | controller | - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.308976 | controller | on port 5671...' 2025-10-13 20:41:20.308982 | controller | - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.308988 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.308994 | controller | - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.308999 | controller | on port 15671...' 2025-10-13 20:41:20.309005 | controller | - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.309010 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.309017 | controller | - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309023 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.309028 | controller | - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.309040 | controller | on port 6642...' 2025-10-13 20:41:20.309046 | controller | - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.309052 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.309057 | controller | - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.309065 | controller | on port 6644...' 2025-10-13 20:41:20.309071 | controller | - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.309077 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.309083 | controller | - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.309089 | controller | on port 1981...' 2025-10-13 20:41:20.309094 | controller | - ' logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.309100 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.309106 | controller | - ' logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309112 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.309117 | controller | - ' logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.309123 | controller | on port 6641...' 2025-10-13 20:41:20.309129 | controller | - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.309135 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.309141 | controller | - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.309146 | controller | on port 6643...' 2025-10-13 20:41:20.309160 | controller | - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.309168 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.309176 | controller | - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.309184 | controller | on port 1981...' 2025-10-13 20:41:20.309192 | controller | - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.309198 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.309204 | controller | - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309209 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.309218 | controller | - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.309224 | controller | on port 3000...' 2025-10-13 20:41:20.309230 | controller | - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.309236 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.309241 | controller | - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309247 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.309253 | controller | - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.309259 | controller | on port 5671...' 2025-10-13 20:41:20.309265 | controller | - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.309270 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.309276 | controller | - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.309282 | controller | on port 15671...' 2025-10-13 20:41:20.309288 | controller | - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.309293 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.309299 | controller | - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.309305 | controller | on port 15691...' 2025-10-13 20:41:20.309311 | controller | - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.309316 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.309322 | controller | - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.309328 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.309333 | controller | - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.309339 | controller | on port 3306...' 2025-10-13 20:41:20.309345 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.309350 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.309357 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.309364 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.309371 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.309379 | controller | on port 3306...' 2025-10-13 20:41:20.309386 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.309398 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.309424 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.309432 | controller | had certificate mismatches:' 2025-10-13 20:41:20.309438 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.309443 | controller | on port 1981' 2025-10-13 20:41:20.309449 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.309455 | controller | on port 1981' 2025-10-13 20:41:20.309460 | controller | - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.309466 | controller | 2 additional commands' 2025-10-13 20:41:20.309480 | controller | - ' logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.309485 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.309491 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.309502 | controller | - ' ]' 2025-10-13 20:41:20.309508 | controller | - ' logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.309513 | controller | of non API service certificates...' 2025-10-13 20:41:20.309523 | controller | - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309528 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.309534 | controller | - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.309540 | controller | on port 15691...' 2025-10-13 20:41:20.309545 | controller | - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.309551 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.309557 | controller | - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.309562 | controller | on port 5671...' 2025-10-13 20:41:20.309568 | controller | - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.309574 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.309589 | controller | - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.309597 | controller | on port 15671...' 2025-10-13 20:41:20.309605 | controller | - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.309612 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.309620 | controller | - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309627 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.309634 | controller | - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.309645 | controller | on port 6642...' 2025-10-13 20:41:20.309651 | controller | - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.309657 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.309662 | controller | - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.309668 | controller | on port 6644...' 2025-10-13 20:41:20.309674 | controller | - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.309680 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.309685 | controller | - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.309691 | controller | on port 1981...' 2025-10-13 20:41:20.309697 | controller | - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.309702 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.309708 | controller | - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309714 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.309719 | controller | - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.309725 | controller | on port 6641...' 2025-10-13 20:41:20.309731 | controller | - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.309736 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.309742 | controller | - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.309750 | controller | on port 6643...' 2025-10-13 20:41:20.309756 | controller | - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.309762 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.309767 | controller | - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.309773 | controller | on port 1981...' 2025-10-13 20:41:20.309779 | controller | - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.309785 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.309790 | controller | - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309799 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.309805 | controller | - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.309811 | controller | on port 3000...' 2025-10-13 20:41:20.309816 | controller | - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.309822 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.309828 | controller | - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.309834 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.309839 | controller | - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.309845 | controller | on port 5671...' 2025-10-13 20:41:20.309851 | controller | - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.309859 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.309865 | controller | - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.309871 | controller | on port 15671...' 2025-10-13 20:41:20.309877 | controller | - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.309882 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.309888 | controller | - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.309894 | controller | on port 15691...' 2025-10-13 20:41:20.309900 | controller | - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.309905 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.309911 | controller | - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.309917 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.309923 | controller | - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.309929 | controller | on port 3306...' 2025-10-13 20:41:20.309934 | controller | - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.309940 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.309946 | controller | - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.309952 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.309968 | controller | - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.309977 | controller | on port 3306...' 2025-10-13 20:41:20.309987 | controller | - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.309995 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.310002 | controller | - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.310009 | controller | had certificate mismatches:' 2025-10-13 20:41:20.310015 | controller | - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.310021 | controller | on port 1981' 2025-10-13 20:41:20.310026 | controller | - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.310032 | controller | on port 1981' 2025-10-13 20:41:20.310038 | controller | - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.310044 | controller | 2 additional commands' 2025-10-13 20:41:20.310050 | controller | - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.310055 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.310061 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.310067 | controller | - ' ]' 2025-10-13 20:41:20.310076 | controller | - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.310082 | controller | of non API service certificates...' 2025-10-13 20:41:20.310088 | controller | - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.310094 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.310099 | controller | - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.310105 | controller | on port 15691...' 2025-10-13 20:41:20.310111 | controller | - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.310117 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.310122 | controller | - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.310128 | controller | on port 5671...' 2025-10-13 20:41:20.310134 | controller | - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.310140 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.310145 | controller | - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.310151 | controller | on port 15671...' 2025-10-13 20:41:20.310157 | controller | - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.310163 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.310168 | controller | - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.310174 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.310180 | controller | - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.310186 | controller | on port 6642...' 2025-10-13 20:41:20.310191 | controller | - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.310197 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.310203 | controller | - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.310209 | controller | on port 6644...' 2025-10-13 20:41:20.310215 | controller | - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.310221 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.310227 | controller | - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.310233 | controller | on port 1981...' 2025-10-13 20:41:20.310239 | controller | - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.310244 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.310250 | controller | - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.310256 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.310262 | controller | - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.310268 | controller | on port 6641...' 2025-10-13 20:41:20.310274 | controller | - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.310280 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.310289 | controller | - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.310295 | controller | on port 6643...' 2025-10-13 20:41:20.310301 | controller | - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.310306 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.310312 | controller | - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.310318 | controller | on port 1981...' 2025-10-13 20:41:20.310326 | controller | - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.310335 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.310341 | controller | - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.310346 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.310352 | controller | - ' logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.310369 | controller | on port 3000...' 2025-10-13 20:41:20.310377 | controller | - ' logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.310384 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.310395 | controller | - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.310417 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.310426 | controller | - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.310431 | controller | on port 5671...' 2025-10-13 20:41:20.310437 | controller | - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.310446 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.310452 | controller | - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.310459 | controller | on port 15671...' 2025-10-13 20:41:20.310466 | controller | - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.310474 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.310481 | controller | - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.310489 | controller | on port 15691...' 2025-10-13 20:41:20.310497 | controller | - ' logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.310504 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.310512 | controller | - ' logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.310520 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.310527 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.310535 | controller | on port 3306...' 2025-10-13 20:41:20.310543 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.310552 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.310565 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.310613 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.310623 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.310632 | controller | on port 3306...' 2025-10-13 20:41:20.310640 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.310649 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.310657 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.310669 | controller | had certificate mismatches:' 2025-10-13 20:41:20.310689 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.310697 | controller | on port 1981' 2025-10-13 20:41:20.310709 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.310727 | controller | on port 1981' 2025-10-13 20:41:20.310739 | controller | - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.310757 | controller | 2 additional commands' 2025-10-13 20:41:20.310780 | controller | - ' logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.310789 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.310802 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.310815 | controller | - ' ]' 2025-10-13 20:41:20.310823 | controller | - ' logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.310832 | controller | of non API service certificates...' 2025-10-13 20:41:20.310843 | controller | - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.310864 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.310875 | controller | - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.310894 | controller | on port 15691...' 2025-10-13 20:41:20.310903 | controller | - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.310911 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.310919 | controller | - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.310927 | controller | on port 5671...' 2025-10-13 20:41:20.310935 | controller | - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.310943 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.310952 | controller | - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.310964 | controller | on port 15671...' 2025-10-13 20:41:20.311014 | controller | - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.311026 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.311034 | controller | - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311042 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.311049 | controller | - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.311065 | controller | on port 6642...' 2025-10-13 20:41:20.311071 | controller | - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.311076 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.311092 | controller | - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.311100 | controller | on port 6644...' 2025-10-13 20:41:20.311108 | controller | - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.311116 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.311123 | controller | - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.311131 | controller | on port 1981...' 2025-10-13 20:41:20.311138 | controller | - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.311145 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.311151 | controller | - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311156 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.311162 | controller | - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.311168 | controller | on port 6641...' 2025-10-13 20:41:20.311173 | controller | - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.311179 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.311185 | controller | - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.311190 | controller | on port 6643...' 2025-10-13 20:41:20.311196 | controller | - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.311202 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.311207 | controller | - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.311217 | controller | on port 1981...' 2025-10-13 20:41:20.311223 | controller | - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.311229 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.311234 | controller | - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311240 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.311246 | controller | - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.311251 | controller | on port 3000...' 2025-10-13 20:41:20.311257 | controller | - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.311263 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.311268 | controller | - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311274 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.311280 | controller | - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.311285 | controller | on port 5671...' 2025-10-13 20:41:20.311291 | controller | - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.311297 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.311303 | controller | - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.311308 | controller | on port 15671...' 2025-10-13 20:41:20.311314 | controller | - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.311320 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.311325 | controller | - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.311331 | controller | on port 15691...' 2025-10-13 20:41:20.311337 | controller | - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.311342 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.311348 | controller | - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.311354 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.311359 | controller | - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.311365 | controller | on port 3306...' 2025-10-13 20:41:20.311371 | controller | - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.311380 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.311386 | controller | - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.311395 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.311423 | controller | - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.311429 | controller | on port 3306...' 2025-10-13 20:41:20.311435 | controller | - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.311441 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.311447 | controller | - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.311452 | controller | had certificate mismatches:' 2025-10-13 20:41:20.311458 | controller | - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.311463 | controller | on port 1981' 2025-10-13 20:41:20.311469 | controller | - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.311475 | controller | on port 1981' 2025-10-13 20:41:20.311481 | controller | - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.311486 | controller | 2 additional commands' 2025-10-13 20:41:20.311503 | controller | - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.311511 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.311519 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.311527 | controller | - ' ]' 2025-10-13 20:41:20.311534 | controller | - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.311542 | controller | of non API service certificates...' 2025-10-13 20:41:20.311550 | controller | - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311557 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.311564 | controller | - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.311572 | controller | on port 15691...' 2025-10-13 20:41:20.311579 | controller | - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.311587 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.311595 | controller | - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.311602 | controller | on port 5671...' 2025-10-13 20:41:20.311607 | controller | - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.311613 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.311619 | controller | - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.311633 | controller | on port 15671...' 2025-10-13 20:41:20.311639 | controller | - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.311651 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.311656 | controller | - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311662 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.311668 | controller | - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.311677 | controller | on port 6642...' 2025-10-13 20:41:20.311683 | controller | - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.311689 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.311695 | controller | - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.311700 | controller | on port 6644...' 2025-10-13 20:41:20.311706 | controller | - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.311712 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.311717 | controller | - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.311723 | controller | on port 1981...' 2025-10-13 20:41:20.311729 | controller | - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.311734 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.311740 | controller | - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311746 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.311751 | controller | - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.311757 | controller | on port 6641...' 2025-10-13 20:41:20.311763 | controller | - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.311768 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.311774 | controller | - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.311780 | controller | on port 6643...' 2025-10-13 20:41:20.311785 | controller | - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.311794 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.311800 | controller | - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.311806 | controller | on port 1981...' 2025-10-13 20:41:20.311811 | controller | - ' logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.311817 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.311823 | controller | - ' logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311828 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.311834 | controller | - ' logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.311840 | controller | on port 3000...' 2025-10-13 20:41:20.311845 | controller | - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.311851 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.311856 | controller | - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.311862 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.311868 | controller | - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.311874 | controller | on port 5671...' 2025-10-13 20:41:20.311879 | controller | - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.311885 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.311891 | controller | - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.311905 | controller | on port 15671...' 2025-10-13 20:41:20.311913 | controller | - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.311921 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.311929 | controller | - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.311937 | controller | on port 15691...' 2025-10-13 20:41:20.311943 | controller | - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.311949 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.311955 | controller | - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.311960 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.311966 | controller | - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.311972 | controller | on port 3306...' 2025-10-13 20:41:20.311977 | controller | - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.311983 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.311989 | controller | - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.311994 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.312000 | controller | - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.312006 | controller | on port 3306...' 2025-10-13 20:41:20.312011 | controller | - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.312017 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.312023 | controller | - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.312028 | controller | had certificate mismatches:' 2025-10-13 20:41:20.312034 | controller | - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.312040 | controller | on port 1981' 2025-10-13 20:41:20.312045 | controller | - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.312051 | controller | on port 1981' 2025-10-13 20:41:20.312057 | controller | - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.312066 | controller | 2 additional commands' 2025-10-13 20:41:20.312071 | controller | - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.312077 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.312083 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.312088 | controller | - ' ]' 2025-10-13 20:41:20.312094 | controller | - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.312100 | controller | of non API service certificates...' 2025-10-13 20:41:20.312105 | controller | - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312111 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.312117 | controller | - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.312122 | controller | on port 15691...' 2025-10-13 20:41:20.312128 | controller | - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.312134 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.312139 | controller | - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.312145 | controller | on port 5671...' 2025-10-13 20:41:20.312151 | controller | - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.312156 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.312162 | controller | - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.312168 | controller | on port 15671...' 2025-10-13 20:41:20.312173 | controller | - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.312179 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.312185 | controller | - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312190 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.312196 | controller | - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.312204 | controller | on port 6642...' 2025-10-13 20:41:20.312210 | controller | - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.312216 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.312222 | controller | - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.312227 | controller | on port 6644...' 2025-10-13 20:41:20.312233 | controller | - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.312239 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.312247 | controller | - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.312253 | controller | on port 1981...' 2025-10-13 20:41:20.312258 | controller | - ' logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.312264 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.312270 | controller | - ' logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312276 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.312291 | controller | - ' logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.312299 | controller | on port 6641...' 2025-10-13 20:41:20.312307 | controller | - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.312315 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.312322 | controller | - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.312331 | controller | on port 6643...' 2025-10-13 20:41:20.312337 | controller | - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.312343 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.312349 | controller | - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.312354 | controller | on port 1981...' 2025-10-13 20:41:20.312360 | controller | - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.312366 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.312371 | controller | - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312377 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.312383 | controller | - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.312391 | controller | on port 3000...' 2025-10-13 20:41:20.312412 | controller | - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.312421 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.312427 | controller | - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312433 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.312438 | controller | - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.312444 | controller | on port 5671...' 2025-10-13 20:41:20.312450 | controller | - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.312455 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.312461 | controller | - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.312467 | controller | on port 15671...' 2025-10-13 20:41:20.312472 | controller | - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.312478 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.312484 | controller | - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.312489 | controller | on port 15691...' 2025-10-13 20:41:20.312495 | controller | - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.312501 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.312506 | controller | - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.312512 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.312518 | controller | - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.312523 | controller | on port 3306...' 2025-10-13 20:41:20.312529 | controller | - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.312535 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.312540 | controller | - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.312546 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.312552 | controller | - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.312557 | controller | on port 3306...' 2025-10-13 20:41:20.312563 | controller | - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.312569 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.312574 | controller | - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.312580 | controller | had certificate mismatches:' 2025-10-13 20:41:20.312586 | controller | - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.312591 | controller | on port 1981' 2025-10-13 20:41:20.312597 | controller | - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.312607 | controller | on port 1981' 2025-10-13 20:41:20.312612 | controller | - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.312618 | controller | 2 additional commands' 2025-10-13 20:41:20.312624 | controller | - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.312629 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.312635 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.312641 | controller | - ' ]' 2025-10-13 20:41:20.312648 | controller | - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.312655 | controller | of non API service certificates...' 2025-10-13 20:41:20.312662 | controller | - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312670 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.312677 | controller | - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.312685 | controller | on port 15691...' 2025-10-13 20:41:20.312701 | controller | - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.312709 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.312717 | controller | - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.312725 | controller | on port 5671...' 2025-10-13 20:41:20.312732 | controller | - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.312738 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.312751 | controller | - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.312757 | controller | on port 15671...' 2025-10-13 20:41:20.312768 | controller | - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.312774 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.312780 | controller | - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312785 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.312791 | controller | - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.312800 | controller | on port 6642...' 2025-10-13 20:41:20.312806 | controller | - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.312812 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.312817 | controller | - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.312823 | controller | on port 6644...' 2025-10-13 20:41:20.312829 | controller | - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.312834 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.312840 | controller | - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.312846 | controller | on port 1981...' 2025-10-13 20:41:20.312851 | controller | - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.312857 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.312863 | controller | - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312868 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.312874 | controller | - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.312880 | controller | on port 6641...' 2025-10-13 20:41:20.312885 | controller | - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.312895 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.312901 | controller | - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.312906 | controller | on port 6643...' 2025-10-13 20:41:20.312912 | controller | - ' logger.go:42: 20:30:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.312918 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.312923 | controller | - ' logger.go:42: 20:30:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.312934 | controller | on port 1981...' 2025-10-13 20:41:20.312940 | controller | - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.312945 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.312951 | controller | - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312957 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.312962 | controller | - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.312968 | controller | on port 3000...' 2025-10-13 20:41:20.312974 | controller | - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.312979 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.312985 | controller | - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.312991 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.312996 | controller | - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.313002 | controller | on port 5671...' 2025-10-13 20:41:20.313008 | controller | - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.313013 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.313019 | controller | - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.313025 | controller | on port 15671...' 2025-10-13 20:41:20.313031 | controller | - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.313036 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.313042 | controller | - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.313048 | controller | on port 15691...' 2025-10-13 20:41:20.313053 | controller | - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.313059 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.313065 | controller | - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.313070 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.313076 | controller | - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.313090 | controller | on port 3306...' 2025-10-13 20:41:20.313098 | controller | - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.313106 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.313113 | controller | - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.313121 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.313127 | controller | - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.313133 | controller | on port 3306...' 2025-10-13 20:41:20.313139 | controller | - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.313145 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.313150 | controller | - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.313156 | controller | had certificate mismatches:' 2025-10-13 20:41:20.313165 | controller | - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.313171 | controller | on port 1981' 2025-10-13 20:41:20.313177 | controller | - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.313182 | controller | on port 1981' 2025-10-13 20:41:20.313188 | controller | - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.313194 | controller | 2 additional commands' 2025-10-13 20:41:20.313200 | controller | - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.313205 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.313211 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.313217 | controller | - ' ]' 2025-10-13 20:41:20.313222 | controller | - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.313228 | controller | of non API service certificates...' 2025-10-13 20:41:20.313234 | controller | - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.313239 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.313245 | controller | - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.313251 | controller | on port 15691...' 2025-10-13 20:41:20.313256 | controller | - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.313262 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.313268 | controller | - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.313273 | controller | on port 5671...' 2025-10-13 20:41:20.313279 | controller | - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.313285 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.313290 | controller | - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.313296 | controller | on port 15671...' 2025-10-13 20:41:20.313302 | controller | - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.313307 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.313313 | controller | - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.313319 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.313324 | controller | - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.313334 | controller | on port 6642...' 2025-10-13 20:41:20.313339 | controller | - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.313345 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.313351 | controller | - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.313357 | controller | on port 6644...' 2025-10-13 20:41:20.313362 | controller | - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.313368 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.313374 | controller | - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.313379 | controller | on port 1981...' 2025-10-13 20:41:20.313385 | controller | - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.313391 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.313412 | controller | - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.313421 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.313427 | controller | - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.313433 | controller | on port 6641...' 2025-10-13 20:41:20.313441 | controller | - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.313447 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.313453 | controller | - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.313459 | controller | on port 6643...' 2025-10-13 20:41:20.313464 | controller | - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.313470 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.313476 | controller | - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.313481 | controller | on port 1981...' 2025-10-13 20:41:20.313495 | controller | - ' logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.313503 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.313511 | controller | - ' logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.313519 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.313526 | controller | - ' logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.313532 | controller | on port 3000...' 2025-10-13 20:41:20.313538 | controller | - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.313544 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.313549 | controller | - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.313556 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.313563 | controller | - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.313571 | controller | on port 5671...' 2025-10-13 20:41:20.313578 | controller | - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.313586 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.313594 | controller | - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.313601 | controller | on port 15671...' 2025-10-13 20:41:20.313609 | controller | - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.313621 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.313632 | controller | - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.313651 | controller | on port 15691...' 2025-10-13 20:41:20.313660 | controller | - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.313676 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.313688 | controller | - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.313737 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.313747 | controller | - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.313755 | controller | on port 3306...' 2025-10-13 20:41:20.313765 | controller | - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.313781 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.313789 | controller | - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.313797 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.313808 | controller | - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.313829 | controller | on port 3306...' 2025-10-13 20:41:20.313837 | controller | - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.313849 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.313868 | controller | - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.313881 | controller | had certificate mismatches:' 2025-10-13 20:41:20.313892 | controller | - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.313902 | controller | on port 1981' 2025-10-13 20:41:20.313915 | controller | - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.313923 | controller | on port 1981' 2025-10-13 20:41:20.313935 | controller | - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.313954 | controller | 2 additional commands' 2025-10-13 20:41:20.313962 | controller | - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.313976 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.314010 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.314019 | controller | - ' ]' 2025-10-13 20:41:20.314031 | controller | - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.314051 | controller | of non API service certificates...' 2025-10-13 20:41:20.314059 | controller | - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314068 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.314079 | controller | - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.314099 | controller | on port 15691...' 2025-10-13 20:41:20.314107 | controller | - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.314119 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.314138 | controller | - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.314146 | controller | on port 5671...' 2025-10-13 20:41:20.314158 | controller | - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.314178 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.314186 | controller | - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.314194 | controller | on port 15671...' 2025-10-13 20:41:20.314202 | controller | - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.314211 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.314234 | controller | - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314250 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.314258 | controller | - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.314268 | controller | on port 6642...' 2025-10-13 20:41:20.314280 | controller | - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.314288 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.314295 | controller | - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.314303 | controller | on port 6644...' 2025-10-13 20:41:20.314309 | controller | - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.314315 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.314323 | controller | - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.314331 | controller | on port 1981...' 2025-10-13 20:41:20.314337 | controller | - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.314343 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.314348 | controller | - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314354 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.314363 | controller | - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.314369 | controller | on port 6641...' 2025-10-13 20:41:20.314375 | controller | - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.314380 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.314386 | controller | - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.314395 | controller | on port 6643...' 2025-10-13 20:41:20.314425 | controller | - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.314432 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.314440 | controller | - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.314447 | controller | on port 1981...' 2025-10-13 20:41:20.314453 | controller | - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.314458 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.314464 | controller | - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314470 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.314476 | controller | - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.314484 | controller | on port 3000...' 2025-10-13 20:41:20.314490 | controller | - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.314496 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.314502 | controller | - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314507 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.314513 | controller | - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.314519 | controller | on port 5671...' 2025-10-13 20:41:20.314524 | controller | - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.314530 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.314536 | controller | - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.314542 | controller | on port 15671...' 2025-10-13 20:41:20.314547 | controller | - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.314553 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.314559 | controller | - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.314564 | controller | on port 15691...' 2025-10-13 20:41:20.314570 | controller | - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.314576 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.314581 | controller | - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.314587 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.314593 | controller | - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.314598 | controller | on port 3306...' 2025-10-13 20:41:20.314604 | controller | - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.314610 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.314615 | controller | - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.314621 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.314628 | controller | - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.314636 | controller | on port 3306...' 2025-10-13 20:41:20.314643 | controller | - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.314656 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.314663 | controller | - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.314680 | controller | had certificate mismatches:' 2025-10-13 20:41:20.314689 | controller | - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.314697 | controller | on port 1981' 2025-10-13 20:41:20.314705 | controller | - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.314712 | controller | on port 1981' 2025-10-13 20:41:20.314718 | controller | - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.314723 | controller | 2 additional commands' 2025-10-13 20:41:20.314738 | controller | - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.314750 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.314755 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.314761 | controller | - ' ]' 2025-10-13 20:41:20.314767 | controller | - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.314772 | controller | of non API service certificates...' 2025-10-13 20:41:20.314778 | controller | - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314784 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.314804 | controller | - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.314811 | controller | on port 15691...' 2025-10-13 20:41:20.314817 | controller | - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.314824 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.314830 | controller | - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.314836 | controller | on port 5671...' 2025-10-13 20:41:20.314843 | controller | - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.314849 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.314856 | controller | - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.314862 | controller | on port 15671...' 2025-10-13 20:41:20.314868 | controller | - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.314875 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.314881 | controller | - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314887 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.314894 | controller | - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.314904 | controller | on port 6642...' 2025-10-13 20:41:20.314910 | controller | - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.314917 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.314923 | controller | - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.314929 | controller | on port 6644...' 2025-10-13 20:41:20.314936 | controller | - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.314942 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.314948 | controller | - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.314955 | controller | on port 1981...' 2025-10-13 20:41:20.314961 | controller | - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.314967 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.314974 | controller | - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.314984 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.314990 | controller | - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.314997 | controller | on port 6641...' 2025-10-13 20:41:20.315003 | controller | - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.315009 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.315016 | controller | - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.315022 | controller | on port 6643...' 2025-10-13 20:41:20.315028 | controller | - ' logger.go:42: 20:31:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.315035 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.315041 | controller | - ' logger.go:42: 20:31:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.315047 | controller | on port 1981...' 2025-10-13 20:41:20.315053 | controller | - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.315059 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.315064 | controller | - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315070 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.315075 | controller | - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.315081 | controller | on port 3000...' 2025-10-13 20:41:20.315087 | controller | - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.315092 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.315098 | controller | - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315112 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.315120 | controller | - ' logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.315127 | controller | on port 5671...' 2025-10-13 20:41:20.315135 | controller | - ' logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.315142 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.315150 | controller | - ' logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.315156 | controller | on port 15671...' 2025-10-13 20:41:20.315162 | controller | - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.315168 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.315173 | controller | - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.315179 | controller | on port 15691...' 2025-10-13 20:41:20.315185 | controller | - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.315190 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.315196 | controller | - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.315202 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.315207 | controller | - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.315213 | controller | on port 3306...' 2025-10-13 20:41:20.315219 | controller | - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.315224 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.315230 | controller | - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.315235 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.315241 | controller | - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.315253 | controller | on port 3306...' 2025-10-13 20:41:20.315259 | controller | - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.315264 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.315270 | controller | - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.315276 | controller | had certificate mismatches:' 2025-10-13 20:41:20.315281 | controller | - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.315287 | controller | on port 1981' 2025-10-13 20:41:20.315293 | controller | - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.315298 | controller | on port 1981' 2025-10-13 20:41:20.315304 | controller | - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.315310 | controller | 2 additional commands' 2025-10-13 20:41:20.315315 | controller | - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.315321 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.315327 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.315332 | controller | - ' ]' 2025-10-13 20:41:20.315338 | controller | - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.315343 | controller | of non API service certificates...' 2025-10-13 20:41:20.315349 | controller | - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315355 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.315360 | controller | - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.315366 | controller | on port 15691...' 2025-10-13 20:41:20.315372 | controller | - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.315377 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.315383 | controller | - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.315389 | controller | on port 5671...' 2025-10-13 20:41:20.315397 | controller | - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.315420 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.315426 | controller | - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.315431 | controller | on port 15671...' 2025-10-13 20:41:20.315437 | controller | - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.315443 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.315448 | controller | - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315454 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.315460 | controller | - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.315468 | controller | on port 6642...' 2025-10-13 20:41:20.315474 | controller | - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.315480 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.315485 | controller | - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.315491 | controller | on port 6644...' 2025-10-13 20:41:20.315497 | controller | - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.315503 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.315517 | controller | - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.315525 | controller | on port 1981...' 2025-10-13 20:41:20.315533 | controller | - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.315544 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.315552 | controller | - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315557 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.315563 | controller | - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.315572 | controller | on port 6641...' 2025-10-13 20:41:20.315578 | controller | - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.315584 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.315589 | controller | - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.315595 | controller | on port 6643...' 2025-10-13 20:41:20.315601 | controller | - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.315606 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.315612 | controller | - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.315618 | controller | on port 1981...' 2025-10-13 20:41:20.315623 | controller | - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.315629 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.315635 | controller | - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315640 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.315646 | controller | - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.315652 | controller | on port 3000...' 2025-10-13 20:41:20.315657 | controller | - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.315663 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.315669 | controller | - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315674 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.315680 | controller | - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.315686 | controller | on port 5671...' 2025-10-13 20:41:20.315691 | controller | - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.315697 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.315703 | controller | - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.315708 | controller | on port 15671...' 2025-10-13 20:41:20.315714 | controller | - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.315720 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.315725 | controller | - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.315731 | controller | on port 15691...' 2025-10-13 20:41:20.315736 | controller | - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.315742 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.315748 | controller | - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.315753 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.315759 | controller | - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.315765 | controller | on port 3306...' 2025-10-13 20:41:20.315770 | controller | - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.315776 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.315782 | controller | - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.315790 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.315796 | controller | - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.315801 | controller | on port 3306...' 2025-10-13 20:41:20.315807 | controller | - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.315813 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.315818 | controller | - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.315824 | controller | had certificate mismatches:' 2025-10-13 20:41:20.315830 | controller | - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.315835 | controller | on port 1981' 2025-10-13 20:41:20.315841 | controller | - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.315847 | controller | on port 1981' 2025-10-13 20:41:20.315852 | controller | - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.315858 | controller | 2 additional commands' 2025-10-13 20:41:20.315864 | controller | - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.315869 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.315875 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.315881 | controller | - ' ]' 2025-10-13 20:41:20.315894 | controller | - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.315902 | controller | of non API service certificates...' 2025-10-13 20:41:20.315909 | controller | - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.315917 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.315924 | controller | - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.315932 | controller | on port 15691...' 2025-10-13 20:41:20.315939 | controller | - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.315947 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.315954 | controller | - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.315962 | controller | on port 5671...' 2025-10-13 20:41:20.315970 | controller | - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.315978 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.315992 | controller | - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.316006 | controller | on port 15671...' 2025-10-13 20:41:20.316026 | controller | - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.316043 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.316053 | controller | - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.316061 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.316073 | controller | - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.316093 | controller | on port 6642...' 2025-10-13 20:41:20.316102 | controller | - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.316109 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.316117 | controller | - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.316130 | controller | on port 6644...' 2025-10-13 20:41:20.316138 | controller | - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.316150 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.316185 | controller | - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.316199 | controller | on port 1981...' 2025-10-13 20:41:20.316214 | controller | - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.316222 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.316230 | controller | - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.316243 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.316262 | controller | - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.316270 | controller | on port 6641...' 2025-10-13 20:41:20.316282 | controller | - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.316302 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.316310 | controller | - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.316322 | controller | on port 6643...' 2025-10-13 20:41:20.316340 | controller | - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.316348 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.316356 | controller | - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.316364 | controller | on port 1981...' 2025-10-13 20:41:20.316373 | controller | - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.316385 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.316449 | controller | - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.316461 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.316469 | controller | - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.316481 | controller | on port 3000...' 2025-10-13 20:41:20.316487 | controller | - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.316495 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.316501 | controller | - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.316506 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.316512 | controller | - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.316518 | controller | on port 5671...' 2025-10-13 20:41:20.316523 | controller | - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.316529 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.316535 | controller | - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.316540 | controller | on port 15671...' 2025-10-13 20:41:20.316546 | controller | - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.316552 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.316557 | controller | - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.316563 | controller | on port 15691...' 2025-10-13 20:41:20.316578 | controller | - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.316587 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.316594 | controller | - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.316602 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.316609 | controller | - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.316617 | controller | on port 3306...' 2025-10-13 20:41:20.316624 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.316633 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.316639 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.316644 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.316650 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.316656 | controller | on port 3306...' 2025-10-13 20:41:20.316661 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.316667 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.316672 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.316678 | controller | had certificate mismatches:' 2025-10-13 20:41:20.316684 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.316689 | controller | on port 1981' 2025-10-13 20:41:20.316695 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.316701 | controller | on port 1981' 2025-10-13 20:41:20.316706 | controller | - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.316712 | controller | 2 additional commands' 2025-10-13 20:41:20.316718 | controller | - ' logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.316723 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.316729 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.316735 | controller | - ' ]' 2025-10-13 20:41:20.316740 | controller | - ' logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.316746 | controller | of non API service certificates...' 2025-10-13 20:41:20.316752 | controller | - ' logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.316757 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.316763 | controller | - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.316769 | controller | on port 15691...' 2025-10-13 20:41:20.316774 | controller | - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.316780 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.316785 | controller | - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.316791 | controller | on port 5671...' 2025-10-13 20:41:20.316797 | controller | - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.316802 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.316808 | controller | - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.316814 | controller | on port 15671...' 2025-10-13 20:41:20.316820 | controller | - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.316825 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.316831 | controller | - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.316837 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.316843 | controller | - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.316849 | controller | on port 6642...' 2025-10-13 20:41:20.316854 | controller | - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.316860 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.316866 | controller | - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.316871 | controller | on port 6644...' 2025-10-13 20:41:20.316877 | controller | - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.316885 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.316891 | controller | - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.316897 | controller | on port 1981...' 2025-10-13 20:41:20.316903 | controller | - ' logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.316908 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.316914 | controller | - ' logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.316920 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.316925 | controller | - ' logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.316931 | controller | on port 6641...' 2025-10-13 20:41:20.316937 | controller | - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.316942 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.316956 | controller | - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.316966 | controller | on port 6643...' 2025-10-13 20:41:20.316975 | controller | - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.316984 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.316991 | controller | - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.316997 | controller | on port 1981...' 2025-10-13 20:41:20.317002 | controller | - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.317008 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.317014 | controller | - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317019 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.317025 | controller | - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.317031 | controller | on port 3000...' 2025-10-13 20:41:20.317036 | controller | - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.317042 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.317048 | controller | - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317053 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.317059 | controller | - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.317065 | controller | on port 5671...' 2025-10-13 20:41:20.317070 | controller | - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.317079 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.317085 | controller | - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.317091 | controller | on port 15671...' 2025-10-13 20:41:20.317097 | controller | - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.317104 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.317111 | controller | - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.317118 | controller | on port 15691...' 2025-10-13 20:41:20.317126 | controller | - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.317138 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.317145 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.317153 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.317160 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.317179 | controller | on port 3306...' 2025-10-13 20:41:20.317185 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.317191 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.317196 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.317202 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.317208 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.317222 | controller | on port 3306...' 2025-10-13 20:41:20.317234 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.317240 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.317245 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.317251 | controller | had certificate mismatches:' 2025-10-13 20:41:20.317257 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.317262 | controller | on port 1981' 2025-10-13 20:41:20.317268 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.317274 | controller | on port 1981' 2025-10-13 20:41:20.317279 | controller | - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.317285 | controller | 2 additional commands' 2025-10-13 20:41:20.317291 | controller | - ' logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.317296 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.317302 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.317308 | controller | - ' ]' 2025-10-13 20:41:20.317313 | controller | - ' logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.317319 | controller | of non API service certificates...' 2025-10-13 20:41:20.317325 | controller | - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317330 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.317336 | controller | - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.317341 | controller | on port 15691...' 2025-10-13 20:41:20.317347 | controller | - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.317353 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.317358 | controller | - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.317364 | controller | on port 5671...' 2025-10-13 20:41:20.317379 | controller | - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.317387 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.317397 | controller | - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.317422 | controller | on port 15671...' 2025-10-13 20:41:20.317429 | controller | - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.317434 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.317440 | controller | - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317446 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.317451 | controller | - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.317457 | controller | on port 6642...' 2025-10-13 20:41:20.317463 | controller | - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.317468 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.317474 | controller | - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.317486 | controller | on port 6644...' 2025-10-13 20:41:20.317492 | controller | - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.317498 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.317503 | controller | - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.317509 | controller | on port 1981...' 2025-10-13 20:41:20.317514 | controller | - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.317520 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.317526 | controller | - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317531 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.317537 | controller | - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.317543 | controller | on port 6641...' 2025-10-13 20:41:20.317549 | controller | - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.317554 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.317560 | controller | - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.317566 | controller | on port 6643...' 2025-10-13 20:41:20.317571 | controller | - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.317577 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.317583 | controller | - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.317588 | controller | on port 1981...' 2025-10-13 20:41:20.317594 | controller | - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.317599 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.317605 | controller | - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317611 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.317616 | controller | - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.317622 | controller | on port 3000...' 2025-10-13 20:41:20.317628 | controller | - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.317634 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.317639 | controller | - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317645 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.317651 | controller | - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.317656 | controller | on port 5671...' 2025-10-13 20:41:20.317662 | controller | - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.317668 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.317673 | controller | - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.317679 | controller | on port 15671...' 2025-10-13 20:41:20.317685 | controller | - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.317690 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.317696 | controller | - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.317702 | controller | on port 15691...' 2025-10-13 20:41:20.317707 | controller | - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.317713 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.317719 | controller | - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.317724 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.317733 | controller | - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.317739 | controller | on port 3306...' 2025-10-13 20:41:20.317744 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.317750 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.317756 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.317769 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.317777 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.317785 | controller | on port 3306...' 2025-10-13 20:41:20.317793 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.317800 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.317806 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.317812 | controller | had certificate mismatches:' 2025-10-13 20:41:20.317817 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.317823 | controller | on port 1981' 2025-10-13 20:41:20.317829 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.317834 | controller | on port 1981' 2025-10-13 20:41:20.317840 | controller | - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.317846 | controller | 2 additional commands' 2025-10-13 20:41:20.317851 | controller | - ' logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.317857 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.317863 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.317868 | controller | - ' ]' 2025-10-13 20:41:20.317874 | controller | - ' logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.317880 | controller | of non API service certificates...' 2025-10-13 20:41:20.317885 | controller | - ' logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317891 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.317897 | controller | - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.317902 | controller | on port 15691...' 2025-10-13 20:41:20.317908 | controller | - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.317914 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.317923 | controller | - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.317929 | controller | on port 5671...' 2025-10-13 20:41:20.317937 | controller | - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.317943 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.317949 | controller | - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.317954 | controller | on port 15671...' 2025-10-13 20:41:20.317960 | controller | - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.317966 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.317972 | controller | - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.317977 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.317983 | controller | - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.317991 | controller | on port 6642...' 2025-10-13 20:41:20.317997 | controller | - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.318005 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.318011 | controller | - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.318019 | controller | on port 6644...' 2025-10-13 20:41:20.318025 | controller | - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.318031 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.318036 | controller | - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.318042 | controller | on port 1981...' 2025-10-13 20:41:20.318048 | controller | - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.318053 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.318059 | controller | - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.318065 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.318070 | controller | - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.318076 | controller | on port 6641...' 2025-10-13 20:41:20.318082 | controller | - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.318087 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.318093 | controller | - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.318099 | controller | on port 6643...' 2025-10-13 20:41:20.318105 | controller | - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.318110 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.318116 | controller | - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.318122 | controller | on port 1981...' 2025-10-13 20:41:20.318127 | controller | - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.318133 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.318139 | controller | - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.318144 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.318158 | controller | - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.318169 | controller | on port 3000...' 2025-10-13 20:41:20.318177 | controller | - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.318185 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.318192 | controller | - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.318197 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.318203 | controller | - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.318209 | controller | on port 5671...' 2025-10-13 20:41:20.318215 | controller | - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.318220 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.318226 | controller | - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.318232 | controller | on port 15671...' 2025-10-13 20:41:20.318237 | controller | - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.318243 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.318249 | controller | - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.318254 | controller | on port 15691...' 2025-10-13 20:41:20.318260 | controller | - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.318265 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.318274 | controller | - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.318280 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.318286 | controller | - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.318291 | controller | on port 3306...' 2025-10-13 20:41:20.318297 | controller | - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.318303 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.318308 | controller | - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.318314 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.318320 | controller | - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.318325 | controller | on port 3306...' 2025-10-13 20:41:20.318331 | controller | - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.318337 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.318342 | controller | - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.318348 | controller | had certificate mismatches:' 2025-10-13 20:41:20.318355 | controller | - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.318362 | controller | on port 1981' 2025-10-13 20:41:20.318370 | controller | - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.318377 | controller | on port 1981' 2025-10-13 20:41:20.318384 | controller | - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.318395 | controller | 2 additional commands' 2025-10-13 20:41:20.318421 | controller | - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.318432 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.318440 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.318448 | controller | - ' ]' 2025-10-13 20:41:20.318457 | controller | - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.318465 | controller | of non API service certificates...' 2025-10-13 20:41:20.318477 | controller | - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.318506 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.318515 | controller | - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.318523 | controller | on port 15691...' 2025-10-13 20:41:20.318532 | controller | - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.318545 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.318564 | controller | - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.318573 | controller | on port 5671...' 2025-10-13 20:41:20.318581 | controller | - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.318589 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.318601 | controller | - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.318620 | controller | on port 15671...' 2025-10-13 20:41:20.318636 | controller | - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.318651 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.318660 | controller | - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.318668 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.318676 | controller | - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.318691 | controller | on port 6642...' 2025-10-13 20:41:20.318724 | controller | - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.318737 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.318745 | controller | - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.318754 | controller | on port 6644...' 2025-10-13 20:41:20.318762 | controller | - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.318774 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.318782 | controller | - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.318790 | controller | on port 1981...' 2025-10-13 20:41:20.318801 | controller | - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.318812 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.318837 | controller | - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.318850 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.318886 | controller | - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.318895 | controller | on port 6641...' 2025-10-13 20:41:20.318903 | controller | - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.318915 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.318936 | controller | - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.318949 | controller | on port 6643...' 2025-10-13 20:41:20.318957 | controller | - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.318965 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.318972 | controller | - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.318979 | controller | on port 1981...' 2025-10-13 20:41:20.318984 | controller | - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.318990 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.318996 | controller | - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319002 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.319007 | controller | - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.319013 | controller | on port 3000...' 2025-10-13 20:41:20.319019 | controller | - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.319024 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.319030 | controller | - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319036 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.319041 | controller | - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.319047 | controller | on port 5671...' 2025-10-13 20:41:20.319053 | controller | - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.319058 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.319064 | controller | - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.319070 | controller | on port 15671...' 2025-10-13 20:41:20.319076 | controller | - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.319081 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.319087 | controller | - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.319093 | controller | on port 15691...' 2025-10-13 20:41:20.319102 | controller | - ' logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.319107 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.319113 | controller | - ' logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.319119 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.319124 | controller | - ' logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.319130 | controller | on port 3306...' 2025-10-13 20:41:20.319136 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.319141 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.319147 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.319153 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.319158 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.319164 | controller | on port 3306...' 2025-10-13 20:41:20.319170 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.319175 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.319181 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.319187 | controller | had certificate mismatches:' 2025-10-13 20:41:20.319192 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.319198 | controller | on port 1981' 2025-10-13 20:41:20.319204 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.319209 | controller | on port 1981' 2025-10-13 20:41:20.319224 | controller | - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.319232 | controller | 2 additional commands' 2025-10-13 20:41:20.319240 | controller | - ' logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.319247 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.319255 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.319262 | controller | - ' ]' 2025-10-13 20:41:20.319267 | controller | - ' logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.319273 | controller | of non API service certificates...' 2025-10-13 20:41:20.319279 | controller | - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319285 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.319290 | controller | - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.319296 | controller | on port 15691...' 2025-10-13 20:41:20.319302 | controller | - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.319307 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.319313 | controller | - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.319319 | controller | on port 5671...' 2025-10-13 20:41:20.319324 | controller | - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.319330 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.319335 | controller | - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.319341 | controller | on port 15671...' 2025-10-13 20:41:20.319347 | controller | - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.319353 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.319358 | controller | - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319364 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.319373 | controller | - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.319378 | controller | on port 6642...' 2025-10-13 20:41:20.319384 | controller | - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.319390 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.319398 | controller | - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.319428 | controller | on port 6644...' 2025-10-13 20:41:20.319435 | controller | - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.319442 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.319449 | controller | - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.319457 | controller | on port 1981...' 2025-10-13 20:41:20.319464 | controller | - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.319471 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.319479 | controller | - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319486 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.319493 | controller | - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.319500 | controller | on port 6641...' 2025-10-13 20:41:20.319507 | controller | - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.319514 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.319521 | controller | - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.319528 | controller | on port 6643...' 2025-10-13 20:41:20.319536 | controller | - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.319543 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.319550 | controller | - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.319558 | controller | on port 1981...' 2025-10-13 20:41:20.319565 | controller | - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.319573 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.319580 | controller | - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319588 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.319596 | controller | - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.319603 | controller | on port 3000...' 2025-10-13 20:41:20.319611 | controller | - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.319618 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.319625 | controller | - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319633 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.319638 | controller | - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.319644 | controller | on port 5671...' 2025-10-13 20:41:20.319650 | controller | - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.319674 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.319696 | controller | - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.319705 | controller | on port 15671...' 2025-10-13 20:41:20.319712 | controller | - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.319720 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.319732 | controller | - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.319739 | controller | on port 15691...' 2025-10-13 20:41:20.319746 | controller | - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.319753 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.319759 | controller | - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.319765 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.319770 | controller | - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.319776 | controller | on port 3306...' 2025-10-13 20:41:20.319782 | controller | - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.319787 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.319793 | controller | - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.319799 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.319804 | controller | - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.319810 | controller | on port 3306...' 2025-10-13 20:41:20.319816 | controller | - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.319821 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.319827 | controller | - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.319833 | controller | had certificate mismatches:' 2025-10-13 20:41:20.319838 | controller | - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.319844 | controller | on port 1981' 2025-10-13 20:41:20.319850 | controller | - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.319855 | controller | on port 1981' 2025-10-13 20:41:20.319861 | controller | - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.319867 | controller | 2 additional commands' 2025-10-13 20:41:20.319872 | controller | - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.319878 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.319884 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.319889 | controller | - ' ]' 2025-10-13 20:41:20.319895 | controller | - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.319901 | controller | of non API service certificates...' 2025-10-13 20:41:20.319910 | controller | - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.319916 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.319921 | controller | - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.319927 | controller | on port 15691...' 2025-10-13 20:41:20.319933 | controller | - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.319939 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.319945 | controller | - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.319950 | controller | on port 5671...' 2025-10-13 20:41:20.319958 | controller | - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.319964 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.319970 | controller | - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.319977 | controller | on port 15671...' 2025-10-13 20:41:20.319984 | controller | - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.319989 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.319995 | controller | - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320004 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.320009 | controller | - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.320018 | controller | on port 6642...' 2025-10-13 20:41:20.320024 | controller | - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.320029 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.320035 | controller | - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.320041 | controller | on port 6644...' 2025-10-13 20:41:20.320047 | controller | - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.320052 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.320058 | controller | - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.320064 | controller | on port 1981...' 2025-10-13 20:41:20.320069 | controller | - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.320075 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.320089 | controller | - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320097 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.320105 | controller | - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.320111 | controller | on port 6641...' 2025-10-13 20:41:20.320117 | controller | - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.320123 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.320128 | controller | - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.320134 | controller | on port 6643...' 2025-10-13 20:41:20.320140 | controller | - ' logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.320146 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.320151 | controller | - ' logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.320157 | controller | on port 1981...' 2025-10-13 20:41:20.320163 | controller | - ' logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.320168 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.320174 | controller | - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320180 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.320185 | controller | - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.320191 | controller | on port 3000...' 2025-10-13 20:41:20.320197 | controller | - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.320202 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.320208 | controller | - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320214 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.320219 | controller | - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.320225 | controller | on port 5671...' 2025-10-13 20:41:20.320231 | controller | - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.320236 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.320242 | controller | - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.320248 | controller | on port 15671...' 2025-10-13 20:41:20.320253 | controller | - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.320262 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.320268 | controller | - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.320274 | controller | on port 15691...' 2025-10-13 20:41:20.320279 | controller | - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.320285 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.320291 | controller | - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.320296 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.320302 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.320308 | controller | on port 3306...' 2025-10-13 20:41:20.320314 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.320322 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.320328 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.320333 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.320339 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.320345 | controller | on port 3306...' 2025-10-13 20:41:20.320350 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.320356 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.320362 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.320367 | controller | had certificate mismatches:' 2025-10-13 20:41:20.320373 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.320379 | controller | on port 1981' 2025-10-13 20:41:20.320384 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.320391 | controller | on port 1981' 2025-10-13 20:41:20.320416 | controller | - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.320428 | controller | 2 additional commands' 2025-10-13 20:41:20.320436 | controller | - ' logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.320442 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.320448 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.320453 | controller | - ' ]' 2025-10-13 20:41:20.320459 | controller | - ' logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.320465 | controller | of non API service certificates...' 2025-10-13 20:41:20.320471 | controller | - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320476 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.320490 | controller | - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.320499 | controller | on port 15691...' 2025-10-13 20:41:20.320507 | controller | - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.320514 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.320521 | controller | - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.320527 | controller | on port 5671...' 2025-10-13 20:41:20.320533 | controller | - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.320539 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.320544 | controller | - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.320550 | controller | on port 15671...' 2025-10-13 20:41:20.320559 | controller | - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.320569 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.320574 | controller | - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320580 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.320586 | controller | - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.320594 | controller | on port 6642...' 2025-10-13 20:41:20.320600 | controller | - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.320606 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.320611 | controller | - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.320617 | controller | on port 6644...' 2025-10-13 20:41:20.320623 | controller | - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.320629 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.320634 | controller | - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.320640 | controller | on port 1981...' 2025-10-13 20:41:20.320646 | controller | - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.320652 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.320658 | controller | - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320665 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.320672 | controller | - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.320680 | controller | on port 6641...' 2025-10-13 20:41:20.320688 | controller | - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.320696 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.320703 | controller | - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.320711 | controller | on port 6643...' 2025-10-13 20:41:20.320719 | controller | - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.320727 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.320739 | controller | - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.320747 | controller | on port 1981...' 2025-10-13 20:41:20.320760 | controller | - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.320769 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.320781 | controller | - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320803 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.320812 | controller | - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.320825 | controller | on port 3000...' 2025-10-13 20:41:20.320836 | controller | - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.320844 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.320853 | controller | - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.320861 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.320873 | controller | - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.320882 | controller | on port 5671...' 2025-10-13 20:41:20.320893 | controller | - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.320902 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.320910 | controller | - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.320927 | controller | on port 15671...' 2025-10-13 20:41:20.320936 | controller | - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.320948 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.320956 | controller | - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.320964 | controller | on port 15691...' 2025-10-13 20:41:20.320973 | controller | - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.320985 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.320993 | controller | - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.321001 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.321017 | controller | - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.321026 | controller | on port 3306...' 2025-10-13 20:41:20.321037 | controller | - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.321046 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.321054 | controller | - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.321062 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.321073 | controller | - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.321083 | controller | on port 3306...' 2025-10-13 20:41:20.321091 | controller | - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.321102 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.321114 | controller | - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.321121 | controller | had certificate mismatches:' 2025-10-13 20:41:20.321132 | controller | - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.321140 | controller | on port 1981' 2025-10-13 20:41:20.321148 | controller | - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.321159 | controller | on port 1981' 2025-10-13 20:41:20.321168 | controller | - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.321179 | controller | 2 additional commands' 2025-10-13 20:41:20.321187 | controller | - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.321198 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.321209 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.321217 | controller | - ' ]' 2025-10-13 20:41:20.321226 | controller | - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.321238 | controller | of non API service certificates...' 2025-10-13 20:41:20.321246 | controller | - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.321254 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.321263 | controller | - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.321271 | controller | on port 15691...' 2025-10-13 20:41:20.321279 | controller | - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.321286 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.321293 | controller | - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.321301 | controller | on port 5671...' 2025-10-13 20:41:20.321308 | controller | - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.321314 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.321319 | controller | - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.321329 | controller | on port 15671...' 2025-10-13 20:41:20.321335 | controller | - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.321341 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.321346 | controller | - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.321352 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.321358 | controller | - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.321363 | controller | on port 6642...' 2025-10-13 20:41:20.321369 | controller | - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.321375 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.321380 | controller | - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.321386 | controller | on port 6644...' 2025-10-13 20:41:20.321396 | controller | - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.321423 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.321431 | controller | - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.321443 | controller | on port 1981...' 2025-10-13 20:41:20.321450 | controller | - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.321457 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.321464 | controller | - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.321471 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.321478 | controller | - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.321485 | controller | on port 6641...' 2025-10-13 20:41:20.321492 | controller | - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.321499 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.321507 | controller | - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.321514 | controller | on port 6643...' 2025-10-13 20:41:20.321521 | controller | - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.321528 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.321544 | controller | - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.321552 | controller | on port 1981...' 2025-10-13 20:41:20.321560 | controller | - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.321567 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.321574 | controller | - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.321582 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.321589 | controller | - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.321596 | controller | on port 3000...' 2025-10-13 20:41:20.321603 | controller | - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.321609 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.321615 | controller | - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.321620 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.321626 | controller | - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.321632 | controller | on port 5671...' 2025-10-13 20:41:20.321637 | controller | - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.321647 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.321653 | controller | - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.321659 | controller | on port 15671...' 2025-10-13 20:41:20.321664 | controller | - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.321670 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.321675 | controller | - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.321681 | controller | on port 15691...' 2025-10-13 20:41:20.321687 | controller | - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.321692 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.321698 | controller | - ' logger.go:42: 20:32:46 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.321704 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.321709 | controller | - ' logger.go:42: 20:32:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.321715 | controller | on port 3306...' 2025-10-13 20:41:20.321721 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.321729 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.321735 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.321741 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.321746 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.321752 | controller | on port 3306...' 2025-10-13 20:41:20.321758 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.321763 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.321769 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.321775 | controller | had certificate mismatches:' 2025-10-13 20:41:20.321781 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.321786 | controller | on port 1981' 2025-10-13 20:41:20.321792 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.321799 | controller | on port 1981' 2025-10-13 20:41:20.321813 | controller | - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.321821 | controller | 2 additional commands' 2025-10-13 20:41:20.321829 | controller | - ' logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.321836 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.321844 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.321851 | controller | - ' ]' 2025-10-13 20:41:20.321859 | controller | - ' logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.321866 | controller | of non API service certificates...' 2025-10-13 20:41:20.321874 | controller | - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.321881 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.321889 | controller | - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.321906 | controller | on port 15691...' 2025-10-13 20:41:20.321914 | controller | - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.321920 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.321926 | controller | - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.321938 | controller | on port 5671...' 2025-10-13 20:41:20.321943 | controller | - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.321952 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.321958 | controller | - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.321964 | controller | on port 15671...' 2025-10-13 20:41:20.321969 | controller | - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.321985 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.321993 | controller | - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322001 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.322008 | controller | - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.322019 | controller | on port 6642...' 2025-10-13 20:41:20.322027 | controller | - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.322034 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.322041 | controller | - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.322048 | controller | on port 6644...' 2025-10-13 20:41:20.322053 | controller | - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.322059 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.322065 | controller | - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.322071 | controller | on port 1981...' 2025-10-13 20:41:20.322076 | controller | - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.322082 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.322088 | controller | - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322093 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.322099 | controller | - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.322105 | controller | on port 6641...' 2025-10-13 20:41:20.322111 | controller | - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.322116 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.322122 | controller | - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.322127 | controller | on port 6643...' 2025-10-13 20:41:20.322133 | controller | - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.322139 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.322145 | controller | - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.322153 | controller | on port 1981...' 2025-10-13 20:41:20.322159 | controller | - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.322164 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.322170 | controller | - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322176 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.322182 | controller | - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.322189 | controller | on port 3000...' 2025-10-13 20:41:20.322195 | controller | - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.322201 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.322207 | controller | - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322212 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.322218 | controller | - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.322227 | controller | on port 5671...' 2025-10-13 20:41:20.322233 | controller | - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.322238 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.322244 | controller | - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.322250 | controller | on port 15671...' 2025-10-13 20:41:20.322255 | controller | - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.322261 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.322267 | controller | - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.322272 | controller | on port 15691...' 2025-10-13 20:41:20.322278 | controller | - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.322284 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.322289 | controller | - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.322295 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.322301 | controller | - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.322306 | controller | on port 3306...' 2025-10-13 20:41:20.322312 | controller | - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.322318 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.322323 | controller | - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.322329 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.322335 | controller | - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.322340 | controller | on port 3306...' 2025-10-13 20:41:20.322346 | controller | - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.322351 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.322365 | controller | - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.322373 | controller | had certificate mismatches:' 2025-10-13 20:41:20.322381 | controller | - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.322388 | controller | on port 1981' 2025-10-13 20:41:20.322398 | controller | - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.322429 | controller | on port 1981' 2025-10-13 20:41:20.322437 | controller | - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.322444 | controller | 2 additional commands' 2025-10-13 20:41:20.322450 | controller | - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.322455 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.322461 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.322467 | controller | - ' ]' 2025-10-13 20:41:20.322472 | controller | - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.322478 | controller | of non API service certificates...' 2025-10-13 20:41:20.322484 | controller | - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322490 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.322495 | controller | - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.322501 | controller | on port 15691...' 2025-10-13 20:41:20.322506 | controller | - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.322512 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.322518 | controller | - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.322527 | controller | on port 5671...' 2025-10-13 20:41:20.322533 | controller | - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.322538 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.322544 | controller | - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.322550 | controller | on port 15671...' 2025-10-13 20:41:20.322555 | controller | - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.322561 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.322567 | controller | - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322572 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.322578 | controller | - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.322587 | controller | on port 6642...' 2025-10-13 20:41:20.322593 | controller | - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.322601 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.322608 | controller | - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.322615 | controller | on port 6644...' 2025-10-13 20:41:20.322623 | controller | - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.322631 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.322638 | controller | - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.322645 | controller | on port 1981...' 2025-10-13 20:41:20.322653 | controller | - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.322659 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.322665 | controller | - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322670 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.322676 | controller | - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.322682 | controller | on port 6641...' 2025-10-13 20:41:20.322688 | controller | - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.322693 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.322699 | controller | - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.322705 | controller | on port 6643...' 2025-10-13 20:41:20.322710 | controller | - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.322716 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.322722 | controller | - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.322727 | controller | on port 1981...' 2025-10-13 20:41:20.322733 | controller | - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.322753 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.322759 | controller | - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322765 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.322770 | controller | - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.322776 | controller | on port 3000...' 2025-10-13 20:41:20.322782 | controller | - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.322788 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.322802 | controller | - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.322814 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.322822 | controller | - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.322830 | controller | on port 5671...' 2025-10-13 20:41:20.322837 | controller | - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.322844 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.322879 | controller | - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.322887 | controller | on port 15671...' 2025-10-13 20:41:20.322894 | controller | - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.322906 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.322914 | controller | - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.322921 | controller | on port 15691...' 2025-10-13 20:41:20.322929 | controller | - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.322936 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.322943 | controller | - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.322951 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.322961 | controller | - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.322970 | controller | on port 3306...' 2025-10-13 20:41:20.322980 | controller | - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.323010 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.323020 | controller | - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.323028 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.323036 | controller | - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.323044 | controller | on port 3306...' 2025-10-13 20:41:20.323057 | controller | - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.323065 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.323073 | controller | - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.323084 | controller | had certificate mismatches:' 2025-10-13 20:41:20.323093 | controller | - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.323104 | controller | on port 1981' 2025-10-13 20:41:20.323112 | controller | - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.323123 | controller | on port 1981' 2025-10-13 20:41:20.323131 | controller | - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.323142 | controller | 2 additional commands' 2025-10-13 20:41:20.323150 | controller | - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.323158 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.323166 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.323174 | controller | - ' ]' 2025-10-13 20:41:20.323183 | controller | - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.323190 | controller | of non API service certificates...' 2025-10-13 20:41:20.323202 | controller | - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.323210 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.323218 | controller | - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.323229 | controller | on port 15691...' 2025-10-13 20:41:20.323237 | controller | - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.323253 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.323262 | controller | - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.323270 | controller | on port 5671...' 2025-10-13 20:41:20.323278 | controller | - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.323289 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.323297 | controller | - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.323305 | controller | on port 15671...' 2025-10-13 20:41:20.323313 | controller | - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.323321 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.323330 | controller | - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.323338 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.323350 | controller | - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.323366 | controller | on port 6642...' 2025-10-13 20:41:20.323374 | controller | - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.323383 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.323394 | controller | - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.323428 | controller | on port 6644...' 2025-10-13 20:41:20.323438 | controller | - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.323456 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.323465 | controller | - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.323473 | controller | on port 1981...' 2025-10-13 20:41:20.323481 | controller | - ' logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.323489 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.323496 | controller | - ' logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.323503 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.323511 | controller | - ' logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.323518 | controller | on port 6641...' 2025-10-13 20:41:20.323525 | controller | - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.323533 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.323540 | controller | - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.323546 | controller | on port 6643...' 2025-10-13 20:41:20.323551 | controller | - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.323557 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.323563 | controller | - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.323568 | controller | on port 1981...' 2025-10-13 20:41:20.323574 | controller | - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.323580 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.323585 | controller | - ' logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.323591 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.323597 | controller | - ' logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.323602 | controller | on port 3000...' 2025-10-13 20:41:20.323608 | controller | - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.323614 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.323623 | controller | - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.323629 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.323635 | controller | - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.323640 | controller | on port 5671...' 2025-10-13 20:41:20.323646 | controller | - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.323651 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.323657 | controller | - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.323663 | controller | on port 15671...' 2025-10-13 20:41:20.323668 | controller | - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.323674 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.323680 | controller | - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.323685 | controller | on port 15691...' 2025-10-13 20:41:20.323691 | controller | - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.323697 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.323702 | controller | - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.323708 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.323714 | controller | - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.323719 | controller | on port 3306...' 2025-10-13 20:41:20.323725 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.323731 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.323736 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.323742 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.323748 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.323754 | controller | on port 3306...' 2025-10-13 20:41:20.323759 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.323765 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.323771 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.323777 | controller | had certificate mismatches:' 2025-10-13 20:41:20.323782 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.323788 | controller | on port 1981' 2025-10-13 20:41:20.323794 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.323800 | controller | on port 1981' 2025-10-13 20:41:20.323805 | controller | - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.323811 | controller | 2 additional commands' 2025-10-13 20:41:20.323817 | controller | - ' logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.323823 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.323836 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.323844 | controller | - ' ]' 2025-10-13 20:41:20.323852 | controller | - ' logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.323860 | controller | of non API service certificates...' 2025-10-13 20:41:20.323868 | controller | - ' logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.323874 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.323883 | controller | - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.323895 | controller | on port 15691...' 2025-10-13 20:41:20.323901 | controller | - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.323907 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.323912 | controller | - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.323918 | controller | on port 5671...' 2025-10-13 20:41:20.323924 | controller | - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.323929 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.323935 | controller | - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.323941 | controller | on port 15671...' 2025-10-13 20:41:20.323946 | controller | - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.323952 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.323958 | controller | - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.323963 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.323969 | controller | - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.323978 | controller | on port 6642...' 2025-10-13 20:41:20.323984 | controller | - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.323989 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.323995 | controller | - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.324002 | controller | on port 6644...' 2025-10-13 20:41:20.324009 | controller | - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.324016 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.324024 | controller | - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.324032 | controller | on port 1981...' 2025-10-13 20:41:20.324039 | controller | - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.324047 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.324054 | controller | - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324061 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.324067 | controller | - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.324072 | controller | on port 6641...' 2025-10-13 20:41:20.324078 | controller | - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.324084 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.324091 | controller | - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.324099 | controller | on port 6643...' 2025-10-13 20:41:20.324106 | controller | - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.324113 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.324121 | controller | - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.324129 | controller | on port 1981...' 2025-10-13 20:41:20.324136 | controller | - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.324144 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.324161 | controller | - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324174 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.324180 | controller | - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.324186 | controller | on port 3000...' 2025-10-13 20:41:20.324195 | controller | - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.324200 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.324206 | controller | - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324212 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.324217 | controller | - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.324223 | controller | on port 5671...' 2025-10-13 20:41:20.324229 | controller | - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.324234 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.324240 | controller | - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.324246 | controller | on port 15671...' 2025-10-13 20:41:20.324251 | controller | - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.324257 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.324272 | controller | - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.324280 | controller | on port 15691...' 2025-10-13 20:41:20.324288 | controller | - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.324296 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.324303 | controller | - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.324311 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.324318 | controller | - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.324325 | controller | on port 3306...' 2025-10-13 20:41:20.324332 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.324340 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.324347 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.324353 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.324359 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.324364 | controller | on port 3306...' 2025-10-13 20:41:20.324370 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.324376 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.324381 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.324387 | controller | had certificate mismatches:' 2025-10-13 20:41:20.324396 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.324419 | controller | on port 1981' 2025-10-13 20:41:20.324431 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.324438 | controller | on port 1981' 2025-10-13 20:41:20.324445 | controller | - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.324452 | controller | 2 additional commands' 2025-10-13 20:41:20.324460 | controller | - ' logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.324467 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.324474 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.324482 | controller | - ' ]' 2025-10-13 20:41:20.324489 | controller | - ' logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.324496 | controller | of non API service certificates...' 2025-10-13 20:41:20.324504 | controller | - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324516 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.324523 | controller | - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.324531 | controller | on port 15691...' 2025-10-13 20:41:20.324546 | controller | - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.324554 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.324561 | controller | - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.324569 | controller | on port 5671...' 2025-10-13 20:41:20.324576 | controller | - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.324583 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.324590 | controller | - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.324597 | controller | on port 15671...' 2025-10-13 20:41:20.324605 | controller | - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.324613 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.324620 | controller | - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324627 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.324635 | controller | - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.324654 | controller | on port 6642...' 2025-10-13 20:41:20.324661 | controller | - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.324668 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.324676 | controller | - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.324683 | controller | on port 6644...' 2025-10-13 20:41:20.324690 | controller | - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.324698 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.324705 | controller | - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.324712 | controller | on port 1981...' 2025-10-13 20:41:20.324718 | controller | - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.324724 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.324729 | controller | - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324735 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.324741 | controller | - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.324749 | controller | on port 6641...' 2025-10-13 20:41:20.324765 | controller | - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.324773 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.324781 | controller | - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.324788 | controller | on port 6643...' 2025-10-13 20:41:20.324796 | controller | - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.324803 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.324811 | controller | - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.324818 | controller | on port 1981...' 2025-10-13 20:41:20.324825 | controller | - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.324833 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.324840 | controller | - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324848 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.324896 | controller | - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.324904 | controller | on port 3000...' 2025-10-13 20:41:20.324912 | controller | - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.324919 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.324926 | controller | - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.324934 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.324941 | controller | - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.324949 | controller | on port 5671...' 2025-10-13 20:41:20.324957 | controller | - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.324964 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.324979 | controller | - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.324987 | controller | on port 15671...' 2025-10-13 20:41:20.324994 | controller | - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.325001 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.325009 | controller | - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.325016 | controller | on port 15691...' 2025-10-13 20:41:20.325023 | controller | - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.325030 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.325038 | controller | - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.325045 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.325052 | controller | - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.325059 | controller | on port 3306...' 2025-10-13 20:41:20.325067 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.325074 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.325081 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.325089 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.325096 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.325103 | controller | on port 3306...' 2025-10-13 20:41:20.325111 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.325118 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.325125 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.325131 | controller | had certificate mismatches:' 2025-10-13 20:41:20.325136 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.325142 | controller | on port 1981' 2025-10-13 20:41:20.325148 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.325154 | controller | on port 1981' 2025-10-13 20:41:20.325159 | controller | - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.325166 | controller | 2 additional commands' 2025-10-13 20:41:20.325173 | controller | - ' logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.325181 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.325188 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.325196 | controller | - ' ]' 2025-10-13 20:41:20.325203 | controller | - ' logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.325211 | controller | of non API service certificates...' 2025-10-13 20:41:20.325222 | controller | - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325227 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.325241 | controller | - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.325247 | controller | on port 15691...' 2025-10-13 20:41:20.325252 | controller | - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.325258 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.325276 | controller | - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.325285 | controller | on port 5671...' 2025-10-13 20:41:20.325293 | controller | - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.325300 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.325308 | controller | - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.325315 | controller | on port 15671...' 2025-10-13 20:41:20.325322 | controller | - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.325328 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.325334 | controller | - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325339 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.325345 | controller | - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.325354 | controller | on port 6642...' 2025-10-13 20:41:20.325360 | controller | - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.325366 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.325371 | controller | - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.325377 | controller | on port 6644...' 2025-10-13 20:41:20.325383 | controller | - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.325388 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.325397 | controller | - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.325419 | controller | on port 1981...' 2025-10-13 20:41:20.325425 | controller | - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.325431 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.325436 | controller | - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325442 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.325448 | controller | - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.325453 | controller | on port 6641...' 2025-10-13 20:41:20.325459 | controller | - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.325465 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.325471 | controller | - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.325476 | controller | on port 6643...' 2025-10-13 20:41:20.325482 | controller | - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.325488 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.325493 | controller | - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.325499 | controller | on port 1981...' 2025-10-13 20:41:20.325505 | controller | - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.325510 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.325516 | controller | - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325525 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.325531 | controller | - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.325539 | controller | on port 3000...' 2025-10-13 20:41:20.325545 | controller | - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.325551 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.325557 | controller | - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325562 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.325568 | controller | - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.325574 | controller | on port 5671...' 2025-10-13 20:41:20.325579 | controller | - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.325585 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.325591 | controller | - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.325596 | controller | on port 15671...' 2025-10-13 20:41:20.325602 | controller | - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.325608 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.325613 | controller | - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.325619 | controller | on port 15691...' 2025-10-13 20:41:20.325625 | controller | - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.325630 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.325636 | controller | - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.325642 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.325650 | controller | - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.325655 | controller | on port 3306...' 2025-10-13 20:41:20.325661 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.325667 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.325681 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.325689 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.325697 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.325705 | controller | on port 3306...' 2025-10-13 20:41:20.325712 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.325719 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.325725 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.325731 | controller | had certificate mismatches:' 2025-10-13 20:41:20.325737 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.325742 | controller | on port 1981' 2025-10-13 20:41:20.325748 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.325754 | controller | on port 1981' 2025-10-13 20:41:20.325759 | controller | - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.325765 | controller | 2 additional commands' 2025-10-13 20:41:20.325771 | controller | - ' logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.325776 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.325782 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.325791 | controller | - ' ]' 2025-10-13 20:41:20.325797 | controller | - ' logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.325803 | controller | of non API service certificates...' 2025-10-13 20:41:20.325809 | controller | - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325814 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.325820 | controller | - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.325826 | controller | on port 15691...' 2025-10-13 20:41:20.325831 | controller | - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.325837 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.325843 | controller | - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.325848 | controller | on port 5671...' 2025-10-13 20:41:20.325854 | controller | - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.325860 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.325865 | controller | - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.325871 | controller | on port 15671...' 2025-10-13 20:41:20.325877 | controller | - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.325882 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.325888 | controller | - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325894 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.325899 | controller | - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.325908 | controller | on port 6642...' 2025-10-13 20:41:20.325914 | controller | - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.325919 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.325925 | controller | - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.325931 | controller | on port 6644...' 2025-10-13 20:41:20.325937 | controller | - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.325942 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.325948 | controller | - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.325954 | controller | on port 1981...' 2025-10-13 20:41:20.325962 | controller | - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.325968 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.325974 | controller | - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.325981 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.325987 | controller | - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.325993 | controller | on port 6641...' 2025-10-13 20:41:20.325998 | controller | - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.326004 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.326010 | controller | - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.326015 | controller | on port 6643...' 2025-10-13 20:41:20.326021 | controller | - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.326027 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.326033 | controller | - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.326038 | controller | on port 1981...' 2025-10-13 20:41:20.326044 | controller | - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.326055 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.326068 | controller | - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326076 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.326084 | controller | - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.326095 | controller | on port 3000...' 2025-10-13 20:41:20.326102 | controller | - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.326108 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.326114 | controller | - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326120 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.326125 | controller | - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.326131 | controller | on port 5671...' 2025-10-13 20:41:20.326137 | controller | - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.326143 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.326148 | controller | - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.326154 | controller | on port 15671...' 2025-10-13 20:41:20.326160 | controller | - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.326166 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.326173 | controller | - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.326181 | controller | on port 15691...' 2025-10-13 20:41:20.326189 | controller | - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.326208 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.326216 | controller | - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.326222 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.326227 | controller | - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.326233 | controller | on port 3306...' 2025-10-13 20:41:20.326239 | controller | - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.326245 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.326251 | controller | - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.326259 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.326265 | controller | - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.326271 | controller | on port 3306...' 2025-10-13 20:41:20.326276 | controller | - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.326282 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.326288 | controller | - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.326294 | controller | had certificate mismatches:' 2025-10-13 20:41:20.326299 | controller | - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.326305 | controller | on port 1981' 2025-10-13 20:41:20.326311 | controller | - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.326317 | controller | on port 1981' 2025-10-13 20:41:20.326323 | controller | - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.326328 | controller | 2 additional commands' 2025-10-13 20:41:20.326334 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.326340 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.326349 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.326354 | controller | - ' ]' 2025-10-13 20:41:20.326360 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.326366 | controller | of non API service certificates...' 2025-10-13 20:41:20.326372 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326377 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.326383 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.326389 | controller | on port 15691...' 2025-10-13 20:41:20.326398 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.326420 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.326426 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.326432 | controller | on port 5671...' 2025-10-13 20:41:20.326437 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.326443 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.326449 | controller | - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.326455 | controller | on port 15671...' 2025-10-13 20:41:20.326460 | controller | - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.326466 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.326472 | controller | - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326478 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.326483 | controller | - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.326501 | controller | on port 6642...' 2025-10-13 20:41:20.326509 | controller | - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.326517 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.326525 | controller | - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.326533 | controller | on port 6644...' 2025-10-13 20:41:20.326540 | controller | - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.326546 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.326552 | controller | - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.326558 | controller | on port 1981...' 2025-10-13 20:41:20.326563 | controller | - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.326569 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.326575 | controller | - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326581 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.326587 | controller | - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.326592 | controller | on port 6641...' 2025-10-13 20:41:20.326598 | controller | - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.326604 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.326610 | controller | - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.326616 | controller | on port 6643...' 2025-10-13 20:41:20.326621 | controller | - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.326627 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.326633 | controller | - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.326642 | controller | on port 1981...' 2025-10-13 20:41:20.326648 | controller | - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.326654 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.326659 | controller | - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326665 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.326671 | controller | - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.326677 | controller | on port 3000...' 2025-10-13 20:41:20.326683 | controller | - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.326688 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.326694 | controller | - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326700 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.326706 | controller | - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.326712 | controller | on port 5671...' 2025-10-13 20:41:20.326718 | controller | - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.326723 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.326729 | controller | - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.326735 | controller | on port 15671...' 2025-10-13 20:41:20.326741 | controller | - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.326746 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.326752 | controller | - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.326758 | controller | on port 15691...' 2025-10-13 20:41:20.326764 | controller | - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.326769 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.326775 | controller | - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.326781 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.326787 | controller | - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.326793 | controller | on port 3306...' 2025-10-13 20:41:20.326798 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.326804 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.326810 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.326816 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.326821 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.326827 | controller | on port 3306...' 2025-10-13 20:41:20.326833 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.326839 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.326845 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.326850 | controller | had certificate mismatches:' 2025-10-13 20:41:20.326856 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.326862 | controller | on port 1981' 2025-10-13 20:41:20.326875 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.326896 | controller | on port 1981' 2025-10-13 20:41:20.326904 | controller | - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.326912 | controller | 2 additional commands' 2025-10-13 20:41:20.326923 | controller | - ' logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.326929 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.326935 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.326940 | controller | - ' ]' 2025-10-13 20:41:20.326946 | controller | - ' logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.326952 | controller | of non API service certificates...' 2025-10-13 20:41:20.326957 | controller | - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.326963 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.326969 | controller | - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.326974 | controller | on port 15691...' 2025-10-13 20:41:20.326980 | controller | - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.326986 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.326991 | controller | - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.326997 | controller | on port 5671...' 2025-10-13 20:41:20.327006 | controller | - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.327012 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.327017 | controller | - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.327023 | controller | on port 15671...' 2025-10-13 20:41:20.327029 | controller | - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.327034 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.327040 | controller | - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327046 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.327051 | controller | - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.327059 | controller | on port 6642...' 2025-10-13 20:41:20.327065 | controller | - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.327071 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.327077 | controller | - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.327084 | controller | on port 6644...' 2025-10-13 20:41:20.327090 | controller | - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.327096 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.327102 | controller | - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.327107 | controller | on port 1981...' 2025-10-13 20:41:20.327113 | controller | - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.327119 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.327124 | controller | - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327130 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.327136 | controller | - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.327142 | controller | on port 6641...' 2025-10-13 20:41:20.327147 | controller | - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.327153 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.327159 | controller | - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.327164 | controller | on port 6643...' 2025-10-13 20:41:20.327170 | controller | - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.327178 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.327184 | controller | - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.327190 | controller | on port 1981...' 2025-10-13 20:41:20.327195 | controller | - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.327201 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.327207 | controller | - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327212 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.327218 | controller | - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.327224 | controller | on port 3000...' 2025-10-13 20:41:20.327229 | controller | - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.327235 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.327241 | controller | - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327246 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.327252 | controller | - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.327258 | controller | on port 5671...' 2025-10-13 20:41:20.327271 | controller | - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.327279 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.327287 | controller | - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.327294 | controller | on port 15671...' 2025-10-13 20:41:20.327302 | controller | - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.327308 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.327314 | controller | - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.327320 | controller | on port 15691...' 2025-10-13 20:41:20.327325 | controller | - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.327331 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.327337 | controller | - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.327343 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.327349 | controller | - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.327354 | controller | on port 3306...' 2025-10-13 20:41:20.327360 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.327366 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.327372 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.327378 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.327383 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.327389 | controller | on port 3306...' 2025-10-13 20:41:20.327397 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.327419 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.327425 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.327431 | controller | had certificate mismatches:' 2025-10-13 20:41:20.327437 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.327443 | controller | on port 1981' 2025-10-13 20:41:20.327448 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.327454 | controller | on port 1981' 2025-10-13 20:41:20.327460 | controller | - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.327468 | controller | 2 additional commands' 2025-10-13 20:41:20.327474 | controller | - ' logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.327479 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.327485 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.327491 | controller | - ' ]' 2025-10-13 20:41:20.327496 | controller | - ' logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.327502 | controller | of non API service certificates...' 2025-10-13 20:41:20.327508 | controller | - ' logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327513 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.327519 | controller | - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.327525 | controller | on port 15691...' 2025-10-13 20:41:20.327530 | controller | - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.327536 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.327542 | controller | - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.327548 | controller | on port 5671...' 2025-10-13 20:41:20.327553 | controller | - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.327559 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.327565 | controller | - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.327570 | controller | on port 15671...' 2025-10-13 20:41:20.327576 | controller | - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.327581 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.327587 | controller | - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327593 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.327598 | controller | - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.327607 | controller | on port 6642...' 2025-10-13 20:41:20.327613 | controller | - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.327619 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.327625 | controller | - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.327630 | controller | on port 6644...' 2025-10-13 20:41:20.327636 | controller | - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.327642 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.327647 | controller | - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.327653 | controller | on port 1981...' 2025-10-13 20:41:20.327659 | controller | - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.327672 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.327680 | controller | - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327688 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.327695 | controller | - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.327706 | controller | on port 6641...' 2025-10-13 20:41:20.327713 | controller | - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.327719 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.327725 | controller | - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.327740 | controller | on port 6643...' 2025-10-13 20:41:20.327746 | controller | - ' logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.327752 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.327757 | controller | - ' logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.327763 | controller | on port 1981...' 2025-10-13 20:41:20.327769 | controller | - ' logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.327774 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.327780 | controller | - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327786 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.327791 | controller | - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.327797 | controller | on port 3000...' 2025-10-13 20:41:20.327803 | controller | - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.327808 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.327814 | controller | - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.327820 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.327825 | controller | - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.327831 | controller | on port 5671...' 2025-10-13 20:41:20.327837 | controller | - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.327842 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.327848 | controller | - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.327854 | controller | on port 15671...' 2025-10-13 20:41:20.327859 | controller | - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.327865 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.327871 | controller | - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.327876 | controller | on port 15691...' 2025-10-13 20:41:20.327882 | controller | - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.327888 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.327893 | controller | - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.327899 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.327905 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.327910 | controller | on port 3306...' 2025-10-13 20:41:20.327916 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.327922 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.327927 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.327933 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.327939 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.327944 | controller | on port 3306...' 2025-10-13 20:41:20.327950 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.327956 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.327961 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.327967 | controller | had certificate mismatches:' 2025-10-13 20:41:20.327973 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.327978 | controller | on port 1981' 2025-10-13 20:41:20.327987 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.327993 | controller | on port 1981' 2025-10-13 20:41:20.327998 | controller | - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.328004 | controller | 2 additional commands' 2025-10-13 20:41:20.328010 | controller | - ' logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.328015 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.328021 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.328027 | controller | - ' ]' 2025-10-13 20:41:20.328032 | controller | - ' logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.328038 | controller | of non API service certificates...' 2025-10-13 20:41:20.328044 | controller | - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328056 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.328064 | controller | - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.328072 | controller | on port 15691...' 2025-10-13 20:41:20.328080 | controller | - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.328087 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.328094 | controller | - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.328099 | controller | on port 5671...' 2025-10-13 20:41:20.328105 | controller | - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.328111 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.328116 | controller | - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.328122 | controller | on port 15671...' 2025-10-13 20:41:20.328128 | controller | - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.328133 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.328139 | controller | - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328144 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.328150 | controller | - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.328156 | controller | on port 6642...' 2025-10-13 20:41:20.328162 | controller | - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.328167 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.328173 | controller | - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.328179 | controller | on port 6644...' 2025-10-13 20:41:20.328184 | controller | - ' logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.328190 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.328195 | controller | - ' logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.328201 | controller | on port 1981...' 2025-10-13 20:41:20.328207 | controller | - ' logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.328212 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.328218 | controller | - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328224 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.328229 | controller | - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.328235 | controller | on port 6641...' 2025-10-13 20:41:20.328241 | controller | - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.328250 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.328255 | controller | - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.328261 | controller | on port 6643...' 2025-10-13 20:41:20.328267 | controller | - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.328272 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.328278 | controller | - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.328284 | controller | on port 1981...' 2025-10-13 20:41:20.328289 | controller | - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.328295 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.328301 | controller | - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328306 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.328312 | controller | - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.328318 | controller | on port 3000...' 2025-10-13 20:41:20.328323 | controller | - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.328329 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.328335 | controller | - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328340 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.328346 | controller | - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.328352 | controller | on port 5671...' 2025-10-13 20:41:20.328357 | controller | - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.328366 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.328372 | controller | - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.328377 | controller | on port 15671...' 2025-10-13 20:41:20.328383 | controller | - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.328389 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.328398 | controller | - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.328418 | controller | on port 15691...' 2025-10-13 20:41:20.328424 | controller | - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.328430 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.328442 | controller | - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.328450 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.328458 | controller | - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.328466 | controller | on port 3306...' 2025-10-13 20:41:20.328473 | controller | - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.328480 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.328486 | controller | - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.328491 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.328497 | controller | - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.328503 | controller | on port 3306...' 2025-10-13 20:41:20.328508 | controller | - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.328514 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.328520 | controller | - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.328525 | controller | had certificate mismatches:' 2025-10-13 20:41:20.328535 | controller | - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.328541 | controller | on port 1981' 2025-10-13 20:41:20.328546 | controller | - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.328552 | controller | on port 1981' 2025-10-13 20:41:20.328558 | controller | - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.328563 | controller | 2 additional commands' 2025-10-13 20:41:20.328569 | controller | - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.328575 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.328581 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.328586 | controller | - ' ]' 2025-10-13 20:41:20.328592 | controller | - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.328598 | controller | of non API service certificates...' 2025-10-13 20:41:20.328603 | controller | - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328609 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.328615 | controller | - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.328620 | controller | on port 15691...' 2025-10-13 20:41:20.328626 | controller | - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.328632 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.328637 | controller | - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.328643 | controller | on port 5671...' 2025-10-13 20:41:20.328649 | controller | - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.328654 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.328660 | controller | - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.328666 | controller | on port 15671...' 2025-10-13 20:41:20.328671 | controller | - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.328677 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.328683 | controller | - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328688 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.328694 | controller | - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.328703 | controller | on port 6642...' 2025-10-13 20:41:20.328709 | controller | - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.328715 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.328721 | controller | - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.328726 | controller | on port 6644...' 2025-10-13 20:41:20.328732 | controller | - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.328738 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.328743 | controller | - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.328749 | controller | on port 1981...' 2025-10-13 20:41:20.328755 | controller | - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.328760 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.328766 | controller | - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328772 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.328778 | controller | - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.328783 | controller | on port 6641...' 2025-10-13 20:41:20.328792 | controller | - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.328797 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.328803 | controller | - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.328809 | controller | on port 6643...' 2025-10-13 20:41:20.328822 | controller | - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.328833 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.328841 | controller | - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.328849 | controller | on port 1981...' 2025-10-13 20:41:20.328856 | controller | - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.328862 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.328868 | controller | - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328874 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.328879 | controller | - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.328885 | controller | on port 3000...' 2025-10-13 20:41:20.328891 | controller | - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.328896 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.328902 | controller | - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.328908 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.328913 | controller | - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.328919 | controller | on port 5671...' 2025-10-13 20:41:20.328938 | controller | - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.328944 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.328950 | controller | - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.328956 | controller | on port 15671...' 2025-10-13 20:41:20.328961 | controller | - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.328967 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.328973 | controller | - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.328979 | controller | on port 15691...' 2025-10-13 20:41:20.328985 | controller | - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.328990 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.328996 | controller | - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.329002 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.329010 | controller | - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.329016 | controller | on port 3306...' 2025-10-13 20:41:20.329021 | controller | - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.329027 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.329033 | controller | - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.329039 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.329044 | controller | - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.329050 | controller | on port 3306...' 2025-10-13 20:41:20.329056 | controller | - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.329061 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.329067 | controller | - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.329076 | controller | had certificate mismatches:' 2025-10-13 20:41:20.329082 | controller | - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.329087 | controller | on port 1981' 2025-10-13 20:41:20.329093 | controller | - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.329099 | controller | on port 1981' 2025-10-13 20:41:20.329104 | controller | - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.329110 | controller | 2 additional commands' 2025-10-13 20:41:20.329116 | controller | - ' logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.329121 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.329127 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.329133 | controller | - ' ]' 2025-10-13 20:41:20.329138 | controller | - ' logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.329144 | controller | of non API service certificates...' 2025-10-13 20:41:20.329150 | controller | - ' logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329155 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.329161 | controller | - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.329167 | controller | on port 15691...' 2025-10-13 20:41:20.329172 | controller | - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.329178 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.329184 | controller | - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.329189 | controller | on port 5671...' 2025-10-13 20:41:20.329197 | controller | - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.329203 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.329208 | controller | - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.329214 | controller | on port 15671...' 2025-10-13 20:41:20.329227 | controller | - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.329235 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.329243 | controller | - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329251 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.329258 | controller | - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.329267 | controller | on port 6642...' 2025-10-13 20:41:20.329273 | controller | - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.329279 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.329284 | controller | - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.329290 | controller | on port 6644...' 2025-10-13 20:41:20.329296 | controller | - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.329301 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.329307 | controller | - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.329313 | controller | on port 1981...' 2025-10-13 20:41:20.329318 | controller | - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.329324 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.329330 | controller | - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329336 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.329347 | controller | - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.329353 | controller | on port 6641...' 2025-10-13 20:41:20.329358 | controller | - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.329364 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.329370 | controller | - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.329375 | controller | on port 6643...' 2025-10-13 20:41:20.329381 | controller | - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.329387 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.329396 | controller | - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.329414 | controller | on port 1981...' 2025-10-13 20:41:20.329423 | controller | - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.329428 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.329434 | controller | - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329440 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.329446 | controller | - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.329454 | controller | on port 3000...' 2025-10-13 20:41:20.329460 | controller | - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.329466 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.329471 | controller | - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329477 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.329483 | controller | - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.329488 | controller | on port 5671...' 2025-10-13 20:41:20.329494 | controller | - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.329500 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.329505 | controller | - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.329511 | controller | on port 15671...' 2025-10-13 20:41:20.329517 | controller | - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.329522 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.329528 | controller | - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.329534 | controller | on port 15691...' 2025-10-13 20:41:20.329539 | controller | - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.329545 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.329551 | controller | - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.329556 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.329562 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.329568 | controller | on port 3306...' 2025-10-13 20:41:20.329573 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.329579 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.329585 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.329591 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.329596 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.329602 | controller | on port 3306...' 2025-10-13 20:41:20.329615 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.329627 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.329657 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.329663 | controller | had certificate mismatches:' 2025-10-13 20:41:20.329669 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.329674 | controller | on port 1981' 2025-10-13 20:41:20.329680 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.329686 | controller | on port 1981' 2025-10-13 20:41:20.329692 | controller | - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.329697 | controller | 2 additional commands' 2025-10-13 20:41:20.329703 | controller | - ' logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.329709 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.329714 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.329720 | controller | - ' ]' 2025-10-13 20:41:20.329726 | controller | - ' logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.329731 | controller | of non API service certificates...' 2025-10-13 20:41:20.329737 | controller | - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329743 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.329749 | controller | - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.329754 | controller | on port 15691...' 2025-10-13 20:41:20.329760 | controller | - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.329766 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.329771 | controller | - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.329777 | controller | on port 5671...' 2025-10-13 20:41:20.329783 | controller | - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.329788 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.329794 | controller | - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.329800 | controller | on port 15671...' 2025-10-13 20:41:20.329805 | controller | - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.329811 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.329817 | controller | - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329822 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.329828 | controller | - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.329834 | controller | on port 6642...' 2025-10-13 20:41:20.329840 | controller | - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.329845 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.329851 | controller | - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.329857 | controller | on port 6644...' 2025-10-13 20:41:20.329862 | controller | - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.329868 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.329874 | controller | - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.329883 | controller | on port 1981...' 2025-10-13 20:41:20.329889 | controller | - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.329894 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.329900 | controller | - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329908 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.329914 | controller | - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.329920 | controller | on port 6641...' 2025-10-13 20:41:20.329926 | controller | - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.329931 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.329937 | controller | - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.329943 | controller | on port 6643...' 2025-10-13 20:41:20.329949 | controller | - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.329954 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.329960 | controller | - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.329966 | controller | on port 1981...' 2025-10-13 20:41:20.329971 | controller | - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.329977 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.329983 | controller | - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.329988 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.329994 | controller | - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.330000 | controller | on port 3000...' 2025-10-13 20:41:20.330013 | controller | - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.330021 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.330029 | controller | - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330036 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.330044 | controller | - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.330049 | controller | on port 5671...' 2025-10-13 20:41:20.330055 | controller | - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.330061 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.330067 | controller | - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.330072 | controller | on port 15671...' 2025-10-13 20:41:20.330078 | controller | - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.330084 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.330089 | controller | - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.330095 | controller | on port 15691...' 2025-10-13 20:41:20.330101 | controller | - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.330107 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.330112 | controller | - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.330118 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.330124 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.330129 | controller | on port 3306...' 2025-10-13 20:41:20.330135 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.330141 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.330146 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.330152 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.330158 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.330167 | controller | on port 3306...' 2025-10-13 20:41:20.330173 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.330178 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.330184 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.330190 | controller | had certificate mismatches:' 2025-10-13 20:41:20.330195 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.330201 | controller | on port 1981' 2025-10-13 20:41:20.330207 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.330212 | controller | on port 1981' 2025-10-13 20:41:20.330218 | controller | - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.330224 | controller | 2 additional commands' 2025-10-13 20:41:20.330229 | controller | - ' logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.330235 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.330241 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.330246 | controller | - ' ]' 2025-10-13 20:41:20.330252 | controller | - ' logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.330258 | controller | of non API service certificates...' 2025-10-13 20:41:20.330263 | controller | - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330269 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.330275 | controller | - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.330281 | controller | on port 15691...' 2025-10-13 20:41:20.330286 | controller | - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.330292 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.330297 | controller | - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.330303 | controller | on port 5671...' 2025-10-13 20:41:20.330309 | controller | - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.330314 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.330320 | controller | - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.330326 | controller | on port 15671...' 2025-10-13 20:41:20.330332 | controller | - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.330337 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.330343 | controller | - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330348 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.330354 | controller | - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.330363 | controller | on port 6642...' 2025-10-13 20:41:20.330369 | controller | - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.330374 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.330380 | controller | - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.330386 | controller | on port 6644...' 2025-10-13 20:41:20.330415 | controller | - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.330429 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.330436 | controller | - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.330441 | controller | on port 1981...' 2025-10-13 20:41:20.330447 | controller | - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.330456 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.330462 | controller | - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330468 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.330473 | controller | - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.330479 | controller | on port 6641...' 2025-10-13 20:41:20.330485 | controller | - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.330490 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.330496 | controller | - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.330502 | controller | on port 6643...' 2025-10-13 20:41:20.330508 | controller | - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.330513 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.330519 | controller | - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.330528 | controller | on port 1981...' 2025-10-13 20:41:20.330534 | controller | - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.330539 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.330545 | controller | - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330551 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.330556 | controller | - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.330562 | controller | on port 3000...' 2025-10-13 20:41:20.330568 | controller | - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.330574 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.330579 | controller | - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330585 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.330591 | controller | - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.330597 | controller | on port 5671...' 2025-10-13 20:41:20.330602 | controller | - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.330608 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.330614 | controller | - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.330620 | controller | on port 15671...' 2025-10-13 20:41:20.330625 | controller | - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.330631 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.330637 | controller | - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.330643 | controller | on port 15691...' 2025-10-13 20:41:20.330649 | controller | - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.330655 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.330660 | controller | - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.330666 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.330672 | controller | - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.330678 | controller | on port 3306...' 2025-10-13 20:41:20.330686 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.330693 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.330699 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.330708 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.330714 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.330720 | controller | on port 3306...' 2025-10-13 20:41:20.330725 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.330731 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.330737 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.330743 | controller | had certificate mismatches:' 2025-10-13 20:41:20.330748 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.330754 | controller | on port 1981' 2025-10-13 20:41:20.330760 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.330765 | controller | on port 1981' 2025-10-13 20:41:20.330771 | controller | - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.330777 | controller | 2 additional commands' 2025-10-13 20:41:20.330782 | controller | - ' logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.330795 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.330804 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.330811 | controller | - ' ]' 2025-10-13 20:41:20.330819 | controller | - ' logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.330827 | controller | of non API service certificates...' 2025-10-13 20:41:20.330832 | controller | - ' logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330838 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.330844 | controller | - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.330849 | controller | on port 15691...' 2025-10-13 20:41:20.330855 | controller | - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.330861 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.330866 | controller | - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.330872 | controller | on port 5671...' 2025-10-13 20:41:20.330878 | controller | - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.330883 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.330889 | controller | - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.330895 | controller | on port 15671...' 2025-10-13 20:41:20.330900 | controller | - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.330906 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.330937 | controller | - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.330944 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.330950 | controller | - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.330959 | controller | on port 6642...' 2025-10-13 20:41:20.330964 | controller | - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.330970 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.330976 | controller | - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.330982 | controller | on port 6644...' 2025-10-13 20:41:20.330987 | controller | - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.330993 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.330999 | controller | - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.331007 | controller | on port 1981...' 2025-10-13 20:41:20.331013 | controller | - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.331018 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.331024 | controller | - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331030 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.331036 | controller | - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.331041 | controller | on port 6641...' 2025-10-13 20:41:20.331047 | controller | - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.331053 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.331058 | controller | - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.331064 | controller | on port 6643...' 2025-10-13 20:41:20.331070 | controller | - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.331075 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.331081 | controller | - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.331087 | controller | on port 1981...' 2025-10-13 20:41:20.331092 | controller | - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.331098 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.331103 | controller | - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331109 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.331115 | controller | - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.331121 | controller | on port 3000...' 2025-10-13 20:41:20.331126 | controller | - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.331132 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.331138 | controller | - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331143 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.331149 | controller | - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.331155 | controller | on port 5671...' 2025-10-13 20:41:20.331160 | controller | - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.331166 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.331172 | controller | - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.331177 | controller | on port 15671...' 2025-10-13 20:41:20.331191 | controller | - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.331202 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.331210 | controller | - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.331217 | controller | on port 15691...' 2025-10-13 20:41:20.331225 | controller | - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.331231 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.331237 | controller | - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.331242 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.331248 | controller | - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.331254 | controller | on port 3306...' 2025-10-13 20:41:20.331259 | controller | - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.331271 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.331277 | controller | - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.331283 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.331288 | controller | - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.331294 | controller | on port 3306...' 2025-10-13 20:41:20.331300 | controller | - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.331305 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.331311 | controller | - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.331317 | controller | had certificate mismatches:' 2025-10-13 20:41:20.331322 | controller | - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.331328 | controller | on port 1981' 2025-10-13 20:41:20.331333 | controller | - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.331339 | controller | on port 1981' 2025-10-13 20:41:20.331345 | controller | - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.331350 | controller | 2 additional commands' 2025-10-13 20:41:20.331356 | controller | - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.331362 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.331367 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.331373 | controller | - ' ]' 2025-10-13 20:41:20.331379 | controller | - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.331384 | controller | of non API service certificates...' 2025-10-13 20:41:20.331390 | controller | - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331398 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.331419 | controller | - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.331425 | controller | on port 15691...' 2025-10-13 20:41:20.331431 | controller | - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.331437 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.331442 | controller | - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.331448 | controller | on port 5671...' 2025-10-13 20:41:20.331454 | controller | - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.331460 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.331465 | controller | - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.331471 | controller | on port 15671...' 2025-10-13 20:41:20.331476 | controller | - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.331482 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.331488 | controller | - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331493 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.331499 | controller | - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.331505 | controller | on port 6642...' 2025-10-13 20:41:20.331510 | controller | - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.331516 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.331522 | controller | - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.331528 | controller | on port 6644...' 2025-10-13 20:41:20.331533 | controller | - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.331542 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.331548 | controller | - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.331553 | controller | on port 1981...' 2025-10-13 20:41:20.331559 | controller | - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.331565 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.331570 | controller | - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331576 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.331582 | controller | - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.331595 | controller | on port 6641...' 2025-10-13 20:41:20.331603 | controller | - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.331611 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.331619 | controller | - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.331627 | controller | on port 6643...' 2025-10-13 20:41:20.331633 | controller | - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.331639 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.331644 | controller | - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.331650 | controller | on port 1981...' 2025-10-13 20:41:20.331656 | controller | - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.331661 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.331667 | controller | - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331673 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.331678 | controller | - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.331688 | controller | on port 3000...' 2025-10-13 20:41:20.331693 | controller | - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.331699 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.331705 | controller | - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331710 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.331716 | controller | - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.331722 | controller | on port 5671...' 2025-10-13 20:41:20.331727 | controller | - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.331733 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.331739 | controller | - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.331744 | controller | on port 15671...' 2025-10-13 20:41:20.331750 | controller | - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.331755 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.331761 | controller | - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.331767 | controller | on port 15691...' 2025-10-13 20:41:20.331772 | controller | - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.331778 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.331784 | controller | - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.331789 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.331795 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.331803 | controller | on port 3306...' 2025-10-13 20:41:20.331809 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.331815 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.331820 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.331826 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.331832 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.331837 | controller | on port 3306...' 2025-10-13 20:41:20.331843 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.331849 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.331854 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.331860 | controller | had certificate mismatches:' 2025-10-13 20:41:20.331865 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.331871 | controller | on port 1981' 2025-10-13 20:41:20.331877 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.331882 | controller | on port 1981' 2025-10-13 20:41:20.331888 | controller | - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.331894 | controller | 2 additional commands' 2025-10-13 20:41:20.331899 | controller | - ' logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.331905 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.331911 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.331916 | controller | - ' ]' 2025-10-13 20:41:20.331922 | controller | - ' logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.331927 | controller | of non API service certificates...' 2025-10-13 20:41:20.331933 | controller | - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.331939 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.331945 | controller | - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.331950 | controller | on port 15691...' 2025-10-13 20:41:20.331956 | controller | - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.331970 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.331978 | controller | - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.331986 | controller | on port 5671...' 2025-10-13 20:41:20.331993 | controller | - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.332001 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.332007 | controller | - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.332013 | controller | on port 15671...' 2025-10-13 20:41:20.332019 | controller | - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.332024 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.332030 | controller | - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332036 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.332041 | controller | - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.332050 | controller | on port 6642...' 2025-10-13 20:41:20.332056 | controller | - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.332062 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.332068 | controller | - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.332077 | controller | on port 6644...' 2025-10-13 20:41:20.332083 | controller | - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.332088 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.332094 | controller | - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.332100 | controller | on port 1981...' 2025-10-13 20:41:20.332105 | controller | - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.332111 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.332117 | controller | - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332122 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.332128 | controller | - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.332134 | controller | on port 6641...' 2025-10-13 20:41:20.332142 | controller | - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.332148 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.332153 | controller | - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.332159 | controller | on port 6643...' 2025-10-13 20:41:20.332165 | controller | - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.332171 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.332176 | controller | - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.332182 | controller | on port 1981...' 2025-10-13 20:41:20.332188 | controller | - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.332193 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.332199 | controller | - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332205 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.332210 | controller | - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.332216 | controller | on port 3000...' 2025-10-13 20:41:20.332222 | controller | - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.332228 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.332233 | controller | - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332239 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.332245 | controller | - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.332251 | controller | on port 5671...' 2025-10-13 20:41:20.332257 | controller | - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.332262 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.332268 | controller | - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.332274 | controller | on port 15671...' 2025-10-13 20:41:20.332280 | controller | - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.332285 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.332291 | controller | - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.332297 | controller | on port 15691...' 2025-10-13 20:41:20.332303 | controller | - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.332311 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.332316 | controller | - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.332322 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.332330 | controller | - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.332336 | controller | on port 3306...' 2025-10-13 20:41:20.332349 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.332357 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.332365 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.332373 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.332380 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.332386 | controller | on port 3306...' 2025-10-13 20:41:20.332395 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.332412 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.332421 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.332427 | controller | had certificate mismatches:' 2025-10-13 20:41:20.332432 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.332438 | controller | on port 1981' 2025-10-13 20:41:20.332444 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.332449 | controller | on port 1981' 2025-10-13 20:41:20.332455 | controller | - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.332461 | controller | 2 additional commands' 2025-10-13 20:41:20.332466 | controller | - ' logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.332472 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.332478 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.332483 | controller | - ' ]' 2025-10-13 20:41:20.332489 | controller | - ' logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.332495 | controller | of non API service certificates...' 2025-10-13 20:41:20.332501 | controller | - ' logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332506 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.332512 | controller | - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.332518 | controller | on port 15691...' 2025-10-13 20:41:20.332527 | controller | - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.332533 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.332538 | controller | - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.332544 | controller | on port 5671...' 2025-10-13 20:41:20.332550 | controller | - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.332555 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.332561 | controller | - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.332567 | controller | on port 15671...' 2025-10-13 20:41:20.332572 | controller | - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.332578 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.332584 | controller | - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332589 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.332595 | controller | - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.332603 | controller | on port 6642...' 2025-10-13 20:41:20.332609 | controller | - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.332617 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.332623 | controller | - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.332629 | controller | on port 6644...' 2025-10-13 20:41:20.332635 | controller | - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.332640 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.332646 | controller | - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.332652 | controller | on port 1981...' 2025-10-13 20:41:20.332657 | controller | - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.332663 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.332669 | controller | - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332674 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.332680 | controller | - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.332688 | controller | on port 6641...' 2025-10-13 20:41:20.332694 | controller | - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.332699 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.332705 | controller | - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.332711 | controller | on port 6643...' 2025-10-13 20:41:20.332716 | controller | - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.332722 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.332728 | controller | - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.332734 | controller | on port 1981...' 2025-10-13 20:41:20.332739 | controller | - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.332753 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.332761 | controller | - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332769 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.332777 | controller | - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.332788 | controller | on port 3000...' 2025-10-13 20:41:20.332796 | controller | - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.332803 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.332811 | controller | - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.332818 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.332826 | controller | - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.332833 | controller | on port 5671...' 2025-10-13 20:41:20.332841 | controller | - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.332848 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.332853 | controller | - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.332859 | controller | on port 15671...' 2025-10-13 20:41:20.332865 | controller | - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.332871 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.332885 | controller | - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.332891 | controller | on port 15691...' 2025-10-13 20:41:20.332902 | controller | - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.332908 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.332917 | controller | - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.332923 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.332929 | controller | - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.332934 | controller | on port 3306...' 2025-10-13 20:41:20.332940 | controller | - ' logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.332946 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.332951 | controller | - ' logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.332957 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.332963 | controller | - ' logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.332968 | controller | on port 3306...' 2025-10-13 20:41:20.332974 | controller | - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.332980 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.332986 | controller | - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.332991 | controller | had certificate mismatches:' 2025-10-13 20:41:20.332997 | controller | - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.333003 | controller | on port 1981' 2025-10-13 20:41:20.333008 | controller | - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.333014 | controller | on port 1981' 2025-10-13 20:41:20.333020 | controller | - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.333026 | controller | 2 additional commands' 2025-10-13 20:41:20.333031 | controller | - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.333037 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.333043 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.333049 | controller | - ' ]' 2025-10-13 20:41:20.333054 | controller | - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.333060 | controller | of non API service certificates...' 2025-10-13 20:41:20.333066 | controller | - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333072 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.333077 | controller | - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.333083 | controller | on port 15691...' 2025-10-13 20:41:20.333089 | controller | - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.333095 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.333100 | controller | - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.333106 | controller | on port 5671...' 2025-10-13 20:41:20.333112 | controller | - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.333118 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.333123 | controller | - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.333129 | controller | on port 15671...' 2025-10-13 20:41:20.333135 | controller | - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.333140 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.333146 | controller | - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333152 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.333166 | controller | - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.333186 | controller | on port 6642...' 2025-10-13 20:41:20.333194 | controller | - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.333202 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.333208 | controller | - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.333214 | controller | on port 6644...' 2025-10-13 20:41:20.333219 | controller | - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.333225 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.333231 | controller | - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.333237 | controller | on port 1981...' 2025-10-13 20:41:20.333243 | controller | - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.333248 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.333254 | controller | - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333260 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.333266 | controller | - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.333272 | controller | on port 6641...' 2025-10-13 20:41:20.333277 | controller | - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.333283 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.333289 | controller | - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.333295 | controller | on port 6643...' 2025-10-13 20:41:20.333300 | controller | - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.333306 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.333312 | controller | - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.333318 | controller | on port 1981...' 2025-10-13 20:41:20.333323 | controller | - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.333329 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.333335 | controller | - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333341 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.333347 | controller | - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.333355 | controller | on port 3000...' 2025-10-13 20:41:20.333361 | controller | - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.333367 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.333373 | controller | - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333378 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.333384 | controller | - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.333390 | controller | on port 5671...' 2025-10-13 20:41:20.333411 | controller | - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.333420 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.333426 | controller | - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.333432 | controller | on port 15671...' 2025-10-13 20:41:20.333437 | controller | - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.333443 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.333449 | controller | - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.333455 | controller | on port 15691...' 2025-10-13 20:41:20.333463 | controller | - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.333469 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.333475 | controller | - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.333481 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.333486 | controller | - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.333492 | controller | on port 3306...' 2025-10-13 20:41:20.333498 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.333504 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.333509 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.333515 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.333521 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.333527 | controller | on port 3306...' 2025-10-13 20:41:20.333533 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.333538 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.333544 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.333550 | controller | had certificate mismatches:' 2025-10-13 20:41:20.333563 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.333572 | controller | on port 1981' 2025-10-13 20:41:20.333580 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.333587 | controller | on port 1981' 2025-10-13 20:41:20.333595 | controller | - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.333602 | controller | 2 additional commands' 2025-10-13 20:41:20.333608 | controller | - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.333613 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.333619 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.333625 | controller | - ' ]' 2025-10-13 20:41:20.333631 | controller | - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.333637 | controller | of non API service certificates...' 2025-10-13 20:41:20.333642 | controller | - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333648 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.333654 | controller | - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.333660 | controller | on port 15691...' 2025-10-13 20:41:20.333666 | controller | - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.333671 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.333677 | controller | - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.333683 | controller | on port 5671...' 2025-10-13 20:41:20.333689 | controller | - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.333695 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.333700 | controller | - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.333706 | controller | on port 15671...' 2025-10-13 20:41:20.333712 | controller | - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.333718 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.333723 | controller | - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333729 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.333738 | controller | - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.333744 | controller | on port 6642...' 2025-10-13 20:41:20.333750 | controller | - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.333755 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.333761 | controller | - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.333767 | controller | on port 6644...' 2025-10-13 20:41:20.333773 | controller | - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.333780 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.333787 | controller | - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.333795 | controller | on port 1981...' 2025-10-13 20:41:20.333803 | controller | - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.333810 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.333818 | controller | - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333825 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.333831 | controller | - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.333837 | controller | on port 6641...' 2025-10-13 20:41:20.333842 | controller | - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.333848 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.333854 | controller | - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.333860 | controller | on port 6643...' 2025-10-13 20:41:20.333866 | controller | - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.333871 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.333877 | controller | - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.333883 | controller | on port 1981...' 2025-10-13 20:41:20.333889 | controller | - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.333895 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.333901 | controller | - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333906 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.333912 | controller | - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.333918 | controller | on port 3000...' 2025-10-13 20:41:20.333924 | controller | - ' logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.333930 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.333936 | controller | - ' logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.333941 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.333956 | controller | - ' logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.333964 | controller | on port 5671...' 2025-10-13 20:41:20.333972 | controller | - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.333980 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.333988 | controller | - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.333995 | controller | on port 15671...' 2025-10-13 20:41:20.334002 | controller | - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.334020 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.334029 | controller | - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.334034 | controller | on port 15691...' 2025-10-13 20:41:20.334040 | controller | - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.334048 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.334054 | controller | - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.334060 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.334066 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.334072 | controller | on port 3306...' 2025-10-13 20:41:20.334078 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.334083 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.334089 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.334095 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.334101 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.334106 | controller | on port 3306...' 2025-10-13 20:41:20.334112 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.334118 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.334124 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.334129 | controller | had certificate mismatches:' 2025-10-13 20:41:20.334135 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.334141 | controller | on port 1981' 2025-10-13 20:41:20.334147 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.334152 | controller | on port 1981' 2025-10-13 20:41:20.334158 | controller | - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.334164 | controller | 2 additional commands' 2025-10-13 20:41:20.334170 | controller | - ' logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.334175 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.334181 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.334187 | controller | - ' ]' 2025-10-13 20:41:20.334193 | controller | - ' logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.334199 | controller | of non API service certificates...' 2025-10-13 20:41:20.334204 | controller | - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334210 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.334216 | controller | - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.334222 | controller | on port 15691...' 2025-10-13 20:41:20.334227 | controller | - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.334233 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.334239 | controller | - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.334245 | controller | on port 5671...' 2025-10-13 20:41:20.334250 | controller | - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.334256 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.334262 | controller | - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.334267 | controller | on port 15671...' 2025-10-13 20:41:20.334273 | controller | - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.334279 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.334287 | controller | - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334293 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.334299 | controller | - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.334307 | controller | on port 6642...' 2025-10-13 20:41:20.334312 | controller | - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.334318 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.334324 | controller | - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.334330 | controller | on port 6644...' 2025-10-13 20:41:20.334336 | controller | - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.334341 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.334347 | controller | - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.334353 | controller | on port 1981...' 2025-10-13 20:41:20.334366 | controller | - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.334375 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.334383 | controller | - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334391 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.334413 | controller | - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.334422 | controller | on port 6641...' 2025-10-13 20:41:20.334428 | controller | - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.334437 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.334443 | controller | - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.334449 | controller | on port 6643...' 2025-10-13 20:41:20.334455 | controller | - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.334460 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.334466 | controller | - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.334472 | controller | on port 1981...' 2025-10-13 20:41:20.334478 | controller | - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.334484 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.334489 | controller | - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334495 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.334501 | controller | - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.334507 | controller | on port 3000...' 2025-10-13 20:41:20.334512 | controller | - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.334518 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.334524 | controller | - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334530 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.334535 | controller | - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.334541 | controller | on port 5671...' 2025-10-13 20:41:20.334547 | controller | - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.334553 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.334558 | controller | - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.334564 | controller | on port 15671...' 2025-10-13 20:41:20.334570 | controller | - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.334579 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.334584 | controller | - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.334590 | controller | on port 15691...' 2025-10-13 20:41:20.334596 | controller | - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.334602 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.334608 | controller | - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.334613 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.334619 | controller | - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.334625 | controller | on port 3306...' 2025-10-13 20:41:20.334631 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.334636 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.334642 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.334648 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.334654 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.334659 | controller | on port 3306...' 2025-10-13 20:41:20.334665 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.334671 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.334677 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.334682 | controller | had certificate mismatches:' 2025-10-13 20:41:20.334688 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.334694 | controller | on port 1981' 2025-10-13 20:41:20.334699 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.334705 | controller | on port 1981' 2025-10-13 20:41:20.334711 | controller | - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.334717 | controller | 2 additional commands' 2025-10-13 20:41:20.334722 | controller | - ' logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.334728 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.334734 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.334740 | controller | - ' ]' 2025-10-13 20:41:20.334745 | controller | - ' logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.334751 | controller | of non API service certificates...' 2025-10-13 20:41:20.334765 | controller | - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334773 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.334781 | controller | - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.334789 | controller | on port 15691...' 2025-10-13 20:41:20.334796 | controller | - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.334802 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.334808 | controller | - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.334814 | controller | on port 5671...' 2025-10-13 20:41:20.334820 | controller | - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.334825 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.334831 | controller | - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.334837 | controller | on port 15671...' 2025-10-13 20:41:20.334843 | controller | - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.334852 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.334857 | controller | - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334863 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.334869 | controller | - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.334878 | controller | on port 6642...' 2025-10-13 20:41:20.334883 | controller | - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.334889 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.334895 | controller | - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.334903 | controller | on port 6644...' 2025-10-13 20:41:20.334909 | controller | - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.334915 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.334921 | controller | - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.334927 | controller | on port 1981...' 2025-10-13 20:41:20.334932 | controller | - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.334938 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.334965 | controller | - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.334971 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.334978 | controller | - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.334984 | controller | on port 6641...' 2025-10-13 20:41:20.334991 | controller | - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.334997 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.335004 | controller | - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.335010 | controller | on port 6643...' 2025-10-13 20:41:20.335017 | controller | - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.335023 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.335029 | controller | - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.335036 | controller | on port 1981...' 2025-10-13 20:41:20.335042 | controller | - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.335049 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.335055 | controller | - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335061 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.335068 | controller | - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.335074 | controller | on port 3000...' 2025-10-13 20:41:20.335081 | controller | - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.335087 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.335094 | controller | - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335100 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.335106 | controller | - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.335113 | controller | on port 5671...' 2025-10-13 20:41:20.335119 | controller | - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.335126 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.335132 | controller | - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.335144 | controller | on port 15671...' 2025-10-13 20:41:20.335151 | controller | - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.335157 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.335164 | controller | - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.335170 | controller | on port 15691...' 2025-10-13 20:41:20.335184 | controller | - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.335192 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.335200 | controller | - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.335207 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.335215 | controller | - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.335222 | controller | on port 3306...' 2025-10-13 20:41:20.335228 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.335233 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.335239 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.335245 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.335250 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.335256 | controller | on port 3306...' 2025-10-13 20:41:20.335262 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.335267 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.335273 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.335279 | controller | had certificate mismatches:' 2025-10-13 20:41:20.335284 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.335290 | controller | on port 1981' 2025-10-13 20:41:20.335296 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.335301 | controller | on port 1981' 2025-10-13 20:41:20.335307 | controller | - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.335313 | controller | 2 additional commands' 2025-10-13 20:41:20.335318 | controller | - ' logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.335324 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.335330 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.335335 | controller | - ' ]' 2025-10-13 20:41:20.335341 | controller | - ' logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.335347 | controller | of non API service certificates...' 2025-10-13 20:41:20.335352 | controller | - ' logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335358 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.335364 | controller | - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.335369 | controller | on port 15691...' 2025-10-13 20:41:20.335375 | controller | - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.335381 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.335386 | controller | - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.335392 | controller | on port 5671...' 2025-10-13 20:41:20.335400 | controller | - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.335421 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.335427 | controller | - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.335436 | controller | on port 15671...' 2025-10-13 20:41:20.335442 | controller | - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.335447 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.335453 | controller | - ' logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335459 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.335465 | controller | - ' logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.335470 | controller | on port 6642...' 2025-10-13 20:41:20.335476 | controller | - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.335482 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.335487 | controller | - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.335493 | controller | on port 6644...' 2025-10-13 20:41:20.335499 | controller | - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.335504 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.335510 | controller | - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.335516 | controller | on port 1981...' 2025-10-13 20:41:20.335521 | controller | - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.335527 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.335533 | controller | - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335538 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.335544 | controller | - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.335550 | controller | on port 6641...' 2025-10-13 20:41:20.335555 | controller | - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.335561 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.335567 | controller | - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.335575 | controller | on port 6643...' 2025-10-13 20:41:20.335589 | controller | - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.335597 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.335605 | controller | - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.335613 | controller | on port 1981...' 2025-10-13 20:41:20.335621 | controller | - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.335628 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.335633 | controller | - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335639 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.335645 | controller | - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.335651 | controller | on port 3000...' 2025-10-13 20:41:20.335657 | controller | - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.335662 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.335671 | controller | - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335677 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.335683 | controller | - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.335689 | controller | on port 5671...' 2025-10-13 20:41:20.335695 | controller | - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.335705 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.335711 | controller | - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.335717 | controller | on port 15671...' 2025-10-13 20:41:20.335723 | controller | - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.335728 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.335734 | controller | - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.335740 | controller | on port 15691...' 2025-10-13 20:41:20.335746 | controller | - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.335751 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.335757 | controller | - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.335763 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.335769 | controller | - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.335774 | controller | on port 3306...' 2025-10-13 20:41:20.335780 | controller | - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.335786 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.335792 | controller | - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.335797 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.335803 | controller | - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.335809 | controller | on port 3306...' 2025-10-13 20:41:20.335815 | controller | - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.335820 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.335826 | controller | - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.335832 | controller | had certificate mismatches:' 2025-10-13 20:41:20.335838 | controller | - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.335843 | controller | on port 1981' 2025-10-13 20:41:20.335849 | controller | - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.335855 | controller | on port 1981' 2025-10-13 20:41:20.335861 | controller | - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.335866 | controller | 2 additional commands' 2025-10-13 20:41:20.335872 | controller | - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.335878 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.335884 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.335889 | controller | - ' ]' 2025-10-13 20:41:20.335895 | controller | - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.335901 | controller | of non API service certificates...' 2025-10-13 20:41:20.335906 | controller | - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.335912 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.335918 | controller | - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.335924 | controller | on port 15691...' 2025-10-13 20:41:20.335929 | controller | - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.335935 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.335941 | controller | - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.335947 | controller | on port 5671...' 2025-10-13 20:41:20.335952 | controller | - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.335961 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.335974 | controller | - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.335983 | controller | on port 15671...' 2025-10-13 20:41:20.335991 | controller | - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.335999 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.336006 | controller | - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336013 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.336019 | controller | - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.336025 | controller | on port 6642...' 2025-10-13 20:41:20.336030 | controller | - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.336036 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.336042 | controller | - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.336048 | controller | on port 6644...' 2025-10-13 20:41:20.336054 | controller | - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.336059 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.336065 | controller | - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.336071 | controller | on port 1981...' 2025-10-13 20:41:20.336077 | controller | - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.336083 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.336088 | controller | - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336094 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.336100 | controller | - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.336106 | controller | on port 6641...' 2025-10-13 20:41:20.336112 | controller | - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.336117 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.336123 | controller | - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.336129 | controller | on port 6643...' 2025-10-13 20:41:20.336135 | controller | - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.336141 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.336146 | controller | - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.336152 | controller | on port 1981...' 2025-10-13 20:41:20.336158 | controller | - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.336164 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.336170 | controller | - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336175 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.336181 | controller | - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.336191 | controller | on port 3000...' 2025-10-13 20:41:20.336197 | controller | - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.336202 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.336208 | controller | - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336214 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.336220 | controller | - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.336229 | controller | on port 5671...' 2025-10-13 20:41:20.336235 | controller | - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.336243 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.336248 | controller | - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.336254 | controller | on port 15671...' 2025-10-13 20:41:20.336260 | controller | - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.336266 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.336272 | controller | - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.336277 | controller | on port 15691...' 2025-10-13 20:41:20.336283 | controller | - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.336291 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.336297 | controller | - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.336303 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.336309 | controller | - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.336314 | controller | on port 3306...' 2025-10-13 20:41:20.336320 | controller | - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.336326 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.336332 | controller | - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.336338 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.336351 | controller | - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.336360 | controller | on port 3306...' 2025-10-13 20:41:20.336368 | controller | - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.336376 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.336383 | controller | - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.336389 | controller | had certificate mismatches:' 2025-10-13 20:41:20.336398 | controller | - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.336418 | controller | on port 1981' 2025-10-13 20:41:20.336424 | controller | - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.336430 | controller | on port 1981' 2025-10-13 20:41:20.336436 | controller | - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.336442 | controller | 2 additional commands' 2025-10-13 20:41:20.336447 | controller | - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.336453 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.336459 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.336465 | controller | - ' ]' 2025-10-13 20:41:20.336471 | controller | - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.336476 | controller | of non API service certificates...' 2025-10-13 20:41:20.336482 | controller | - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336488 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.336494 | controller | - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.336499 | controller | on port 15691...' 2025-10-13 20:41:20.336505 | controller | - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.336511 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.336517 | controller | - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.336526 | controller | on port 5671...' 2025-10-13 20:41:20.336531 | controller | - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.336537 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.336543 | controller | - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.336549 | controller | on port 15671...' 2025-10-13 20:41:20.336554 | controller | - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.336560 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.336566 | controller | - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336572 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.336577 | controller | - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.336586 | controller | on port 6642...' 2025-10-13 20:41:20.336592 | controller | - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.336598 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.336603 | controller | - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.336609 | controller | on port 6644...' 2025-10-13 20:41:20.336615 | controller | - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.336621 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.336626 | controller | - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.336632 | controller | on port 1981...' 2025-10-13 20:41:20.336638 | controller | - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.336643 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.336649 | controller | - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336655 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.336661 | controller | - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.336666 | controller | on port 6641...' 2025-10-13 20:41:20.336672 | controller | - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.336678 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.336683 | controller | - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.336689 | controller | on port 6643...' 2025-10-13 20:41:20.336695 | controller | - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.336700 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.336706 | controller | - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.336712 | controller | on port 1981...' 2025-10-13 20:41:20.336717 | controller | - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.336723 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.336729 | controller | - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336734 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.336740 | controller | - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.336754 | controller | on port 3000...' 2025-10-13 20:41:20.336762 | controller | - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.336770 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.336777 | controller | - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.336788 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.336794 | controller | - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.336800 | controller | on port 5671...' 2025-10-13 20:41:20.336806 | controller | - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.336812 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.336817 | controller | - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.336823 | controller | on port 15671...' 2025-10-13 20:41:20.336829 | controller | - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.336834 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.336840 | controller | - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.336846 | controller | on port 15691...' 2025-10-13 20:41:20.336851 | controller | - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.336857 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.336863 | controller | - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.336869 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.336874 | controller | - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.336880 | controller | on port 3306...' 2025-10-13 20:41:20.336886 | controller | - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.336894 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.336900 | controller | - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.336906 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.336912 | controller | - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.336917 | controller | on port 3306...' 2025-10-13 20:41:20.336923 | controller | - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.336929 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.336934 | controller | - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.336940 | controller | had certificate mismatches:' 2025-10-13 20:41:20.336946 | controller | - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.336951 | controller | on port 1981' 2025-10-13 20:41:20.336957 | controller | - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.336963 | controller | on port 1981' 2025-10-13 20:41:20.336969 | controller | - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.336974 | controller | 2 additional commands' 2025-10-13 20:41:20.336980 | controller | - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.336986 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.336991 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.336997 | controller | - ' ]' 2025-10-13 20:41:20.337003 | controller | - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.337008 | controller | of non API service certificates...' 2025-10-13 20:41:20.337014 | controller | - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337020 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.337026 | controller | - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.337031 | controller | on port 15691...' 2025-10-13 20:41:20.337037 | controller | - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.337048 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.337054 | controller | - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.337060 | controller | on port 5671...' 2025-10-13 20:41:20.337065 | controller | - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.337071 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.337077 | controller | - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.337082 | controller | on port 15671...' 2025-10-13 20:41:20.337088 | controller | - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.337094 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.337100 | controller | - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337105 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.337111 | controller | - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.337119 | controller | on port 6642...' 2025-10-13 20:41:20.337125 | controller | - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.337130 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.337144 | controller | - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.337152 | controller | on port 6644...' 2025-10-13 20:41:20.337160 | controller | - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.337167 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.337175 | controller | - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.337181 | controller | on port 1981...' 2025-10-13 20:41:20.337187 | controller | - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.337192 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.337198 | controller | - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337204 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.337210 | controller | - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.337215 | controller | on port 6641...' 2025-10-13 20:41:20.337221 | controller | - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.337227 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.337233 | controller | - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.337238 | controller | on port 6643...' 2025-10-13 20:41:20.337244 | controller | - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.337250 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.337256 | controller | - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.337262 | controller | on port 1981...' 2025-10-13 20:41:20.337267 | controller | - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.337273 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.337279 | controller | - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337285 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.337290 | controller | - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.337299 | controller | on port 3000...' 2025-10-13 20:41:20.337305 | controller | - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.337314 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.337320 | controller | - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337325 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.337331 | controller | - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.337337 | controller | on port 5671...' 2025-10-13 20:41:20.337342 | controller | - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.337348 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.337354 | controller | - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.337359 | controller | on port 15671...' 2025-10-13 20:41:20.337365 | controller | - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.337371 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.337377 | controller | - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.337382 | controller | on port 15691...' 2025-10-13 20:41:20.337388 | controller | - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.337397 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.337418 | controller | - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.337424 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.337430 | controller | - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.337435 | controller | on port 3306...' 2025-10-13 20:41:20.337441 | controller | - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.337447 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.337452 | controller | - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.337458 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.337464 | controller | - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.337469 | controller | on port 3306...' 2025-10-13 20:41:20.337475 | controller | - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.337481 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.337487 | controller | - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.337492 | controller | had certificate mismatches:' 2025-10-13 20:41:20.337498 | controller | - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.337504 | controller | on port 1981' 2025-10-13 20:41:20.337509 | controller | - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.337515 | controller | on port 1981' 2025-10-13 20:41:20.337521 | controller | - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.337526 | controller | 2 additional commands' 2025-10-13 20:41:20.337540 | controller | - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.337548 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.337555 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.337563 | controller | - ' ]' 2025-10-13 20:41:20.337571 | controller | - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.337577 | controller | of non API service certificates...' 2025-10-13 20:41:20.337582 | controller | - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337588 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.337594 | controller | - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.337603 | controller | on port 15691...' 2025-10-13 20:41:20.337608 | controller | - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.337614 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.337620 | controller | - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.337626 | controller | on port 5671...' 2025-10-13 20:41:20.337631 | controller | - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.337637 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.337643 | controller | - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.337648 | controller | on port 15671...' 2025-10-13 20:41:20.337654 | controller | - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.337660 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.337665 | controller | - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337671 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.337677 | controller | - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.337682 | controller | on port 6642...' 2025-10-13 20:41:20.337688 | controller | - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.337694 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.337699 | controller | - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.337705 | controller | on port 6644...' 2025-10-13 20:41:20.337711 | controller | - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.337717 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.337722 | controller | - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.337731 | controller | on port 1981...' 2025-10-13 20:41:20.337737 | controller | - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.337743 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.337748 | controller | - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337754 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.337760 | controller | - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.337765 | controller | on port 6641...' 2025-10-13 20:41:20.337771 | controller | - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.337777 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.337783 | controller | - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.337788 | controller | on port 6643...' 2025-10-13 20:41:20.337794 | controller | - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.337800 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.337805 | controller | - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.337811 | controller | on port 1981...' 2025-10-13 20:41:20.337817 | controller | - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.337822 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.337828 | controller | - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337834 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.337840 | controller | - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.337845 | controller | on port 3000...' 2025-10-13 20:41:20.337854 | controller | - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.337860 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.337865 | controller | - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.337871 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.337877 | controller | - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.337882 | controller | on port 5671...' 2025-10-13 20:41:20.337888 | controller | - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.337894 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.337907 | controller | - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.337916 | controller | on port 15671...' 2025-10-13 20:41:20.337923 | controller | - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.337931 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.337938 | controller | - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.337944 | controller | on port 15691...' 2025-10-13 20:41:20.337950 | controller | - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.337956 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.337961 | controller | - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.337967 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.337973 | controller | - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.337978 | controller | on port 3306...' 2025-10-13 20:41:20.337984 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.337990 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.337995 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.338001 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.338007 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.338012 | controller | on port 3306...' 2025-10-13 20:41:20.338018 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.338024 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.338033 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.338038 | controller | had certificate mismatches:' 2025-10-13 20:41:20.338044 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.338050 | controller | on port 1981' 2025-10-13 20:41:20.338055 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.338061 | controller | on port 1981' 2025-10-13 20:41:20.338067 | controller | - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.338072 | controller | 2 additional commands' 2025-10-13 20:41:20.338078 | controller | - ' logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.338084 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.338089 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.338095 | controller | - ' ]' 2025-10-13 20:41:20.338103 | controller | - ' logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.338109 | controller | of non API service certificates...' 2025-10-13 20:41:20.338115 | controller | - ' logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338123 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.338129 | controller | - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.338135 | controller | on port 15691...' 2025-10-13 20:41:20.338140 | controller | - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.338146 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.338152 | controller | - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.338157 | controller | on port 5671...' 2025-10-13 20:41:20.338163 | controller | - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.338169 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.338174 | controller | - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.338180 | controller | on port 15671...' 2025-10-13 20:41:20.338186 | controller | - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.338191 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.338197 | controller | - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338202 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.338208 | controller | - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.338216 | controller | on port 6642...' 2025-10-13 20:41:20.338222 | controller | - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.338228 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.338233 | controller | - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.338239 | controller | on port 6644...' 2025-10-13 20:41:20.338245 | controller | - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.338250 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.338256 | controller | - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.338262 | controller | on port 1981...' 2025-10-13 20:41:20.338267 | controller | - ' logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.338273 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.338279 | controller | - ' logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338284 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.338298 | controller | - ' logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.338306 | controller | on port 6641...' 2025-10-13 20:41:20.338314 | controller | - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.338322 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.338329 | controller | - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.338335 | controller | on port 6643...' 2025-10-13 20:41:20.338341 | controller | - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.338347 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.338352 | controller | - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.338369 | controller | on port 1981...' 2025-10-13 20:41:20.338374 | controller | - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.338380 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.338386 | controller | - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338395 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.338417 | controller | - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.338426 | controller | on port 3000...' 2025-10-13 20:41:20.338432 | controller | - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.338437 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.338443 | controller | - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338449 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.338454 | controller | - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.338460 | controller | on port 5671...' 2025-10-13 20:41:20.338466 | controller | - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.338471 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.338477 | controller | - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.338483 | controller | on port 15671...' 2025-10-13 20:41:20.338488 | controller | - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.338494 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.338500 | controller | - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.338506 | controller | on port 15691...' 2025-10-13 20:41:20.338511 | controller | - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.338517 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.338523 | controller | - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.338528 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.338534 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.338540 | controller | on port 3306...' 2025-10-13 20:41:20.338545 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.338551 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.338557 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.338562 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.338568 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.338574 | controller | on port 3306...' 2025-10-13 20:41:20.338579 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.338585 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.338591 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.338596 | controller | had certificate mismatches:' 2025-10-13 20:41:20.338602 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.338608 | controller | on port 1981' 2025-10-13 20:41:20.338613 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.338619 | controller | on port 1981' 2025-10-13 20:41:20.338625 | controller | - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.338630 | controller | 2 additional commands' 2025-10-13 20:41:20.338636 | controller | - ' logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.338642 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.338647 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.338653 | controller | - ' ]' 2025-10-13 20:41:20.338659 | controller | - ' logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.338667 | controller | of non API service certificates...' 2025-10-13 20:41:20.338675 | controller | - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338681 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.338687 | controller | - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.338693 | controller | on port 15691...' 2025-10-13 20:41:20.338706 | controller | - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.338714 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.338722 | controller | - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.338730 | controller | on port 5671...' 2025-10-13 20:41:20.338738 | controller | - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.338744 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.338749 | controller | - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.338755 | controller | on port 15671...' 2025-10-13 20:41:20.338761 | controller | - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.338766 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.338772 | controller | - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338778 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.338783 | controller | - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.338795 | controller | on port 6642...' 2025-10-13 20:41:20.338801 | controller | - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.338806 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.338812 | controller | - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.338818 | controller | on port 6644...' 2025-10-13 20:41:20.338823 | controller | - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.338829 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.338835 | controller | - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.338841 | controller | on port 1981...' 2025-10-13 20:41:20.338846 | controller | - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.338852 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.338858 | controller | - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338864 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.338869 | controller | - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.338875 | controller | on port 6641...' 2025-10-13 20:41:20.338881 | controller | - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.338887 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.338892 | controller | - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.338898 | controller | on port 6643...' 2025-10-13 20:41:20.338904 | controller | - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.338910 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.338916 | controller | - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.338924 | controller | on port 1981...' 2025-10-13 20:41:20.338930 | controller | - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.338935 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.338941 | controller | - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.338950 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.338955 | controller | - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.338961 | controller | on port 3000...' 2025-10-13 20:41:20.338967 | controller | - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.339001 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.339007 | controller | - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339013 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.339018 | controller | - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.339024 | controller | on port 5671...' 2025-10-13 20:41:20.339030 | controller | - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.339036 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.339041 | controller | - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.339047 | controller | on port 15671...' 2025-10-13 20:41:20.339052 | controller | - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.339061 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.339067 | controller | - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.339072 | controller | on port 15691...' 2025-10-13 20:41:20.339078 | controller | - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.339084 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.339089 | controller | - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.339095 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.339109 | controller | - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.339117 | controller | on port 3306...' 2025-10-13 20:41:20.339125 | controller | - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.339133 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.339141 | controller | - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.339148 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.339153 | controller | - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.339159 | controller | on port 3306...' 2025-10-13 20:41:20.339165 | controller | - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.339170 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.339176 | controller | - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.339182 | controller | had certificate mismatches:' 2025-10-13 20:41:20.339187 | controller | - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.339193 | controller | on port 1981' 2025-10-13 20:41:20.339199 | controller | - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.339204 | controller | on port 1981' 2025-10-13 20:41:20.339210 | controller | - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.339216 | controller | 2 additional commands' 2025-10-13 20:41:20.339221 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.339227 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.339233 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.339242 | controller | - ' ]' 2025-10-13 20:41:20.339247 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.339253 | controller | of non API service certificates...' 2025-10-13 20:41:20.339259 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339264 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.339270 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.339276 | controller | on port 15691...' 2025-10-13 20:41:20.339281 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.339287 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.339293 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.339298 | controller | on port 5671...' 2025-10-13 20:41:20.339304 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.339310 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.339315 | controller | - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.339321 | controller | on port 15671...' 2025-10-13 20:41:20.339327 | controller | - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.339332 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.339338 | controller | - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339343 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.339349 | controller | - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.339355 | controller | on port 6642...' 2025-10-13 20:41:20.339360 | controller | - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.339366 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.339372 | controller | - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.339378 | controller | on port 6644...' 2025-10-13 20:41:20.339383 | controller | - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.339389 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.339394 | controller | - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.339415 | controller | on port 1981...' 2025-10-13 20:41:20.339424 | controller | - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.339430 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.339436 | controller | - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339442 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.339447 | controller | - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.339453 | controller | on port 6641...' 2025-10-13 20:41:20.339459 | controller | - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.339464 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.339470 | controller | - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.339476 | controller | on port 6643...' 2025-10-13 20:41:20.339481 | controller | - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.339487 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.339493 | controller | - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.339498 | controller | on port 1981...' 2025-10-13 20:41:20.339512 | controller | - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.339523 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.339531 | controller | - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339539 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.339546 | controller | - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.339555 | controller | on port 3000...' 2025-10-13 20:41:20.339561 | controller | - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.339567 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.339573 | controller | - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339578 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.339584 | controller | - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.339590 | controller | on port 5671...' 2025-10-13 20:41:20.339595 | controller | - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.339601 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.339607 | controller | - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.339612 | controller | on port 15671...' 2025-10-13 20:41:20.339618 | controller | - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.339624 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.339629 | controller | - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.339635 | controller | on port 15691...' 2025-10-13 20:41:20.339641 | controller | - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.339646 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.339652 | controller | - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.339658 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.339663 | controller | - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.339669 | controller | on port 3306...' 2025-10-13 20:41:20.339675 | controller | - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.339683 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.339689 | controller | - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.339694 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.339700 | controller | - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.339706 | controller | on port 3306...' 2025-10-13 20:41:20.339712 | controller | - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.339717 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.339723 | controller | - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.339729 | controller | had certificate mismatches:' 2025-10-13 20:41:20.339735 | controller | - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.339740 | controller | on port 1981' 2025-10-13 20:41:20.339746 | controller | - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.339752 | controller | on port 1981' 2025-10-13 20:41:20.339758 | controller | - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.339763 | controller | 2 additional commands' 2025-10-13 20:41:20.339769 | controller | - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.339775 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.339784 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.339790 | controller | - ' ]' 2025-10-13 20:41:20.339796 | controller | - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.339802 | controller | of non API service certificates...' 2025-10-13 20:41:20.339807 | controller | - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339813 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.339819 | controller | - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.339825 | controller | on port 15691...' 2025-10-13 20:41:20.339830 | controller | - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.339836 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.339842 | controller | - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.339848 | controller | on port 5671...' 2025-10-13 20:41:20.339853 | controller | - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.339859 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.339865 | controller | - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.339870 | controller | on port 15671...' 2025-10-13 20:41:20.339876 | controller | - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.339882 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.339895 | controller | - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339904 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.339912 | controller | - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.339924 | controller | on port 6642...' 2025-10-13 20:41:20.339931 | controller | - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.339936 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.339942 | controller | - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.339948 | controller | on port 6644...' 2025-10-13 20:41:20.339954 | controller | - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.339960 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.339966 | controller | - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.339971 | controller | on port 1981...' 2025-10-13 20:41:20.339977 | controller | - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.339985 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.339991 | controller | - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.339997 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.340003 | controller | - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.340009 | controller | on port 6641...' 2025-10-13 20:41:20.340014 | controller | - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.340020 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.340026 | controller | - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.340032 | controller | on port 6643...' 2025-10-13 20:41:20.340038 | controller | - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.340043 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.340049 | controller | - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.340058 | controller | on port 1981...' 2025-10-13 20:41:20.340063 | controller | - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.340069 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.340075 | controller | - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340081 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.340087 | controller | - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.340092 | controller | on port 3000...' 2025-10-13 20:41:20.340098 | controller | - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.340104 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.340110 | controller | - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340115 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.340121 | controller | - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.340127 | controller | on port 5671...' 2025-10-13 20:41:20.340133 | controller | - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.340138 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.340144 | controller | - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.340150 | controller | on port 15671...' 2025-10-13 20:41:20.340156 | controller | - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.340161 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.340167 | controller | - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.340173 | controller | on port 15691...' 2025-10-13 20:41:20.340178 | controller | - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.340184 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.340190 | controller | - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.340196 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.340201 | controller | - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.340207 | controller | on port 3306...' 2025-10-13 20:41:20.340213 | controller | - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.340219 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.340224 | controller | - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.340230 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.340236 | controller | - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.340242 | controller | on port 3306...' 2025-10-13 20:41:20.340247 | controller | - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.340253 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.340259 | controller | - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.340272 | controller | had certificate mismatches:' 2025-10-13 20:41:20.340280 | controller | - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.340288 | controller | on port 1981' 2025-10-13 20:41:20.340296 | controller | - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.340304 | controller | on port 1981' 2025-10-13 20:41:20.340310 | controller | - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.340316 | controller | 2 additional commands' 2025-10-13 20:41:20.340325 | controller | - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.340331 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.340336 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.340342 | controller | - ' ]' 2025-10-13 20:41:20.340348 | controller | - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.340354 | controller | of non API service certificates...' 2025-10-13 20:41:20.340359 | controller | - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340365 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.340371 | controller | - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.340376 | controller | on port 15691...' 2025-10-13 20:41:20.340382 | controller | - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.340388 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.340396 | controller | - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.340414 | controller | on port 5671...' 2025-10-13 20:41:20.340422 | controller | - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.340428 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.340434 | controller | - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.340439 | controller | on port 15671...' 2025-10-13 20:41:20.340445 | controller | - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.340451 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.340456 | controller | - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340462 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.340468 | controller | - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.340477 | controller | on port 6642...' 2025-10-13 20:41:20.340482 | controller | - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.340488 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.340494 | controller | - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.340500 | controller | on port 6644...' 2025-10-13 20:41:20.340505 | controller | - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.340511 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.340517 | controller | - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.340523 | controller | on port 1981...' 2025-10-13 20:41:20.340528 | controller | - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.340534 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.340540 | controller | - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340546 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.340554 | controller | - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.340560 | controller | on port 6641...' 2025-10-13 20:41:20.340565 | controller | - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.340571 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.340577 | controller | - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.340588 | controller | on port 6643...' 2025-10-13 20:41:20.340593 | controller | - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.340602 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.340607 | controller | - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.340613 | controller | on port 1981...' 2025-10-13 20:41:20.340619 | controller | - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.340625 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.340630 | controller | - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340636 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.340642 | controller | - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.340648 | controller | on port 3000...' 2025-10-13 20:41:20.340653 | controller | - ' logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.340659 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.340665 | controller | - ' logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340678 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.340687 | controller | - ' logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.340695 | controller | on port 5671...' 2025-10-13 20:41:20.340703 | controller | - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.340711 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.340717 | controller | - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.340723 | controller | on port 15671...' 2025-10-13 20:41:20.340729 | controller | - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.340735 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.340740 | controller | - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.340746 | controller | on port 15691...' 2025-10-13 20:41:20.340752 | controller | - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.340758 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.340764 | controller | - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.340769 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.340775 | controller | - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.340781 | controller | on port 3306...' 2025-10-13 20:41:20.340787 | controller | - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.340792 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.340798 | controller | - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.340804 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.340810 | controller | - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.340815 | controller | on port 3306...' 2025-10-13 20:41:20.340821 | controller | - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.340827 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.340833 | controller | - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.340838 | controller | had certificate mismatches:' 2025-10-13 20:41:20.340844 | controller | - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.340850 | controller | on port 1981' 2025-10-13 20:41:20.340856 | controller | - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.340861 | controller | on port 1981' 2025-10-13 20:41:20.340870 | controller | - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.340876 | controller | 2 additional commands' 2025-10-13 20:41:20.340882 | controller | - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.340887 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.340893 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.340899 | controller | - ' ]' 2025-10-13 20:41:20.340905 | controller | - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.340910 | controller | of non API service certificates...' 2025-10-13 20:41:20.340916 | controller | - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.340922 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.340928 | controller | - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.340933 | controller | on port 15691...' 2025-10-13 20:41:20.340939 | controller | - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.340945 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.340951 | controller | - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.340956 | controller | on port 5671...' 2025-10-13 20:41:20.340962 | controller | - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.340968 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.340974 | controller | - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.340979 | controller | on port 15671...' 2025-10-13 20:41:20.340985 | controller | - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.340991 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.340997 | controller | - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341002 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.341008 | controller | - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.341017 | controller | on port 6642...' 2025-10-13 20:41:20.341023 | controller | - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.341028 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.341034 | controller | - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.341040 | controller | on port 6644...' 2025-10-13 20:41:20.341046 | controller | - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.341051 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.341065 | controller | - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.341073 | controller | on port 1981...' 2025-10-13 20:41:20.341081 | controller | - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.341089 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.341097 | controller | - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341103 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.341109 | controller | - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.341114 | controller | on port 6641...' 2025-10-13 20:41:20.341120 | controller | - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.341126 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.341132 | controller | - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.341141 | controller | on port 6643...' 2025-10-13 20:41:20.341147 | controller | - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.341153 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.341158 | controller | - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.341164 | controller | on port 1981...' 2025-10-13 20:41:20.341170 | controller | - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.341176 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.341181 | controller | - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341187 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.341193 | controller | - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.341202 | controller | on port 3000...' 2025-10-13 20:41:20.341208 | controller | - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.341213 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.341219 | controller | - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341225 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.341230 | controller | - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.341236 | controller | on port 5671...' 2025-10-13 20:41:20.341242 | controller | - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.341247 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.341253 | controller | - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.341259 | controller | on port 15671...' 2025-10-13 20:41:20.341265 | controller | - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.341270 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.341276 | controller | - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.341282 | controller | on port 15691...' 2025-10-13 20:41:20.341287 | controller | - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.341293 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.341299 | controller | - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.341304 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.341310 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.341316 | controller | on port 3306...' 2025-10-13 20:41:20.341321 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.341327 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.341333 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.341339 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.341344 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.341350 | controller | on port 3306...' 2025-10-13 20:41:20.341355 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.341361 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.341367 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.341373 | controller | had certificate mismatches:' 2025-10-13 20:41:20.341378 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.341384 | controller | on port 1981' 2025-10-13 20:41:20.341395 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.341413 | controller | on port 1981' 2025-10-13 20:41:20.341421 | controller | - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.341427 | controller | 2 additional commands' 2025-10-13 20:41:20.341433 | controller | - ' logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.341439 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.341444 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.341450 | controller | - ' ]' 2025-10-13 20:41:20.341463 | controller | - ' logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.341471 | controller | of non API service certificates...' 2025-10-13 20:41:20.341479 | controller | - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341487 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.341494 | controller | - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.341501 | controller | on port 15691...' 2025-10-13 20:41:20.341507 | controller | - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.341513 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.341518 | controller | - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.341524 | controller | on port 5671...' 2025-10-13 20:41:20.341530 | controller | - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.341535 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.341541 | controller | - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.341547 | controller | on port 15671...' 2025-10-13 20:41:20.341552 | controller | - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.341558 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.341564 | controller | - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341569 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.341575 | controller | - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.341581 | controller | on port 6642...' 2025-10-13 20:41:20.341586 | controller | - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.341592 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.341598 | controller | - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.341604 | controller | on port 6644...' 2025-10-13 20:41:20.341609 | controller | - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.341615 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.341620 | controller | - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.341626 | controller | on port 1981...' 2025-10-13 20:41:20.341632 | controller | - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.341637 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.341643 | controller | - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341649 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.341654 | controller | - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.341660 | controller | on port 6641...' 2025-10-13 20:41:20.341666 | controller | - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.341675 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.341681 | controller | - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.341686 | controller | on port 6643...' 2025-10-13 20:41:20.341692 | controller | - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.341698 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.341703 | controller | - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.341709 | controller | on port 1981...' 2025-10-13 20:41:20.341715 | controller | - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.341720 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.341726 | controller | - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341732 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.341737 | controller | - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.341743 | controller | on port 3000...' 2025-10-13 20:41:20.341749 | controller | - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.341754 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.341760 | controller | - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.341765 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.341771 | controller | - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.341777 | controller | on port 5671...' 2025-10-13 20:41:20.341782 | controller | - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.341788 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.341794 | controller | - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.341800 | controller | on port 15671...' 2025-10-13 20:41:20.341805 | controller | - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.341823 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.341828 | controller | - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.341842 | controller | on port 15691...' 2025-10-13 20:41:20.341850 | controller | - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.341861 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.341868 | controller | - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.341876 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.341882 | controller | - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.341888 | controller | on port 3306...' 2025-10-13 20:41:20.341893 | controller | - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.341899 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.341905 | controller | - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.341910 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.341916 | controller | - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.341922 | controller | on port 3306...' 2025-10-13 20:41:20.341930 | controller | - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.341936 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.341942 | controller | - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.341947 | controller | had certificate mismatches:' 2025-10-13 20:41:20.341958 | controller | - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.341964 | controller | on port 1981' 2025-10-13 20:41:20.341970 | controller | - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.341977 | controller | on port 1981' 2025-10-13 20:41:20.341984 | controller | - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.341989 | controller | 2 additional commands' 2025-10-13 20:41:20.341995 | controller | - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.342001 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.342006 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.342012 | controller | - ' ]' 2025-10-13 20:41:20.342018 | controller | - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.342023 | controller | of non API service certificates...' 2025-10-13 20:41:20.342029 | controller | - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342035 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.342040 | controller | - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.342046 | controller | on port 15691...' 2025-10-13 20:41:20.342052 | controller | - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.342057 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.342063 | controller | - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.342069 | controller | on port 5671...' 2025-10-13 20:41:20.342074 | controller | - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.342080 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.342086 | controller | - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.342091 | controller | on port 15671...' 2025-10-13 20:41:20.342097 | controller | - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.342103 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.342108 | controller | - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342114 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.342120 | controller | - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.342128 | controller | on port 6642...' 2025-10-13 20:41:20.342133 | controller | - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.342139 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.342145 | controller | - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.342151 | controller | on port 6644...' 2025-10-13 20:41:20.342156 | controller | - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.342162 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.342168 | controller | - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.342174 | controller | on port 1981...' 2025-10-13 20:41:20.342179 | controller | - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.342185 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.342191 | controller | - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342197 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.342202 | controller | - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.342213 | controller | on port 6641...' 2025-10-13 20:41:20.342219 | controller | - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.342224 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.342239 | controller | - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.342247 | controller | on port 6643...' 2025-10-13 20:41:20.342254 | controller | - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.342262 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.342270 | controller | - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.342276 | controller | on port 1981...' 2025-10-13 20:41:20.342282 | controller | - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.342287 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.342293 | controller | - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342299 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.342305 | controller | - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.342310 | controller | on port 3000...' 2025-10-13 20:41:20.342316 | controller | - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.342322 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.342327 | controller | - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342333 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.342339 | controller | - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.342344 | controller | on port 5671...' 2025-10-13 20:41:20.342350 | controller | - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.342356 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.342361 | controller | - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.342367 | controller | on port 15671...' 2025-10-13 20:41:20.342373 | controller | - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.342378 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.342384 | controller | - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.342390 | controller | on port 15691...' 2025-10-13 20:41:20.342398 | controller | - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.342419 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.342424 | controller | - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.342430 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.342436 | controller | - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.342441 | controller | on port 3306...' 2025-10-13 20:41:20.342447 | controller | - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.342453 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.342458 | controller | - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.342464 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.342470 | controller | - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.342475 | controller | on port 3306...' 2025-10-13 20:41:20.342481 | controller | - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.342487 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.342500 | controller | - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.342506 | controller | had certificate mismatches:' 2025-10-13 20:41:20.342511 | controller | - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.342517 | controller | on port 1981' 2025-10-13 20:41:20.342523 | controller | - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.342528 | controller | on port 1981' 2025-10-13 20:41:20.342534 | controller | - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.342540 | controller | 2 additional commands' 2025-10-13 20:41:20.342545 | controller | - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.342551 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.342557 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.342562 | controller | - ' ]' 2025-10-13 20:41:20.342568 | controller | - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.342573 | controller | of non API service certificates...' 2025-10-13 20:41:20.342579 | controller | - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342585 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.342591 | controller | - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.342596 | controller | on port 15691...' 2025-10-13 20:41:20.342602 | controller | - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.342608 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.342613 | controller | - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.342619 | controller | on port 5671...' 2025-10-13 20:41:20.342632 | controller | - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.342640 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.342648 | controller | - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.342656 | controller | on port 15671...' 2025-10-13 20:41:20.342663 | controller | - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.342669 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.342675 | controller | - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342680 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.342686 | controller | - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.342695 | controller | on port 6642...' 2025-10-13 20:41:20.342701 | controller | - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.342707 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.342712 | controller | - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.342721 | controller | on port 6644...' 2025-10-13 20:41:20.342726 | controller | - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.342732 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.342738 | controller | - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.342743 | controller | on port 1981...' 2025-10-13 20:41:20.342749 | controller | - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.342755 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.342760 | controller | - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342766 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.342775 | controller | - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.342781 | controller | on port 6641...' 2025-10-13 20:41:20.342787 | controller | - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.342792 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.342798 | controller | - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.342804 | controller | on port 6643...' 2025-10-13 20:41:20.342809 | controller | - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.342815 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.342821 | controller | - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.342826 | controller | on port 1981...' 2025-10-13 20:41:20.342832 | controller | - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.342838 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.342843 | controller | - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342849 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.342855 | controller | - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.342863 | controller | on port 3000...' 2025-10-13 20:41:20.342869 | controller | - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.342874 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.342880 | controller | - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.342886 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.342892 | controller | - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.342897 | controller | on port 5671...' 2025-10-13 20:41:20.342903 | controller | - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.342909 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.342914 | controller | - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.342920 | controller | on port 15671...' 2025-10-13 20:41:20.342926 | controller | - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.342931 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.342937 | controller | - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.342943 | controller | on port 15691...' 2025-10-13 20:41:20.342948 | controller | - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.342954 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.342960 | controller | - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.342965 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.342971 | controller | - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.342977 | controller | on port 3306...' 2025-10-13 20:41:20.342982 | controller | - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.342988 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.342994 | controller | - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.343024 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.343033 | controller | - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.343041 | controller | on port 3306...' 2025-10-13 20:41:20.343049 | controller | - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.343086 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.343092 | controller | - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.343098 | controller | had certificate mismatches:' 2025-10-13 20:41:20.343104 | controller | - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.343109 | controller | on port 1981' 2025-10-13 20:41:20.343115 | controller | - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.343121 | controller | on port 1981' 2025-10-13 20:41:20.343126 | controller | - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.343132 | controller | 2 additional commands' 2025-10-13 20:41:20.343138 | controller | - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.343143 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.343149 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.343155 | controller | - ' ]' 2025-10-13 20:41:20.343160 | controller | - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.343166 | controller | of non API service certificates...' 2025-10-13 20:41:20.343172 | controller | - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343177 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.343183 | controller | - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.343189 | controller | on port 15691...' 2025-10-13 20:41:20.343194 | controller | - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.343200 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.343206 | controller | - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.343211 | controller | on port 5671...' 2025-10-13 20:41:20.343217 | controller | - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.343223 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.343228 | controller | - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.343234 | controller | on port 15671...' 2025-10-13 20:41:20.343240 | controller | - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.343245 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.343251 | controller | - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343257 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.343262 | controller | - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.343268 | controller | on port 6642...' 2025-10-13 20:41:20.343274 | controller | - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.343279 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.343285 | controller | - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.343291 | controller | on port 6644...' 2025-10-13 20:41:20.343296 | controller | - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.343302 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.343308 | controller | - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.343313 | controller | on port 1981...' 2025-10-13 20:41:20.343319 | controller | - ' logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.343325 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.343333 | controller | - ' logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343339 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.343345 | controller | - ' logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.343350 | controller | on port 6641...' 2025-10-13 20:41:20.343356 | controller | - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.343362 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.343367 | controller | - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.343376 | controller | on port 6643...' 2025-10-13 20:41:20.343382 | controller | - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.343388 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.343393 | controller | - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.343418 | controller | on port 1981...' 2025-10-13 20:41:20.343430 | controller | - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.343438 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.343444 | controller | - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343450 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.343463 | controller | - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.343472 | controller | on port 3000...' 2025-10-13 20:41:20.343480 | controller | - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.343487 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.343495 | controller | - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343502 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.343509 | controller | - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.343514 | controller | on port 5671...' 2025-10-13 20:41:20.343520 | controller | - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.343526 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.343532 | controller | - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.343537 | controller | on port 15671...' 2025-10-13 20:41:20.343543 | controller | - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.343549 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.343554 | controller | - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.343560 | controller | on port 15691...' 2025-10-13 20:41:20.343566 | controller | - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.343571 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.343577 | controller | - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.343583 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.343588 | controller | - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.343594 | controller | on port 3306...' 2025-10-13 20:41:20.343600 | controller | - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.343605 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.343611 | controller | - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.343617 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.343622 | controller | - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.343632 | controller | on port 3306...' 2025-10-13 20:41:20.343637 | controller | - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.343643 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.343649 | controller | - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.343654 | controller | had certificate mismatches:' 2025-10-13 20:41:20.343660 | controller | - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.343666 | controller | on port 1981' 2025-10-13 20:41:20.343671 | controller | - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.343677 | controller | on port 1981' 2025-10-13 20:41:20.343683 | controller | - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.343688 | controller | 2 additional commands' 2025-10-13 20:41:20.343697 | controller | - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.343703 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.343709 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.343714 | controller | - ' ]' 2025-10-13 20:41:20.343720 | controller | - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.343726 | controller | of non API service certificates...' 2025-10-13 20:41:20.343732 | controller | - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343737 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.343743 | controller | - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.343749 | controller | on port 15691...' 2025-10-13 20:41:20.343754 | controller | - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.343760 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.343766 | controller | - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.343771 | controller | on port 5671...' 2025-10-13 20:41:20.343777 | controller | - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.343783 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.343788 | controller | - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.343794 | controller | on port 15671...' 2025-10-13 20:41:20.343800 | controller | - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.343805 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.343813 | controller | - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343819 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.343825 | controller | - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.343831 | controller | on port 6642...' 2025-10-13 20:41:20.343844 | controller | - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.343853 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.343861 | controller | - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.343868 | controller | on port 6644...' 2025-10-13 20:41:20.343876 | controller | - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.343882 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.343888 | controller | - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.343896 | controller | on port 1981...' 2025-10-13 20:41:20.343902 | controller | - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.343911 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.343916 | controller | - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.343922 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.343928 | controller | - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.343934 | controller | on port 6641...' 2025-10-13 20:41:20.343939 | controller | - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.343945 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.343951 | controller | - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.343956 | controller | on port 6643...' 2025-10-13 20:41:20.343962 | controller | - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.343968 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.343973 | controller | - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.343979 | controller | on port 1981...' 2025-10-13 20:41:20.343985 | controller | - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.343990 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.343996 | controller | - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344002 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.344008 | controller | - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.344013 | controller | on port 3000...' 2025-10-13 20:41:20.344019 | controller | - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.344025 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.344030 | controller | - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344036 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.344042 | controller | - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.344047 | controller | on port 5671...' 2025-10-13 20:41:20.344053 | controller | - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.344061 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.344067 | controller | - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.344073 | controller | on port 15671...' 2025-10-13 20:41:20.344079 | controller | - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.344084 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.344090 | controller | - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.344096 | controller | on port 15691...' 2025-10-13 20:41:20.344101 | controller | - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.344107 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.344113 | controller | - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.344119 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.344124 | controller | - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.344130 | controller | on port 3306...' 2025-10-13 20:41:20.344135 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.344141 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.344147 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.344155 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.344161 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.344167 | controller | on port 3306...' 2025-10-13 20:41:20.344172 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.344178 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.344184 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.344189 | controller | had certificate mismatches:' 2025-10-13 20:41:20.344195 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.344201 | controller | on port 1981' 2025-10-13 20:41:20.344206 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.344212 | controller | on port 1981' 2025-10-13 20:41:20.344225 | controller | - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.344233 | controller | 2 additional commands' 2025-10-13 20:41:20.344241 | controller | - ' logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.344249 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.344256 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.344262 | controller | - ' ]' 2025-10-13 20:41:20.344268 | controller | - ' logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.344274 | controller | of non API service certificates...' 2025-10-13 20:41:20.344279 | controller | - ' logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344285 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.344291 | controller | - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.344296 | controller | on port 15691...' 2025-10-13 20:41:20.344302 | controller | - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.344308 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.344314 | controller | - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.344319 | controller | on port 5671...' 2025-10-13 20:41:20.344325 | controller | - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.344331 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.344336 | controller | - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.344342 | controller | on port 15671...' 2025-10-13 20:41:20.344348 | controller | - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.344353 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.344359 | controller | - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344365 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.344370 | controller | - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.344382 | controller | on port 6642...' 2025-10-13 20:41:20.344388 | controller | - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.344396 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.344417 | controller | - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.344423 | controller | on port 6644...' 2025-10-13 20:41:20.344429 | controller | - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.344435 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.344440 | controller | - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.344449 | controller | on port 1981...' 2025-10-13 20:41:20.344455 | controller | - ' logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.344460 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.344466 | controller | - ' logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344472 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.344477 | controller | - ' logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.344483 | controller | on port 6641...' 2025-10-13 20:41:20.344489 | controller | - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.344495 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.344500 | controller | - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.344506 | controller | on port 6643...' 2025-10-13 20:41:20.344512 | controller | - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.344517 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.344523 | controller | - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.344529 | controller | on port 1981...' 2025-10-13 20:41:20.344534 | controller | - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.344540 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.344546 | controller | - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344551 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.344557 | controller | - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.344563 | controller | on port 3000...' 2025-10-13 20:41:20.344568 | controller | - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.344574 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.344580 | controller | - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344585 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.344591 | controller | - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.344597 | controller | on port 5671...' 2025-10-13 20:41:20.344602 | controller | - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.344616 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.344624 | controller | - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.344632 | controller | on port 15671...' 2025-10-13 20:41:20.344640 | controller | - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.344648 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.344654 | controller | - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.344660 | controller | on port 15691...' 2025-10-13 20:41:20.344666 | controller | - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.344672 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.344677 | controller | - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.344683 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.344689 | controller | - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.344694 | controller | on port 3306...' 2025-10-13 20:41:20.344700 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.344712 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.344718 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.344723 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.344729 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.344735 | controller | on port 3306...' 2025-10-13 20:41:20.344741 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.344746 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.344752 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.344758 | controller | had certificate mismatches:' 2025-10-13 20:41:20.344763 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.344769 | controller | on port 1981' 2025-10-13 20:41:20.344775 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.344780 | controller | on port 1981' 2025-10-13 20:41:20.344786 | controller | - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.344792 | controller | 2 additional commands' 2025-10-13 20:41:20.344797 | controller | - ' logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.344803 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.344809 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.344815 | controller | - ' ]' 2025-10-13 20:41:20.344820 | controller | - ' logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.344826 | controller | of non API service certificates...' 2025-10-13 20:41:20.344832 | controller | - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344837 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.344843 | controller | - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.344849 | controller | on port 15691...' 2025-10-13 20:41:20.344854 | controller | - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.344860 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.344866 | controller | - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.344871 | controller | on port 5671...' 2025-10-13 20:41:20.344877 | controller | - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.344883 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.344888 | controller | - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.344894 | controller | on port 15671...' 2025-10-13 20:41:20.344900 | controller | - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.344905 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.344911 | controller | - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.344917 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.344922 | controller | - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.344928 | controller | on port 6642...' 2025-10-13 20:41:20.344934 | controller | - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.344939 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.344945 | controller | - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.344951 | controller | on port 6644...' 2025-10-13 20:41:20.344957 | controller | - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.344965 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.344971 | controller | - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.344977 | controller | on port 1981...' 2025-10-13 20:41:20.344982 | controller | - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.344988 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.345002 | controller | - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345010 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.345018 | controller | - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.345029 | controller | on port 6641...' 2025-10-13 20:41:20.345037 | controller | - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.345044 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.345051 | controller | - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.345058 | controller | on port 6643...' 2025-10-13 20:41:20.345065 | controller | - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.345072 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.345078 | controller | - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.345083 | controller | on port 1981...' 2025-10-13 20:41:20.345089 | controller | - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.345095 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.345100 | controller | - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345106 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.345112 | controller | - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.345117 | controller | on port 3000...' 2025-10-13 20:41:20.345123 | controller | - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.345129 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.345134 | controller | - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345140 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.345146 | controller | - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.345152 | controller | on port 5671...' 2025-10-13 20:41:20.345157 | controller | - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.345163 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.345169 | controller | - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.345174 | controller | on port 15671...' 2025-10-13 20:41:20.345183 | controller | - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.345188 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.345194 | controller | - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.345200 | controller | on port 15691...' 2025-10-13 20:41:20.345206 | controller | - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.345211 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.345217 | controller | - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.345223 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.345228 | controller | - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.345239 | controller | on port 3306...' 2025-10-13 20:41:20.345244 | controller | - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.345250 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.345256 | controller | - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.345262 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.345267 | controller | - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.345273 | controller | on port 3306...' 2025-10-13 20:41:20.345279 | controller | - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.345284 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.345290 | controller | - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.345296 | controller | had certificate mismatches:' 2025-10-13 20:41:20.345301 | controller | - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.345307 | controller | on port 1981' 2025-10-13 20:41:20.345313 | controller | - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.345319 | controller | on port 1981' 2025-10-13 20:41:20.345324 | controller | - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.345330 | controller | 2 additional commands' 2025-10-13 20:41:20.345336 | controller | - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.345341 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.345347 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.345353 | controller | - ' ]' 2025-10-13 20:41:20.345358 | controller | - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.345364 | controller | of non API service certificates...' 2025-10-13 20:41:20.345370 | controller | - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345375 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.345390 | controller | - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.345413 | controller | on port 15691...' 2025-10-13 20:41:20.345425 | controller | - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.345431 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.345437 | controller | - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.345442 | controller | on port 5671...' 2025-10-13 20:41:20.345448 | controller | - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.345454 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.345460 | controller | - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.345465 | controller | on port 15671...' 2025-10-13 20:41:20.345471 | controller | - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.345477 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.345483 | controller | - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345489 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.345494 | controller | - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.345500 | controller | on port 6642...' 2025-10-13 20:41:20.345506 | controller | - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.345512 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.345517 | controller | - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.345531 | controller | on port 6644...' 2025-10-13 20:41:20.345537 | controller | - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.345544 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.345550 | controller | - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.345558 | controller | on port 1981...' 2025-10-13 20:41:20.345564 | controller | - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.345570 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.345576 | controller | - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345581 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.345587 | controller | - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.345593 | controller | on port 6641...' 2025-10-13 20:41:20.345598 | controller | - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.345604 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.345610 | controller | - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.345616 | controller | on port 6643...' 2025-10-13 20:41:20.345621 | controller | - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.345627 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.345633 | controller | - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.345638 | controller | on port 1981...' 2025-10-13 20:41:20.345644 | controller | - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.345650 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.345656 | controller | - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345661 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.345667 | controller | - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.345673 | controller | on port 3000...' 2025-10-13 20:41:20.345678 | controller | - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.345684 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.345690 | controller | - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345696 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.345701 | controller | - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.345707 | controller | on port 5671...' 2025-10-13 20:41:20.345713 | controller | - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.345718 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.345724 | controller | - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.345730 | controller | on port 15671...' 2025-10-13 20:41:20.345736 | controller | - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.345741 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.345747 | controller | - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.345753 | controller | on port 15691...' 2025-10-13 20:41:20.345758 | controller | - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.345764 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.345770 | controller | - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.345783 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.345795 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.345803 | controller | on port 3306...' 2025-10-13 20:41:20.345810 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.345817 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.345823 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.345829 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.345835 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.345840 | controller | on port 3306...' 2025-10-13 20:41:20.345846 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.345852 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.345857 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.345863 | controller | had certificate mismatches:' 2025-10-13 20:41:20.345869 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.345875 | controller | on port 1981' 2025-10-13 20:41:20.345880 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.345886 | controller | on port 1981' 2025-10-13 20:41:20.345892 | controller | - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.345897 | controller | 2 additional commands' 2025-10-13 20:41:20.345903 | controller | - ' logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.345909 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.345914 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.345920 | controller | - ' ]' 2025-10-13 20:41:20.345926 | controller | - ' logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.345931 | controller | of non API service certificates...' 2025-10-13 20:41:20.345937 | controller | - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.345943 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.345948 | controller | - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.345954 | controller | on port 15691...' 2025-10-13 20:41:20.345960 | controller | - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.345965 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.345971 | controller | - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.345977 | controller | on port 5671...' 2025-10-13 20:41:20.345982 | controller | - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.345988 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.345994 | controller | - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.345999 | controller | on port 15671...' 2025-10-13 20:41:20.346005 | controller | - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.346011 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.346016 | controller | - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346022 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.346028 | controller | - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.346038 | controller | on port 6642...' 2025-10-13 20:41:20.346043 | controller | - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.346052 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.346058 | controller | - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.346064 | controller | on port 6644...' 2025-10-13 20:41:20.346070 | controller | - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.346075 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.346081 | controller | - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.346087 | controller | on port 1981...' 2025-10-13 20:41:20.346092 | controller | - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.346098 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.346104 | controller | - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346110 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.346115 | controller | - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.346121 | controller | on port 6641...' 2025-10-13 20:41:20.346127 | controller | - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.346132 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.346138 | controller | - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.346144 | controller | on port 6643...' 2025-10-13 20:41:20.346150 | controller | - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.346155 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.346168 | controller | - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.346182 | controller | on port 1981...' 2025-10-13 20:41:20.346190 | controller | - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.346198 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.346204 | controller | - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346209 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.346215 | controller | - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.346224 | controller | on port 3000...' 2025-10-13 20:41:20.346229 | controller | - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.346235 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.346241 | controller | - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346247 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.346252 | controller | - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.346258 | controller | on port 5671...' 2025-10-13 20:41:20.346264 | controller | - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.346269 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.346275 | controller | - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.346281 | controller | on port 15671...' 2025-10-13 20:41:20.346287 | controller | - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.346292 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.346298 | controller | - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.346304 | controller | on port 15691...' 2025-10-13 20:41:20.346309 | controller | - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.346315 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.346324 | controller | - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.346329 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.346335 | controller | - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.346341 | controller | on port 3306...' 2025-10-13 20:41:20.346346 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.346352 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.346358 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.346363 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.346369 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.346375 | controller | on port 3306...' 2025-10-13 20:41:20.346381 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.346386 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.346395 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.346413 | controller | had certificate mismatches:' 2025-10-13 20:41:20.346421 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.346427 | controller | on port 1981' 2025-10-13 20:41:20.346433 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.346438 | controller | on port 1981' 2025-10-13 20:41:20.346444 | controller | - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.346450 | controller | 2 additional commands' 2025-10-13 20:41:20.346455 | controller | - ' logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.346461 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.346467 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.346472 | controller | - ' ]' 2025-10-13 20:41:20.346478 | controller | - ' logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.346484 | controller | of non API service certificates...' 2025-10-13 20:41:20.346489 | controller | - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346495 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.346501 | controller | - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.346506 | controller | on port 15691...' 2025-10-13 20:41:20.346512 | controller | - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.346518 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.346523 | controller | - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.346529 | controller | on port 5671...' 2025-10-13 20:41:20.346535 | controller | - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.346541 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.346546 | controller | - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.346552 | controller | on port 15671...' 2025-10-13 20:41:20.346558 | controller | - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.346570 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.346579 | controller | - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346586 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.346594 | controller | - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.346608 | controller | on port 6642...' 2025-10-13 20:41:20.346614 | controller | - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.346620 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.346626 | controller | - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.346632 | controller | on port 6644...' 2025-10-13 20:41:20.346637 | controller | - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.346643 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.346649 | controller | - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.346654 | controller | on port 1981...' 2025-10-13 20:41:20.346660 | controller | - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.346666 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.346672 | controller | - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346677 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.346683 | controller | - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.346689 | controller | on port 6641...' 2025-10-13 20:41:20.346694 | controller | - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.346700 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.346706 | controller | - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.346711 | controller | on port 6643...' 2025-10-13 20:41:20.346717 | controller | - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.346723 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.346728 | controller | - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.346734 | controller | on port 1981...' 2025-10-13 20:41:20.346740 | controller | - ' logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.346746 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.346751 | controller | - ' logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346757 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.346763 | controller | - ' logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.346768 | controller | on port 3000...' 2025-10-13 20:41:20.346774 | controller | - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.346780 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.346785 | controller | - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.346791 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.346797 | controller | - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.346803 | controller | on port 5671...' 2025-10-13 20:41:20.346808 | controller | - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.346814 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.346820 | controller | - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.346825 | controller | on port 15671...' 2025-10-13 20:41:20.346831 | controller | - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.346840 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.346846 | controller | - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.346851 | controller | on port 15691...' 2025-10-13 20:41:20.346860 | controller | - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.346865 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.346871 | controller | - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.346877 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.346883 | controller | - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.346888 | controller | on port 3306...' 2025-10-13 20:41:20.346894 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.346900 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.346905 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.346911 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.346917 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.346923 | controller | on port 3306...' 2025-10-13 20:41:20.346928 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.346934 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.346947 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.346955 | controller | had certificate mismatches:' 2025-10-13 20:41:20.346963 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.346970 | controller | on port 1981' 2025-10-13 20:41:20.346978 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.346983 | controller | on port 1981' 2025-10-13 20:41:20.346989 | controller | - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.346995 | controller | 2 additional commands' 2025-10-13 20:41:20.347000 | controller | - ' logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.347006 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.347012 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.347018 | controller | - ' ]' 2025-10-13 20:41:20.347023 | controller | - ' logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.347033 | controller | of non API service certificates...' 2025-10-13 20:41:20.347058 | controller | - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347064 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.347070 | controller | - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.347075 | controller | on port 15691...' 2025-10-13 20:41:20.347081 | controller | - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.347087 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.347093 | controller | - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.347098 | controller | on port 5671...' 2025-10-13 20:41:20.347104 | controller | - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.347110 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.347116 | controller | - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.347122 | controller | on port 15671...' 2025-10-13 20:41:20.347127 | controller | - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.347133 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.347139 | controller | - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347144 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.347153 | controller | - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.347162 | controller | on port 6642...' 2025-10-13 20:41:20.347168 | controller | - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.347174 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.347179 | controller | - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.347185 | controller | on port 6644...' 2025-10-13 20:41:20.347191 | controller | - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.347196 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.347202 | controller | - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.347208 | controller | on port 1981...' 2025-10-13 20:41:20.347214 | controller | - ' logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.347219 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.347225 | controller | - ' logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347231 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.347236 | controller | - ' logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.347242 | controller | on port 6641...' 2025-10-13 20:41:20.347248 | controller | - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.347253 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.347259 | controller | - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.347265 | controller | on port 6643...' 2025-10-13 20:41:20.347271 | controller | - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.347276 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.347282 | controller | - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.347288 | controller | on port 1981...' 2025-10-13 20:41:20.347293 | controller | - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.347299 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.347305 | controller | - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347310 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.347316 | controller | - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.347322 | controller | on port 3000...' 2025-10-13 20:41:20.347328 | controller | - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.347333 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.347347 | controller | - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347354 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.347362 | controller | - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.347370 | controller | on port 5671...' 2025-10-13 20:41:20.347377 | controller | - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.347388 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.347394 | controller | - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.347414 | controller | on port 15671...' 2025-10-13 20:41:20.347423 | controller | - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.347429 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.347437 | controller | - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.347443 | controller | on port 15691...' 2025-10-13 20:41:20.347449 | controller | - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.347455 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.347460 | controller | - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.347466 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.347472 | controller | - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.347477 | controller | on port 3306...' 2025-10-13 20:41:20.347483 | controller | - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.347489 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.347494 | controller | - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.347500 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.347506 | controller | - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.347512 | controller | on port 3306...' 2025-10-13 20:41:20.347517 | controller | - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.347523 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.347529 | controller | - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.347534 | controller | had certificate mismatches:' 2025-10-13 20:41:20.347540 | controller | - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.347546 | controller | on port 1981' 2025-10-13 20:41:20.347551 | controller | - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.347557 | controller | on port 1981' 2025-10-13 20:41:20.347563 | controller | - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.347568 | controller | 2 additional commands' 2025-10-13 20:41:20.347574 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.347580 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.347588 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.347594 | controller | - ' ]' 2025-10-13 20:41:20.347600 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.347605 | controller | of non API service certificates...' 2025-10-13 20:41:20.347611 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347617 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.347622 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.347628 | controller | on port 15691...' 2025-10-13 20:41:20.347634 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.347640 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.347645 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.347651 | controller | on port 5671...' 2025-10-13 20:41:20.347657 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.347662 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.347668 | controller | - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.347674 | controller | on port 15671...' 2025-10-13 20:41:20.347679 | controller | - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.347685 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.347693 | controller | - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347699 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.347705 | controller | - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.347713 | controller | on port 6642...' 2025-10-13 20:41:20.347719 | controller | - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.347725 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.347730 | controller | - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.347736 | controller | on port 6644...' 2025-10-13 20:41:20.347750 | controller | - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.347758 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.347766 | controller | - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.347773 | controller | on port 1981...' 2025-10-13 20:41:20.347781 | controller | - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.347788 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.347794 | controller | - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347800 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.347805 | controller | - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.347811 | controller | on port 6641...' 2025-10-13 20:41:20.347817 | controller | - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.347822 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.347828 | controller | - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.347834 | controller | on port 6643...' 2025-10-13 20:41:20.347840 | controller | - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.347845 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.347851 | controller | - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.347857 | controller | on port 1981...' 2025-10-13 20:41:20.347862 | controller | - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.347868 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.347874 | controller | - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347879 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.347885 | controller | - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.347891 | controller | on port 3000...' 2025-10-13 20:41:20.347896 | controller | - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.347902 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.347908 | controller | - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.347914 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.347919 | controller | - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.347925 | controller | on port 5671...' 2025-10-13 20:41:20.347931 | controller | - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.347936 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.347942 | controller | - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.347948 | controller | on port 15671...' 2025-10-13 20:41:20.347954 | controller | - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.347963 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.347968 | controller | - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.347974 | controller | on port 15691...' 2025-10-13 20:41:20.347980 | controller | - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.347986 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.347991 | controller | - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.347997 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.348003 | controller | - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.348009 | controller | on port 3306...' 2025-10-13 20:41:20.348014 | controller | - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.348020 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.348026 | controller | - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.348031 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.348037 | controller | - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.348043 | controller | on port 3306...' 2025-10-13 20:41:20.348049 | controller | - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.348054 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.348060 | controller | - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.348066 | controller | had certificate mismatches:' 2025-10-13 20:41:20.348071 | controller | - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.348077 | controller | on port 1981' 2025-10-13 20:41:20.348083 | controller | - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.348089 | controller | on port 1981' 2025-10-13 20:41:20.348094 | controller | - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.348100 | controller | 2 additional commands' 2025-10-13 20:41:20.348106 | controller | - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.348111 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.348125 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.348133 | controller | - ' ]' 2025-10-13 20:41:20.348140 | controller | - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.348148 | controller | of non API service certificates...' 2025-10-13 20:41:20.348155 | controller | - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348162 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.348168 | controller | - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.348174 | controller | on port 15691...' 2025-10-13 20:41:20.348179 | controller | - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.348185 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.348191 | controller | - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.348196 | controller | on port 5671...' 2025-10-13 20:41:20.348202 | controller | - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.348208 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.348213 | controller | - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.348219 | controller | on port 15671...' 2025-10-13 20:41:20.348225 | controller | - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.348236 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.348242 | controller | - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348247 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.348253 | controller | - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.348262 | controller | on port 6642...' 2025-10-13 20:41:20.348268 | controller | - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.348273 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.348279 | controller | - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.348285 | controller | on port 6644...' 2025-10-13 20:41:20.348291 | controller | - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.348296 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.348302 | controller | - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.348308 | controller | on port 1981...' 2025-10-13 20:41:20.348313 | controller | - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.348319 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.348325 | controller | - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348330 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.348336 | controller | - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.348345 | controller | on port 6641...' 2025-10-13 20:41:20.348350 | controller | - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.348356 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.348362 | controller | - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.348367 | controller | on port 6643...' 2025-10-13 20:41:20.348373 | controller | - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.348379 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.348384 | controller | - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.348390 | controller | on port 1981...' 2025-10-13 20:41:20.348410 | controller | - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.348419 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.348425 | controller | - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348431 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.348436 | controller | - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.348442 | controller | on port 3000...' 2025-10-13 20:41:20.348448 | controller | - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.348453 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.348459 | controller | - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348465 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.348470 | controller | - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.348476 | controller | on port 5671...' 2025-10-13 20:41:20.348482 | controller | - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.348487 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.348493 | controller | - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.348502 | controller | on port 15671...' 2025-10-13 20:41:20.348507 | controller | - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.348513 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.348527 | controller | - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.348535 | controller | on port 15691...' 2025-10-13 20:41:20.348543 | controller | - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.348550 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.348558 | controller | - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.348565 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.348571 | controller | - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.348577 | controller | on port 3306...' 2025-10-13 20:41:20.348582 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.348588 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.348594 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.348600 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.348605 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.348611 | controller | on port 3306...' 2025-10-13 20:41:20.348617 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.348622 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.348628 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.348634 | controller | had certificate mismatches:' 2025-10-13 20:41:20.348639 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.348645 | controller | on port 1981' 2025-10-13 20:41:20.348651 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.348656 | controller | on port 1981' 2025-10-13 20:41:20.348662 | controller | - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.348668 | controller | 2 additional commands' 2025-10-13 20:41:20.348674 | controller | - ' logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.348679 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.348685 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.348691 | controller | - ' ]' 2025-10-13 20:41:20.348696 | controller | - ' logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.348702 | controller | of non API service certificates...' 2025-10-13 20:41:20.348708 | controller | - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348714 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.348719 | controller | - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.348725 | controller | on port 15691...' 2025-10-13 20:41:20.348731 | controller | - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.348737 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.348743 | controller | - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.348748 | controller | on port 5671...' 2025-10-13 20:41:20.348754 | controller | - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.348760 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.348766 | controller | - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.348774 | controller | on port 15671...' 2025-10-13 20:41:20.348780 | controller | - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.348786 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.348791 | controller | - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348797 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.348803 | controller | - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.348812 | controller | on port 6642...' 2025-10-13 20:41:20.348817 | controller | - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.348823 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.348829 | controller | - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.348834 | controller | on port 6644...' 2025-10-13 20:41:20.348840 | controller | - ' logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.348846 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.348851 | controller | - ' logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.348857 | controller | on port 1981...' 2025-10-13 20:41:20.348863 | controller | - ' logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.348868 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.348874 | controller | - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348880 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.348885 | controller | - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.348891 | controller | on port 6641...' 2025-10-13 20:41:20.348904 | controller | - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.348912 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.348920 | controller | - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.348927 | controller | on port 6643...' 2025-10-13 20:41:20.348935 | controller | - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.348942 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.348949 | controller | - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.348956 | controller | on port 1981...' 2025-10-13 20:41:20.348963 | controller | - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.348970 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.348977 | controller | - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.348983 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.348991 | controller | - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.349000 | controller | on port 3000...' 2025-10-13 20:41:20.349005 | controller | - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.349011 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.349017 | controller | - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349022 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.349028 | controller | - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.349034 | controller | on port 5671...' 2025-10-13 20:41:20.349040 | controller | - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.349048 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.349054 | controller | - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.349060 | controller | on port 15671...' 2025-10-13 20:41:20.349065 | controller | - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.349071 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.349077 | controller | - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.349082 | controller | on port 15691...' 2025-10-13 20:41:20.349088 | controller | - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.349094 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.349099 | controller | - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.349105 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.349111 | controller | - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.349116 | controller | on port 3306...' 2025-10-13 20:41:20.349122 | controller | - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.349128 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.349134 | controller | - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.349139 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.349145 | controller | - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.349151 | controller | on port 3306...' 2025-10-13 20:41:20.349156 | controller | - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.349162 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.349168 | controller | - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.349173 | controller | had certificate mismatches:' 2025-10-13 20:41:20.349179 | controller | - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.349185 | controller | on port 1981' 2025-10-13 20:41:20.349190 | controller | - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.349196 | controller | on port 1981' 2025-10-13 20:41:20.349202 | controller | - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.349208 | controller | 2 additional commands' 2025-10-13 20:41:20.349213 | controller | - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.349219 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.349225 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.349230 | controller | - ' ]' 2025-10-13 20:41:20.349236 | controller | - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.349242 | controller | of non API service certificates...' 2025-10-13 20:41:20.349247 | controller | - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349253 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.349259 | controller | - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.349264 | controller | on port 15691...' 2025-10-13 20:41:20.349270 | controller | - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.349276 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.349289 | controller | - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.349297 | controller | on port 5671...' 2025-10-13 20:41:20.349305 | controller | - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.349316 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.349323 | controller | - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.349329 | controller | on port 15671...' 2025-10-13 20:41:20.349335 | controller | - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.349340 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.349346 | controller | - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349352 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.349358 | controller | - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.349366 | controller | on port 6642...' 2025-10-13 20:41:20.349372 | controller | - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.349378 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.349384 | controller | - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.349389 | controller | on port 6644...' 2025-10-13 20:41:20.349398 | controller | - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.349419 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.349425 | controller | - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.349431 | controller | on port 1981...' 2025-10-13 20:41:20.349437 | controller | - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.349442 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.349448 | controller | - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349454 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.349460 | controller | - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.349465 | controller | on port 6641...' 2025-10-13 20:41:20.349471 | controller | - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.349477 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.349482 | controller | - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.349488 | controller | on port 6643...' 2025-10-13 20:41:20.349494 | controller | - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.349500 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.349505 | controller | - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.349511 | controller | on port 1981...' 2025-10-13 20:41:20.349517 | controller | - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.349522 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.349528 | controller | - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349534 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.349539 | controller | - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.349556 | controller | on port 3000...' 2025-10-13 20:41:20.349562 | controller | - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.349568 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.349573 | controller | - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349579 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.349585 | controller | - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.349593 | controller | on port 5671...' 2025-10-13 20:41:20.349599 | controller | - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.349605 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.349610 | controller | - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.349616 | controller | on port 15671...' 2025-10-13 20:41:20.349622 | controller | - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.349628 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.349633 | controller | - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.349639 | controller | on port 15691...' 2025-10-13 20:41:20.349645 | controller | - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.349653 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.349658 | controller | - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.349664 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.349670 | controller | - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.349676 | controller | on port 3306...' 2025-10-13 20:41:20.349681 | controller | - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.349687 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.349700 | controller | - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.349708 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.349716 | controller | - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.349724 | controller | on port 3306...' 2025-10-13 20:41:20.349732 | controller | - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.349738 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.349744 | controller | - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.349750 | controller | had certificate mismatches:' 2025-10-13 20:41:20.349755 | controller | - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.349761 | controller | on port 1981' 2025-10-13 20:41:20.349767 | controller | - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.349773 | controller | on port 1981' 2025-10-13 20:41:20.349781 | controller | - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.349787 | controller | 2 additional commands' 2025-10-13 20:41:20.349793 | controller | - ' logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.349798 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.349804 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.349810 | controller | - ' ]' 2025-10-13 20:41:20.349816 | controller | - ' logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.349821 | controller | of non API service certificates...' 2025-10-13 20:41:20.349827 | controller | - ' logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349833 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.349838 | controller | - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.349844 | controller | on port 15691...' 2025-10-13 20:41:20.349850 | controller | - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.349855 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.349861 | controller | - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.349872 | controller | on port 5671...' 2025-10-13 20:41:20.349878 | controller | - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.349884 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.349889 | controller | - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.349895 | controller | on port 15671...' 2025-10-13 20:41:20.349901 | controller | - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.349906 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.349912 | controller | - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.349918 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.349923 | controller | - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.349931 | controller | on port 6642...' 2025-10-13 20:41:20.349937 | controller | - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.349943 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.349949 | controller | - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.349954 | controller | on port 6644...' 2025-10-13 20:41:20.349960 | controller | - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.349966 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.349971 | controller | - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.349977 | controller | on port 1981...' 2025-10-13 20:41:20.349983 | controller | - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.349989 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.349994 | controller | - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350000 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.350006 | controller | - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.350011 | controller | on port 6641...' 2025-10-13 20:41:20.350017 | controller | - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.350023 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.350028 | controller | - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.350034 | controller | on port 6643...' 2025-10-13 20:41:20.350040 | controller | - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.350045 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.350051 | controller | - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.350057 | controller | on port 1981...' 2025-10-13 20:41:20.350062 | controller | - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.350068 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.350081 | controller | - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350089 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.350097 | controller | - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.350105 | controller | on port 3000...' 2025-10-13 20:41:20.350112 | controller | - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.350119 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.350126 | controller | - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350137 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.350144 | controller | - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.350151 | controller | on port 5671...' 2025-10-13 20:41:20.350158 | controller | - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.350165 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.350172 | controller | - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.350179 | controller | on port 15671...' 2025-10-13 20:41:20.350186 | controller | - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.350193 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.350200 | controller | - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.350207 | controller | on port 15691...' 2025-10-13 20:41:20.350214 | controller | - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.350221 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.350228 | controller | - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.350235 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.350241 | controller | - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.350248 | controller | on port 3306...' 2025-10-13 20:41:20.350255 | controller | - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.350262 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.350269 | controller | - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.350276 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.350283 | controller | - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.350290 | controller | on port 3306...' 2025-10-13 20:41:20.350297 | controller | - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.350304 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.350311 | controller | - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.350318 | controller | had certificate mismatches:' 2025-10-13 20:41:20.350325 | controller | - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.350332 | controller | on port 1981' 2025-10-13 20:41:20.350339 | controller | - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.350346 | controller | on port 1981' 2025-10-13 20:41:20.350353 | controller | - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.350360 | controller | 2 additional commands' 2025-10-13 20:41:20.350367 | controller | - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.350374 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.350381 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.350388 | controller | - ' ]' 2025-10-13 20:41:20.350412 | controller | - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.350425 | controller | of non API service certificates...' 2025-10-13 20:41:20.350432 | controller | - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350439 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.350446 | controller | - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.350454 | controller | on port 15691...' 2025-10-13 20:41:20.350461 | controller | - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.350473 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.350480 | controller | - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.350487 | controller | on port 5671...' 2025-10-13 20:41:20.350495 | controller | - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.350502 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.350513 | controller | - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.350520 | controller | on port 15671...' 2025-10-13 20:41:20.350527 | controller | - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.350534 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.350542 | controller | - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350549 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.350561 | controller | - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.350571 | controller | on port 6642...' 2025-10-13 20:41:20.350578 | controller | - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.350585 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.350593 | controller | - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.350603 | controller | on port 6644...' 2025-10-13 20:41:20.350610 | controller | - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.350618 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.350625 | controller | - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.350632 | controller | on port 1981...' 2025-10-13 20:41:20.350639 | controller | - ' logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.350647 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.350654 | controller | - ' logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350661 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.350668 | controller | - ' logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.350675 | controller | on port 6641...' 2025-10-13 20:41:20.350683 | controller | - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.350690 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.350697 | controller | - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.350704 | controller | on port 6643...' 2025-10-13 20:41:20.350711 | controller | - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.350719 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.350726 | controller | - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.350733 | controller | on port 1981...' 2025-10-13 20:41:20.350740 | controller | - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.350748 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.350755 | controller | - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350763 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.350770 | controller | - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.350777 | controller | on port 3000...' 2025-10-13 20:41:20.350784 | controller | - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.350795 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.350806 | controller | - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.350814 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.350822 | controller | - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.350829 | controller | on port 5671...' 2025-10-13 20:41:20.350837 | controller | - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.350844 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.350852 | controller | - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.350859 | controller | on port 15671...' 2025-10-13 20:41:20.350867 | controller | - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.350874 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.350881 | controller | - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.350889 | controller | on port 15691...' 2025-10-13 20:41:20.350896 | controller | - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.350904 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.350911 | controller | - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.350919 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.350927 | controller | - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.350935 | controller | on port 3306...' 2025-10-13 20:41:20.350943 | controller | - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.350951 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.350958 | controller | - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.350965 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.350973 | controller | - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.350980 | controller | on port 3306...' 2025-10-13 20:41:20.350988 | controller | - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.350995 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.351003 | controller | - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.351010 | controller | had certificate mismatches:' 2025-10-13 20:41:20.351017 | controller | - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.351025 | controller | on port 1981' 2025-10-13 20:41:20.351038 | controller | - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.351045 | controller | on port 1981' 2025-10-13 20:41:20.351053 | controller | - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.351076 | controller | 2 additional commands' 2025-10-13 20:41:20.351085 | controller | - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.351093 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.351100 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.351107 | controller | - ' ]' 2025-10-13 20:41:20.351115 | controller | - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.351122 | controller | of non API service certificates...' 2025-10-13 20:41:20.351129 | controller | - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.351136 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.351144 | controller | - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.351155 | controller | on port 15691...' 2025-10-13 20:41:20.351162 | controller | - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.351170 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.351177 | controller | - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.351184 | controller | on port 5671...' 2025-10-13 20:41:20.351191 | controller | - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.351199 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.351206 | controller | - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.351213 | controller | on port 15671...' 2025-10-13 20:41:20.351221 | controller | - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.351228 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.351235 | controller | - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.351242 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.351250 | controller | - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.351257 | controller | on port 6642...' 2025-10-13 20:41:20.351264 | controller | - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.351276 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.351284 | controller | - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.351291 | controller | on port 6644...' 2025-10-13 20:41:20.351299 | controller | - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.351306 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.351313 | controller | - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.351321 | controller | on port 1981...' 2025-10-13 20:41:20.351328 | controller | - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.351335 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.351342 | controller | - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.351350 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.351357 | controller | - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.351364 | controller | on port 6641...' 2025-10-13 20:41:20.351371 | controller | - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.351379 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.351386 | controller | - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.351400 | controller | on port 6643...' 2025-10-13 20:41:20.351427 | controller | - ' logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.351434 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.351442 | controller | - ' logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.351449 | controller | on port 1981...' 2025-10-13 20:41:20.351456 | controller | - ' logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.351464 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.351471 | controller | - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.351478 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.351486 | controller | - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.351493 | controller | on port 3000...' 2025-10-13 20:41:20.351504 | controller | - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.351511 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.351519 | controller | - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.351526 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.351533 | controller | - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.351540 | controller | on port 5671...' 2025-10-13 20:41:20.351553 | controller | - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.351561 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.351568 | controller | - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.351576 | controller | on port 15671...' 2025-10-13 20:41:20.351583 | controller | - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.351590 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.351597 | controller | - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.351605 | controller | on port 15691...' 2025-10-13 20:41:20.351612 | controller | - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.351619 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.351626 | controller | - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.351634 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.351641 | controller | - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.351648 | controller | on port 3306...' 2025-10-13 20:41:20.351655 | controller | - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.351663 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.351670 | controller | - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.351677 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.351685 | controller | - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.351692 | controller | on port 3306...' 2025-10-13 20:41:20.351699 | controller | - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.351706 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.351713 | controller | - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.351721 | controller | had certificate mismatches:' 2025-10-13 20:41:20.351728 | controller | - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.351735 | controller | on port 1981' 2025-10-13 20:41:20.351742 | controller | - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.351750 | controller | on port 1981' 2025-10-13 20:41:20.351757 | controller | - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.351764 | controller | 2 additional commands' 2025-10-13 20:41:20.351771 | controller | - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.351779 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.351786 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.351793 | controller | - ' ]' 2025-10-13 20:41:20.351801 | controller | - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.351808 | controller | of non API service certificates...' 2025-10-13 20:41:20.351816 | controller | - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.351827 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.351834 | controller | - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.351842 | controller | on port 15691...' 2025-10-13 20:41:20.351849 | controller | - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.351856 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.351863 | controller | - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.351871 | controller | on port 5671...' 2025-10-13 20:41:20.351878 | controller | - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.351885 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.351892 | controller | - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.351900 | controller | on port 15671...' 2025-10-13 20:41:20.351907 | controller | - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.351914 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.351921 | controller | - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.351928 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.351936 | controller | - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.351947 | controller | on port 6642...' 2025-10-13 20:41:20.351954 | controller | - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.351961 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.351969 | controller | - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.351976 | controller | on port 6644...' 2025-10-13 20:41:20.351983 | controller | - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.351990 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.352004 | controller | - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.352012 | controller | on port 1981...' 2025-10-13 20:41:20.352020 | controller | - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.352032 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.352039 | controller | - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352046 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.352054 | controller | - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.352061 | controller | on port 6641...' 2025-10-13 20:41:20.352068 | controller | - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.352076 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.352083 | controller | - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.352090 | controller | on port 6643...' 2025-10-13 20:41:20.352097 | controller | - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.352104 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.352112 | controller | - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.352119 | controller | on port 1981...' 2025-10-13 20:41:20.352126 | controller | - ' logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.352134 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.352141 | controller | - ' logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352148 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.352159 | controller | - ' logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.352167 | controller | on port 3000...' 2025-10-13 20:41:20.352174 | controller | - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.352181 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.352188 | controller | - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352196 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.352203 | controller | - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.352210 | controller | on port 5671...' 2025-10-13 20:41:20.352218 | controller | - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.352229 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.352236 | controller | - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.352243 | controller | on port 15671...' 2025-10-13 20:41:20.352251 | controller | - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.352258 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.352265 | controller | - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.352272 | controller | on port 15691...' 2025-10-13 20:41:20.352280 | controller | - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.352287 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.352294 | controller | - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.352301 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.352309 | controller | - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.352316 | controller | on port 3306...' 2025-10-13 20:41:20.352323 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.352330 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.352338 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.352345 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.352352 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.352359 | controller | on port 3306...' 2025-10-13 20:41:20.352367 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.352374 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.352381 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.352389 | controller | had certificate mismatches:' 2025-10-13 20:41:20.352417 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.352429 | controller | on port 1981' 2025-10-13 20:41:20.352437 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.352445 | controller | on port 1981' 2025-10-13 20:41:20.352452 | controller | - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.352459 | controller | 2 additional commands' 2025-10-13 20:41:20.352467 | controller | - ' logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.352474 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.352481 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.352489 | controller | - ' ]' 2025-10-13 20:41:20.352496 | controller | - ' logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.352508 | controller | of non API service certificates...' 2025-10-13 20:41:20.352515 | controller | - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352532 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.352540 | controller | - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.352547 | controller | on port 15691...' 2025-10-13 20:41:20.352554 | controller | - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.352562 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.352569 | controller | - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.352576 | controller | on port 5671...' 2025-10-13 20:41:20.352584 | controller | - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.352591 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.352598 | controller | - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.352605 | controller | on port 15671...' 2025-10-13 20:41:20.352613 | controller | - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.352620 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.352627 | controller | - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352634 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.352642 | controller | - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.352653 | controller | on port 6642...' 2025-10-13 20:41:20.352660 | controller | - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.352668 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.352675 | controller | - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.352682 | controller | on port 6644...' 2025-10-13 20:41:20.352690 | controller | - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.352697 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.352704 | controller | - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.352711 | controller | on port 1981...' 2025-10-13 20:41:20.352719 | controller | - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.352726 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.352733 | controller | - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352740 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.352748 | controller | - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.352755 | controller | on port 6641...' 2025-10-13 20:41:20.352762 | controller | - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.352769 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.352777 | controller | - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.352784 | controller | on port 6643...' 2025-10-13 20:41:20.352792 | controller | - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.352799 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.352806 | controller | - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.352814 | controller | on port 1981...' 2025-10-13 20:41:20.352821 | controller | - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.352828 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.352835 | controller | - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352847 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.352854 | controller | - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.352862 | controller | on port 3000...' 2025-10-13 20:41:20.352869 | controller | - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.352877 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.352884 | controller | - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.352892 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.352899 | controller | - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.352907 | controller | on port 5671...' 2025-10-13 20:41:20.352914 | controller | - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.352922 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.352929 | controller | - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.352936 | controller | on port 15671...' 2025-10-13 20:41:20.352944 | controller | - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.352952 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.352959 | controller | - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.352967 | controller | on port 15691...' 2025-10-13 20:41:20.352974 | controller | - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.352981 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.352993 | controller | - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.353001 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.353008 | controller | - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.353016 | controller | on port 3306...' 2025-10-13 20:41:20.353023 | controller | - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.353034 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.353042 | controller | - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.353049 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.353056 | controller | - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.353064 | controller | on port 3306...' 2025-10-13 20:41:20.353071 | controller | - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.353079 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.353086 | controller | - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.353093 | controller | had certificate mismatches:' 2025-10-13 20:41:20.353101 | controller | - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.353108 | controller | on port 1981' 2025-10-13 20:41:20.353115 | controller | - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.353122 | controller | on port 1981' 2025-10-13 20:41:20.353130 | controller | - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.353137 | controller | 2 additional commands' 2025-10-13 20:41:20.353144 | controller | - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.353152 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.353159 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.353170 | controller | - ' ]' 2025-10-13 20:41:20.353177 | controller | - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.353184 | controller | of non API service certificates...' 2025-10-13 20:41:20.353192 | controller | - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.353199 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.353206 | controller | - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.353214 | controller | on port 15691...' 2025-10-13 20:41:20.353221 | controller | - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.353228 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.353235 | controller | - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.353242 | controller | on port 5671...' 2025-10-13 20:41:20.353250 | controller | - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.353257 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.353264 | controller | - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.353271 | controller | on port 15671...' 2025-10-13 20:41:20.353278 | controller | - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.353286 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.353293 | controller | - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.353300 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.353307 | controller | - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.353315 | controller | on port 6642...' 2025-10-13 20:41:20.353322 | controller | - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.353329 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.353337 | controller | - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.353344 | controller | on port 6644...' 2025-10-13 20:41:20.353351 | controller | - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.353358 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.353365 | controller | - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.353373 | controller | on port 1981...' 2025-10-13 20:41:20.353380 | controller | - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.353387 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.353398 | controller | - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.353424 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.353432 | controller | - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.353439 | controller | on port 6641...' 2025-10-13 20:41:20.353447 | controller | - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.353454 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.353461 | controller | - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.353469 | controller | on port 6643...' 2025-10-13 20:41:20.353482 | controller | - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.353489 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.353497 | controller | - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.353505 | controller | on port 1981...' 2025-10-13 20:41:20.353512 | controller | - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.353523 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.353531 | controller | - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.353538 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.353549 | controller | - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.353557 | controller | on port 3000...' 2025-10-13 20:41:20.353564 | controller | - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.353575 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.353582 | controller | - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.353590 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.353597 | controller | - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.353605 | controller | on port 5671...' 2025-10-13 20:41:20.353612 | controller | - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.353622 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.353630 | controller | - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.353638 | controller | on port 15671...' 2025-10-13 20:41:20.353645 | controller | - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.353652 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.353659 | controller | - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.353667 | controller | on port 15691...' 2025-10-13 20:41:20.353674 | controller | - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.353681 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.353689 | controller | - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.353696 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.353703 | controller | - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.353711 | controller | on port 3306...' 2025-10-13 20:41:20.353718 | controller | - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.353725 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.353733 | controller | - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.353740 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.353747 | controller | - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.353754 | controller | on port 3306...' 2025-10-13 20:41:20.353762 | controller | - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.353769 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.353776 | controller | - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.353784 | controller | had certificate mismatches:' 2025-10-13 20:41:20.353791 | controller | - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.353798 | controller | on port 1981' 2025-10-13 20:41:20.353806 | controller | - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.353813 | controller | on port 1981' 2025-10-13 20:41:20.353820 | controller | - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.353828 | controller | 2 additional commands' 2025-10-13 20:41:20.353835 | controller | - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.353842 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.353853 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.353861 | controller | - ' ]' 2025-10-13 20:41:20.353868 | controller | - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.353876 | controller | of non API service certificates...' 2025-10-13 20:41:20.353883 | controller | - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.353890 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.353897 | controller | - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.353905 | controller | on port 15691...' 2025-10-13 20:41:20.353912 | controller | - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.353919 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.353927 | controller | - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.353934 | controller | on port 5671...' 2025-10-13 20:41:20.353942 | controller | - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.353949 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.353956 | controller | - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.353968 | controller | on port 15671...' 2025-10-13 20:41:20.353976 | controller | - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.353983 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.353991 | controller | - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.353998 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.354005 | controller | - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.354013 | controller | on port 6642...' 2025-10-13 20:41:20.354020 | controller | - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.354027 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.354035 | controller | - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.354042 | controller | on port 6644...' 2025-10-13 20:41:20.354049 | controller | - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.354056 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.354064 | controller | - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.354076 | controller | on port 1981...' 2025-10-13 20:41:20.354083 | controller | - ' logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.354090 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.354098 | controller | - ' logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354105 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.354112 | controller | - ' logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.354120 | controller | on port 6641...' 2025-10-13 20:41:20.354127 | controller | - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.354134 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.354142 | controller | - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.354149 | controller | on port 6643...' 2025-10-13 20:41:20.354156 | controller | - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.354164 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.354171 | controller | - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.354185 | controller | on port 1981...' 2025-10-13 20:41:20.354193 | controller | - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.354200 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.354207 | controller | - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354215 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.354222 | controller | - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.354229 | controller | on port 3000...' 2025-10-13 20:41:20.354236 | controller | - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.354244 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.354251 | controller | - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354258 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.354266 | controller | - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.354273 | controller | on port 5671...' 2025-10-13 20:41:20.354280 | controller | - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.354288 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.354295 | controller | - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.354302 | controller | on port 15671...' 2025-10-13 20:41:20.354310 | controller | - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.354317 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.354324 | controller | - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.354331 | controller | on port 15691...' 2025-10-13 20:41:20.354339 | controller | - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.354346 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.354354 | controller | - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.354361 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.354368 | controller | - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.354376 | controller | on port 3306...' 2025-10-13 20:41:20.354383 | controller | - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.354390 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.354419 | controller | - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.354431 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.354439 | controller | - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.354446 | controller | on port 3306...' 2025-10-13 20:41:20.354459 | controller | - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.354467 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.354474 | controller | - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.354482 | controller | had certificate mismatches:' 2025-10-13 20:41:20.354489 | controller | - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.354496 | controller | on port 1981' 2025-10-13 20:41:20.354504 | controller | - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.354511 | controller | on port 1981' 2025-10-13 20:41:20.354518 | controller | - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.354526 | controller | 2 additional commands' 2025-10-13 20:41:20.354550 | controller | - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.354559 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.354566 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.354574 | controller | - ' ]' 2025-10-13 20:41:20.354581 | controller | - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.354589 | controller | of non API service certificates...' 2025-10-13 20:41:20.354596 | controller | - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354603 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.354610 | controller | - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.354618 | controller | on port 15691...' 2025-10-13 20:41:20.354625 | controller | - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.354632 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.354640 | controller | - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.354647 | controller | on port 5671...' 2025-10-13 20:41:20.354655 | controller | - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.354662 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.354670 | controller | - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.354677 | controller | on port 15671...' 2025-10-13 20:41:20.354685 | controller | - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.354692 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.354699 | controller | - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354707 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.354714 | controller | - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.354726 | controller | on port 6642...' 2025-10-13 20:41:20.354733 | controller | - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.354741 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.354748 | controller | - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.354756 | controller | on port 6644...' 2025-10-13 20:41:20.354763 | controller | - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.354770 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.354778 | controller | - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.354785 | controller | on port 1981...' 2025-10-13 20:41:20.354793 | controller | - ' logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.354800 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.354807 | controller | - ' logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354815 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.354822 | controller | - ' logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.354830 | controller | on port 6641...' 2025-10-13 20:41:20.354837 | controller | - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.354845 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.354852 | controller | - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.354860 | controller | on port 6643...' 2025-10-13 20:41:20.354867 | controller | - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.354879 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.354886 | controller | - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.354897 | controller | on port 1981...' 2025-10-13 20:41:20.354904 | controller | - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.354911 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.354919 | controller | - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354926 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.354933 | controller | - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.354941 | controller | on port 3000...' 2025-10-13 20:41:20.354953 | controller | - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.354961 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.354968 | controller | - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.354975 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.354983 | controller | - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.354990 | controller | on port 5671...' 2025-10-13 20:41:20.354997 | controller | - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.355005 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.355012 | controller | - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.355020 | controller | on port 15671...' 2025-10-13 20:41:20.355027 | controller | - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.355034 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.355041 | controller | - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.355049 | controller | on port 15691...' 2025-10-13 20:41:20.355056 | controller | - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.355063 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.355071 | controller | - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.355078 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.355085 | controller | - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.355118 | controller | on port 3306...' 2025-10-13 20:41:20.355126 | controller | - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.355134 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.355141 | controller | - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.355148 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.355156 | controller | - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.355163 | controller | on port 3306...' 2025-10-13 20:41:20.355171 | controller | - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.355178 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.355185 | controller | - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.355193 | controller | had certificate mismatches:' 2025-10-13 20:41:20.355200 | controller | - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.355207 | controller | on port 1981' 2025-10-13 20:41:20.355214 | controller | - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.355222 | controller | on port 1981' 2025-10-13 20:41:20.355233 | controller | - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.355240 | controller | 2 additional commands' 2025-10-13 20:41:20.355248 | controller | - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.355255 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.355262 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.355269 | controller | - ' ]' 2025-10-13 20:41:20.355277 | controller | - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.355284 | controller | of non API service certificates...' 2025-10-13 20:41:20.355291 | controller | - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.355299 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.355306 | controller | - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.355314 | controller | on port 15691...' 2025-10-13 20:41:20.355321 | controller | - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.355329 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.355336 | controller | - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.355343 | controller | on port 5671...' 2025-10-13 20:41:20.355351 | controller | - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.355358 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.355366 | controller | - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.355373 | controller | on port 15671...' 2025-10-13 20:41:20.355380 | controller | - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.355387 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.355395 | controller | - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.355420 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.355431 | controller | - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.355443 | controller | on port 6642...' 2025-10-13 20:41:20.355451 | controller | - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.355458 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.355466 | controller | - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.355478 | controller | on port 6644...' 2025-10-13 20:41:20.355486 | controller | - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.355494 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.355501 | controller | - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.355508 | controller | on port 1981...' 2025-10-13 20:41:20.355516 | controller | - ' logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.355523 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.355531 | controller | - ' logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.355538 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.355545 | controller | - ' logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.355552 | controller | on port 6641...' 2025-10-13 20:41:20.355560 | controller | - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.355568 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.355575 | controller | - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.355586 | controller | on port 6643...' 2025-10-13 20:41:20.355593 | controller | - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.355600 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.355607 | controller | - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.355615 | controller | on port 1981...' 2025-10-13 20:41:20.355622 | controller | - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.355629 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.355637 | controller | - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.355644 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.355651 | controller | - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.355659 | controller | on port 3000...' 2025-10-13 20:41:20.355666 | controller | - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.355673 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.355680 | controller | - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.355688 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.355695 | controller | - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.355702 | controller | on port 5671...' 2025-10-13 20:41:20.355709 | controller | - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.355717 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.355724 | controller | - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.355731 | controller | on port 15671...' 2025-10-13 20:41:20.355738 | controller | - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.355750 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.355758 | controller | - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.355766 | controller | on port 15691...' 2025-10-13 20:41:20.355773 | controller | - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.355784 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.355792 | controller | - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.355799 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.355806 | controller | - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.355813 | controller | on port 3306...' 2025-10-13 20:41:20.355820 | controller | - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.355828 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.355835 | controller | - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.355842 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.355849 | controller | - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.355856 | controller | on port 3306...' 2025-10-13 20:41:20.355863 | controller | - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.355871 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.355878 | controller | - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.355885 | controller | had certificate mismatches:' 2025-10-13 20:41:20.355892 | controller | - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.355899 | controller | on port 1981' 2025-10-13 20:41:20.355910 | controller | - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.355918 | controller | on port 1981' 2025-10-13 20:41:20.355925 | controller | - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.355932 | controller | 2 additional commands' 2025-10-13 20:41:20.355939 | controller | - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.355952 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.355960 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.355969 | controller | - ' ]' 2025-10-13 20:41:20.355976 | controller | - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.355985 | controller | of non API service certificates...' 2025-10-13 20:41:20.355993 | controller | - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356000 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.356007 | controller | - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.356014 | controller | on port 15691...' 2025-10-13 20:41:20.356021 | controller | - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.356028 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.356035 | controller | - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.356042 | controller | on port 5671...' 2025-10-13 20:41:20.356053 | controller | - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.356060 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.356068 | controller | - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.356075 | controller | on port 15671...' 2025-10-13 20:41:20.356082 | controller | - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.356089 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.356096 | controller | - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356104 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.356111 | controller | - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.356122 | controller | on port 6642...' 2025-10-13 20:41:20.356129 | controller | - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.356136 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.356143 | controller | - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.356151 | controller | on port 6644...' 2025-10-13 20:41:20.356158 | controller | - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.356166 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.356173 | controller | - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.356180 | controller | on port 1981...' 2025-10-13 20:41:20.356188 | controller | - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.356195 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.356202 | controller | - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356210 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.356217 | controller | - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.356224 | controller | on port 6641...' 2025-10-13 20:41:20.356231 | controller | - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.356242 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.356250 | controller | - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.356258 | controller | on port 6643...' 2025-10-13 20:41:20.356265 | controller | - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.356272 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.356279 | controller | - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.356287 | controller | on port 1981...' 2025-10-13 20:41:20.356294 | controller | - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.356301 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.356309 | controller | - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356316 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.356323 | controller | - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.356331 | controller | on port 3000...' 2025-10-13 20:41:20.356338 | controller | - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.356345 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.356353 | controller | - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356360 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.356367 | controller | - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.356375 | controller | on port 5671...' 2025-10-13 20:41:20.356382 | controller | - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.356389 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.356413 | controller | - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.356425 | controller | on port 15671...' 2025-10-13 20:41:20.356440 | controller | - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.356447 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.356455 | controller | - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.356462 | controller | on port 15691...' 2025-10-13 20:41:20.356469 | controller | - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.356477 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.356484 | controller | - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.356492 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.356499 | controller | - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.356506 | controller | on port 3306...' 2025-10-13 20:41:20.356514 | controller | - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.356521 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.356529 | controller | - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.356536 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.356544 | controller | - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.356551 | controller | on port 3306...' 2025-10-13 20:41:20.356559 | controller | - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.356566 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.356577 | controller | - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.356585 | controller | had certificate mismatches:' 2025-10-13 20:41:20.356599 | controller | - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.356606 | controller | on port 1981' 2025-10-13 20:41:20.356614 | controller | - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.356621 | controller | on port 1981' 2025-10-13 20:41:20.356628 | controller | - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.356635 | controller | 2 additional commands' 2025-10-13 20:41:20.356642 | controller | - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.356650 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.356661 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.356668 | controller | - ' ]' 2025-10-13 20:41:20.356675 | controller | - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.356682 | controller | of non API service certificates...' 2025-10-13 20:41:20.356690 | controller | - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356697 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.356704 | controller | - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.356711 | controller | on port 15691...' 2025-10-13 20:41:20.356718 | controller | - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.356726 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.356733 | controller | - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.356740 | controller | on port 5671...' 2025-10-13 20:41:20.356747 | controller | - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.356754 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.356762 | controller | - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.356769 | controller | on port 15671...' 2025-10-13 20:41:20.356776 | controller | - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.356784 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.356791 | controller | - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356798 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.356805 | controller | - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.356816 | controller | on port 6642...' 2025-10-13 20:41:20.356824 | controller | - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.356831 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.356838 | controller | - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.356845 | controller | on port 6644...' 2025-10-13 20:41:20.356853 | controller | - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.356860 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.356867 | controller | - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.356875 | controller | on port 1981...' 2025-10-13 20:41:20.356882 | controller | - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.356889 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.356897 | controller | - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.356904 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.356916 | controller | - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.356927 | controller | on port 6641...' 2025-10-13 20:41:20.356935 | controller | - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.356942 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.356950 | controller | - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.356957 | controller | on port 6643...' 2025-10-13 20:41:20.356965 | controller | - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.356972 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.356980 | controller | - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.356987 | controller | on port 1981...' 2025-10-13 20:41:20.356994 | controller | - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.357002 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.357009 | controller | - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.357017 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.357024 | controller | - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.357031 | controller | on port 3000...' 2025-10-13 20:41:20.357039 | controller | - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.357046 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.357053 | controller | - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.357061 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.357068 | controller | - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.357075 | controller | on port 5671...' 2025-10-13 20:41:20.357083 | controller | - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.357090 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.357098 | controller | - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.357105 | controller | on port 15671...' 2025-10-13 20:41:20.357112 | controller | - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.357120 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.357127 | controller | - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.357134 | controller | on port 15691...' 2025-10-13 20:41:20.357142 | controller | - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.357149 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.357157 | controller | - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.357164 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.357171 | controller | - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.357178 | controller | on port 3306...' 2025-10-13 20:41:20.357185 | controller | - ' logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.357193 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.357200 | controller | - ' logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.357207 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.357214 | controller | - ' logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.357222 | controller | on port 3306...' 2025-10-13 20:41:20.357229 | controller | - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.357236 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.357247 | controller | - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.357255 | controller | had certificate mismatches:' 2025-10-13 20:41:20.357262 | controller | - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.357269 | controller | on port 1981' 2025-10-13 20:41:20.357277 | controller | - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.357284 | controller | on port 1981' 2025-10-13 20:41:20.357291 | controller | - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.357298 | controller | 2 additional commands' 2025-10-13 20:41:20.357305 | controller | - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | running command: [sh 2025-10-13 20:41:20.357313 | controller | -c echo "Checking rotation of non API service certificates..."' 2025-10-13 20:41:20.357320 | controller | - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' 2025-10-13 20:41:20.357327 | controller | - ' ]' 2025-10-13 20:41:20.357334 | controller | - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Checking rotation 2025-10-13 20:41:20.357342 | controller | of non API service certificates...' 2025-10-13 20:41:20.357349 | controller | - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.357356 | controller | rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' 2025-10-13 20:41:20.357363 | controller | - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.357370 | controller | on port 15691...' 2025-10-13 20:41:20.357378 | controller | - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.357390 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.357415 | controller | - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.357426 | controller | on port 5671...' 2025-10-13 20:41:20.357434 | controller | - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.357441 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.357448 | controller | - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq 2025-10-13 20:41:20.357455 | controller | on port 15671...' 2025-10-13 20:41:20.357462 | controller | - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq 2025-10-13 20:41:20.357470 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.357477 | controller | - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.357484 | controller | ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' 2025-10-13 20:41:20.357491 | controller | - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.357503 | controller | on port 6642...' 2025-10-13 20:41:20.357510 | controller | - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.357518 | controller | on port 6642 match the secret.' 2025-10-13 20:41:20.357525 | controller | - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.357532 | controller | on port 6644...' 2025-10-13 20:41:20.357539 | controller | - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.357547 | controller | on port 6644 match the secret.' 2025-10-13 20:41:20.357554 | controller | - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 2025-10-13 20:41:20.357561 | controller | on port 1981...' 2025-10-13 20:41:20.357568 | controller | - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 2025-10-13 20:41:20.357576 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.357583 | controller | - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.357590 | controller | ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' 2025-10-13 20:41:20.357602 | controller | - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.357611 | controller | on port 6641...' 2025-10-13 20:41:20.357619 | controller | - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.357626 | controller | on port 6641 match the secret.' 2025-10-13 20:41:20.357634 | controller | - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.357641 | controller | on port 6643...' 2025-10-13 20:41:20.357648 | controller | - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.357656 | controller | on port 6643 match the secret.' 2025-10-13 20:41:20.357663 | controller | - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 2025-10-13 20:41:20.357670 | controller | on port 1981...' 2025-10-13 20:41:20.357678 | controller | - ' logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 2025-10-13 20:41:20.357685 | controller | on port 1981 DO NOT match the secret.' 2025-10-13 20:41:20.357692 | controller | - ' logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.357700 | controller | ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' 2025-10-13 20:41:20.357707 | controller | - ' logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal 2025-10-13 20:41:20.357718 | controller | on port 3000...' 2025-10-13 20:41:20.357726 | controller | - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal 2025-10-13 20:41:20.357733 | controller | on port 3000 match the secret.' 2025-10-13 20:41:20.357740 | controller | - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Checking service: 2025-10-13 20:41:20.357747 | controller | rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' 2025-10-13 20:41:20.357755 | controller | - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.357763 | controller | on port 5671...' 2025-10-13 20:41:20.357770 | controller | - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.357777 | controller | on port 5671 match the secret.' 2025-10-13 20:41:20.357785 | controller | - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.357792 | controller | on port 15671...' 2025-10-13 20:41:20.357799 | controller | - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.357806 | controller | on port 15671 match the secret.' 2025-10-13 20:41:20.357813 | controller | - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 2025-10-13 20:41:20.357820 | controller | on port 15691...' 2025-10-13 20:41:20.357827 | controller | - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 2025-10-13 20:41:20.357835 | controller | on port 15691 match the secret.' 2025-10-13 20:41:20.357842 | controller | - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.357849 | controller | openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' 2025-10-13 20:41:20.357856 | controller | - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 2025-10-13 20:41:20.357864 | controller | on port 3306...' 2025-10-13 20:41:20.357876 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 2025-10-13 20:41:20.389139 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.389181 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Checking database: 2025-10-13 20:41:20.389190 | controller | openstack (ClusterIP: 10.217.5.75, Ports: 3306)' 2025-10-13 20:41:20.389198 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack 2025-10-13 20:41:20.389205 | controller | on port 3306...' 2025-10-13 20:41:20.389212 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack 2025-10-13 20:41:20.389226 | controller | on port 3306 match the secret.' 2025-10-13 20:41:20.389233 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | The following services 2025-10-13 20:41:20.389240 | controller | had certificate mismatches:' 2025-10-13 20:41:20.389247 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 2025-10-13 20:41:20.389254 | controller | on port 1981' 2025-10-13 20:41:20.389261 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 2025-10-13 20:41:20.389267 | controller | on port 1981' 2025-10-13 20:41:20.389274 | controller | - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2025-10-13 20:41:20.389281 | controller | 2 additional commands' 2025-10-13 20:41:20.389288 | controller | - ' logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation/4- | test step failed 4-' 2025-10-13 20:41:20.389295 | controller | - ' case.go:396: failed in step 4-' 2025-10-13 20:41:20.389302 | controller | - ' case.go:398: command "echo \"Checking rotation of non API service certificates...\"\\n 2025-10-13 20:41:20.389309 | controller | NAMES..." failed, exit status 1' 2025-10-13 20:41:20.389316 | controller | - ' logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation | skipping kubernetes event 2025-10-13 20:41:20.389323 | controller | logging' 2025-10-13 20:41:20.389330 | controller | - === NAME kuttl 2025-10-13 20:41:20.389337 | controller | - ' harness.go:406: run tests finished' 2025-10-13 20:41:20.389344 | controller | - ' harness.go:514: cleaning up' 2025-10-13 20:41:20.389351 | controller | - ' harness.go:571: removing temp folder: ""' 2025-10-13 20:41:20.389358 | controller | - '--- FAIL: kuttl (1314.18s)' 2025-10-13 20:41:20.389365 | controller | - ' --- FAIL: kuttl/harness (0.00s)' 2025-10-13 20:41:20.389372 | controller | - ' --- FAIL: kuttl/harness/ctlplane-tls-cert-rotation (1312.57s)' 2025-10-13 20:41:20.389379 | controller | - FAIL 2025-10-13 20:41:20.389386 | controller | - 'make[1]: *** [Makefile:2080: openstack_kuttl_run] Error 1' 2025-10-13 20:41:20.389410 | controller | - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' 2025-10-13 20:41:20.389422 | controller | - 'make: *** [Makefile:2102: openstack_kuttl] Error 2' 2025-10-13 20:41:20.389436 | controller | ...ignoring 2025-10-13 20:41:21.409535 | controller | 2025-10-13 20:41:21.409594 | controller | TASK [Get resource status after openstack_kuttl run _raw_params={{ item }} >> {{ cifmw_artifacts_basedir }}/logs/cmd_after_{{ operator }}_kuttl.log 2025-10-13 20:41:21.409602 | controller | ] *** 2025-10-13 20:41:21.409609 | controller | Monday 13 October 2025 20:41:20 +0000 (1:06:41.792) 1:09:07.609 ******** 2025-10-13 20:41:21.409624 | controller | changed: [localhost] => (item=oc get pv) 2025-10-13 20:41:21.617827 | controller | changed: [localhost] => (item=oc get all) 2025-10-13 20:41:21.617899 | controller | 2025-10-13 20:41:21.617907 | controller | TASK [Find the generated JUnitXML files paths={{ cifmw_installyamls_repos }}, file_type=file, patterns=*.xml] *** 2025-10-13 20:41:21.617914 | controller | Monday 13 October 2025 20:41:21 +0000 (0:00:01.020) 1:09:08.630 ******** 2025-10-13 20:41:21.617932 | controller | ok: [localhost] 2025-10-13 20:41:21.825859 | controller | 2025-10-13 20:41:21.825924 | controller | TASK [Create the test results directory path={{ _kuttl_test_result_dir }}, state=directory, mode=0755] *** 2025-10-13 20:41:21.825932 | controller | Monday 13 October 2025 20:41:21 +0000 (0:00:00.207) 1:09:08.838 ******** 2025-10-13 20:41:21.825949 | controller | changed: [localhost] 2025-10-13 20:41:22.430133 | controller | 2025-10-13 20:41:22.430168 | controller | TASK [Copy the generated test results to the test results directory src={{ item.path }}, dest={{ _kuttl_test_result_dir }}, mode=0644] *** 2025-10-13 20:41:22.430176 | controller | Monday 13 October 2025 20:41:21 +0000 (0:00:00.207) 1:09:09.045 ******** 2025-10-13 20:41:22.430189 | controller | changed: [localhost] => (item={'path': '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/kuttl-report-openstack.xml', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 1000, 'gid': 1000, 'size': 633, 'inode': 79844139, 'dev': 64513, 'nlink': 1, 'atime': 1760385082.3343067, 'mtime': 1760388079.762774, 'ctime': 1760388079.762774, 'gr_name': 'zuul', 'pw_name': 'zuul', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2025-10-13 20:41:22.475690 | controller | 2025-10-13 20:41:22.475788 | controller | TASK [Fail when any tests failed that=['_kuttl_curr_operator_result.rc == 0'], success_msg=KUTTL tests for {{ operator }} passed, fail_msg=KUTTL tests for {{ operator }} failed] *** 2025-10-13 20:41:22.475797 | controller | Monday 13 October 2025 20:41:22 +0000 (0:00:00.604) 1:09:09.650 ******** 2025-10-13 20:41:22.475812 | controller | task path: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml:96 2025-10-13 20:41:22.603376 | controller | fatal: [localhost]: FAILED! => 2025-10-13 20:41:22.603496 | controller | assertion: _kuttl_curr_operator_result.rc == 0 2025-10-13 20:41:22.603506 | controller | changed: false 2025-10-13 20:41:22.603516 | controller | evaluated_to: false 2025-10-13 20:41:22.603524 | controller | msg: KUTTL tests for openstack failed 2025-10-13 20:41:22.603534 | controller | 2025-10-13 20:41:22.603542 | controller | NO MORE HOSTS LEFT ************************************************************* 2025-10-13 20:41:22.603558 | controller | 2025-10-13 20:41:22.603566 | controller | PLAY RECAP ********************************************************************* 2025-10-13 20:41:22.603677 | controller | localhost : ok=127 changed=54 unreachable=0 failed=1 skipped=67 rescued=0 ignored=2 2025-10-13 20:41:22.603691 | controller | 2025-10-13 20:41:22.603699 | controller | Monday 13 October 2025 20:41:22 +0000 (0:00:00.044) 1:09:09.694 ******** 2025-10-13 20:41:22.603708 | controller | =============================================================================== 2025-10-13 20:41:22.603716 | controller | install_yamls_makes : Run openstack_kuttl ---------------------------- 4001.79s 2025-10-13 20:41:22.603724 | controller | install_yamls_makes : Run download_tools ------------------------------- 34.41s 2025-10-13 20:41:22.603732 | controller | ci_setup : Install needed packages ------------------------------------- 26.27s 2025-10-13 20:41:22.603755 | controller | ci_local_storage : Remove the cifmw_cls_namespace namespace ------------ 10.77s 2025-10-13 20:41:22.603763 | controller | repo_setup : Initialize python venv and install requirements ------------ 8.68s 2025-10-13 20:41:22.603771 | controller | ci_local_storage : Perform action in the PV directory ------------------- 5.78s 2025-10-13 20:41:22.603779 | controller | ci_local_storage : Perform action in the PV directory ------------------- 5.77s 2025-10-13 20:41:22.603787 | controller | ci_setup : Install openshift client ------------------------------------- 5.32s 2025-10-13 20:41:22.603795 | controller | install_yamls_makes : Run crc_attach_default_interface ------------------ 5.20s 2025-10-13 20:41:22.603803 | controller | run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs --- 1.77s 2025-10-13 20:41:22.603812 | controller | run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs --- 1.74s 2025-10-13 20:41:22.603820 | controller | openshift_setup : Create required namespaces ---------------------------- 1.71s 2025-10-13 20:41:22.603828 | controller | ci_local_storage : Fetch hostnames for all hosts ------------------------ 1.63s 2025-10-13 20:41:22.603836 | controller | install_ca : Update ca bundle ------------------------------------------- 1.53s 2025-10-13 20:41:22.603844 | controller | ci_setup : Manage directories ------------------------------------------- 1.16s 2025-10-13 20:41:22.603852 | controller | repo_setup : Make sure git-core package is installed -------------------- 1.09s 2025-10-13 20:41:22.603860 | controller | repo_setup : Get repo-setup repository ---------------------------------- 1.05s 2025-10-13 20:41:22.603868 | controller | Get resource status after openstack_kuttl run --------------------------- 1.02s 2025-10-13 20:41:22.603876 | controller | ci_local_storage : Fetch hostnames for all hosts ------------------------ 0.99s 2025-10-13 20:41:22.603884 | controller | openshift_setup : Gather network.operator info -------------------------- 0.97s 2025-10-13 20:41:23.002348 | controller | ERROR 2025-10-13 20:41:23.002639 | controller | { 2025-10-13 20:41:23.002701 | controller | "delta": "1:09:10.650047", 2025-10-13 20:41:23.002786 | controller | "end": "2025-10-13 20:41:22.609001", 2025-10-13 20:41:23.002829 | controller | "msg": "non-zero return code", 2025-10-13 20:41:23.002865 | controller | "rc": 2, 2025-10-13 20:41:23.002901 | controller | "start": "2025-10-13 19:32:11.958954" 2025-10-13 20:41:23.002936 | controller | } failure 2025-10-13 20:41:23.252876 | 2025-10-13 20:41:23.252981 | PLAY RECAP 2025-10-13 20:41:23.253027 | controller | ok: 9 changed: 2 unreachable: 0 failed: 1 skipped: 1 rescued: 0 ignored: 0 2025-10-13 20:41:23.253047 | 2025-10-13 20:41:23.411952 | RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run.yml@main] 2025-10-13 20:41:23.415074 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/e2e-collect-logs.yml@main] 2025-10-13 20:41:24.123531 | 2025-10-13 20:41:24.123640 | PLAY [Run ci/playbooks/e2e-collect-logs.yml] 2025-10-13 20:41:24.166226 | 2025-10-13 20:41:24.166354 | TASK [Read group_vars] 2025-10-13 20:41:24.191267 | controller | ok 2025-10-13 20:41:24.208413 | crc | ok 2025-10-13 20:41:24.344265 | 2025-10-13 20:41:24.344410 | TASK [cifmw_helpers : Check directory is available] 2025-10-13 20:41:24.961049 | controller | ok 2025-10-13 20:41:25.242841 | crc | ok 2025-10-13 20:41:25.256386 | 2025-10-13 20:41:25.256523 | TASK [cifmw_helpers : Find yaml files] 2025-10-13 20:41:25.677339 | controller | ok: All paths examined 2025-10-13 20:41:25.745692 | crc | ok: All paths examined 2025-10-13 20:41:25.754586 | 2025-10-13 20:41:25.754675 | TASK [cifmw_helpers : Print available yaml files] 2025-10-13 20:41:25.802719 | controller | ok: Found yaml files to parse: ['/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/group_vars/all.yml'] 2025-10-13 20:41:25.821613 | crc | ok: Found yaml files to parse: ['/var/home/core/src/github.com/openstack-k8s-operators/ci-framework/group_vars/all.yml'] 2025-10-13 20:41:25.830429 | 2025-10-13 20:41:25.830516 | LOOP [cifmw_helpers : Create files on localhost and use include_vars] 2025-10-13 20:41:25.885224 | controller | Output suppressed because no_log was given 2025-10-13 20:41:25.901614 | crc | Output suppressed because no_log was given 2025-10-13 20:41:25.927820 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/include_file.yml 2025-10-13 20:41:25.932587 | crc | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/include_file.yml 2025-10-13 20:41:25.942727 | 2025-10-13 20:41:25.942830 | TASK [cifmw_helpers : Fail if file is not yaml or yml extension] 2025-10-13 20:41:25.976349 | controller | skipping: Conditional result was False 2025-10-13 20:41:25.984746 | 2025-10-13 20:41:25.984851 | TASK [cifmw_helpers : Check if file is available] 2025-10-13 20:41:26.298810 | controller | ok 2025-10-13 20:41:26.312444 | 2025-10-13 20:41:26.312582 | TASK [cifmw_helpers : Create temporary directory] 2025-10-13 20:41:26.712643 | controller -> localhost | changed 2025-10-13 20:41:26.720053 | 2025-10-13 20:41:26.720116 | TASK [cifmw_helpers : Read vars] 2025-10-13 20:41:27.129822 | controller | ok 2025-10-13 20:41:27.144160 | 2025-10-13 20:41:27.144311 | TASK [cifmw_helpers : Create new variable files with content] 2025-10-13 20:41:27.803931 | controller -> localhost | changed 2025-10-13 20:41:27.819003 | 2025-10-13 20:41:27.819168 | TASK [cifmw_helpers : Include vars] 2025-10-13 20:41:27.868562 | controller -> localhost | ok 2025-10-13 20:41:27.898226 | 2025-10-13 20:41:27.898388 | TASK [cifmw_helpers : Fail if file is not yaml or yml extension] 2025-10-13 20:41:27.935068 | crc | skipping: Conditional result was False 2025-10-13 20:41:27.965214 | 2025-10-13 20:41:27.965379 | TASK [cifmw_helpers : Check if file is available] 2025-10-13 20:41:28.263260 | crc | ok 2025-10-13 20:41:28.291888 | 2025-10-13 20:41:28.292030 | TASK [cifmw_helpers : Create temporary directory] 2025-10-13 20:41:28.582783 | crc -> localhost | changed 2025-10-13 20:41:28.596024 | 2025-10-13 20:41:28.596090 | TASK [cifmw_helpers : Read vars] 2025-10-13 20:41:28.913137 | crc | ok 2025-10-13 20:41:28.939808 | 2025-10-13 20:41:28.939943 | TASK [cifmw_helpers : Create new variable files with content] 2025-10-13 20:41:29.433736 | crc -> localhost | changed 2025-10-13 20:41:29.447661 | 2025-10-13 20:41:29.447764 | TASK [cifmw_helpers : Include vars] 2025-10-13 20:41:29.481761 | crc -> localhost | ok 2025-10-13 20:41:29.500373 | 2025-10-13 20:41:29.500450 | TASK [Filter out host if needed] 2025-10-13 20:41:29.513178 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-10-13 20:41:29.520190 | 2025-10-13 20:41:29.520247 | TASK [Filter out host if needed] 2025-10-13 20:41:29.534510 | 2025-10-13 20:41:29.534565 | TASK [Ensure we have the ci-framework on host] 2025-10-13 20:41:29.835646 | controller | ok 2025-10-13 20:41:29.850163 | 2025-10-13 20:41:29.850293 | TASK [End host if no basedir] 2025-10-13 20:41:29.905756 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-10-13 20:41:29.912960 | 2025-10-13 20:41:29.913054 | TASK [Read base centos-9 scenarios] 2025-10-13 20:41:29.934449 | controller | ok 2025-10-13 20:41:30.007391 | 2025-10-13 20:41:30.007479 | TASK [cifmw_helpers : Fail if file is not yaml or yml extension] 2025-10-13 20:41:30.041435 | controller | skipping: Conditional result was False 2025-10-13 20:41:30.050357 | 2025-10-13 20:41:30.050444 | TASK [cifmw_helpers : Check if file is available] 2025-10-13 20:41:30.293562 | controller | ok 2025-10-13 20:41:30.306677 | 2025-10-13 20:41:30.306838 | TASK [cifmw_helpers : Read vars] 2025-10-13 20:41:30.333270 | controller | Output suppressed because no_log was given 2025-10-13 20:41:30.349476 | 2025-10-13 20:41:30.349612 | LOOP [cifmw_helpers : Set vars as fact] 2025-10-13 20:41:30.403201 | 2025-10-13 20:41:30.403470 | TASK [cifmw_setup : Ensure cifmw_basedir param is set] 2025-10-13 20:41:30.452586 | controller | ok 2025-10-13 20:41:30.465105 | 2025-10-13 20:41:30.465226 | TASK [Read artifacts parameters dir and set as facts] 2025-10-13 20:41:30.496050 | controller | ok 2025-10-13 20:41:30.526574 | 2025-10-13 20:41:30.526663 | TASK [cifmw_helpers : Check directory is available] 2025-10-13 20:41:30.828980 | controller | ok 2025-10-13 20:41:30.842609 | 2025-10-13 20:41:30.842796 | TASK [cifmw_helpers : Find yaml files] 2025-10-13 20:41:31.139391 | controller | ok: All paths examined 2025-10-13 20:41:31.155033 | 2025-10-13 20:41:31.155183 | TASK [cifmw_helpers : Print available yaml files] 2025-10-13 20:41:31.215939 | controller | ok: Found yaml files to parse: ['/home/zuul/ci-framework-data/artifacts/parameters/zuul-params.yml', '/home/zuul/ci-framework-data/artifacts/parameters/install-yamls-params.yml', '/home/zuul/ci-framework-data/artifacts/parameters/custom-params.yml', '/home/zuul/ci-framework-data/artifacts/parameters/openshift-login-params.yml', '/home/zuul/ci-framework-data/artifacts/parameters/pre_kuttl_fetch_crc_facts_and_save_them_.yml'] 2025-10-13 20:41:31.228844 | 2025-10-13 20:41:31.228972 | LOOP [cifmw_helpers : Read vars] 2025-10-13 20:41:31.527101 | controller | ok: 2025-10-13 20:41:31.527509 | controller | { 2025-10-13 20:41:31.527591 | controller | "atime": 1760383926.916131, 2025-10-13 20:41:31.527651 | controller | "ctime": 1760383923.6860523, 2025-10-13 20:41:31.527699 | controller | "dev": 64513, 2025-10-13 20:41:31.527957 | controller | "gid": 1000, 2025-10-13 20:41:31.528038 | controller | "gr_name": "zuul", 2025-10-13 20:41:31.528082 | controller | "inode": 29440371, 2025-10-13 20:41:31.528118 | controller | "isblk": false, 2025-10-13 20:41:31.528154 | controller | "ischr": false, 2025-10-13 20:41:31.528190 | controller | "isdir": false, 2025-10-13 20:41:31.528226 | controller | "isfifo": false, 2025-10-13 20:41:31.528261 | controller | "isgid": false, 2025-10-13 20:41:31.528296 | controller | "islnk": false, 2025-10-13 20:41:31.528330 | controller | "isreg": true, 2025-10-13 20:41:31.528363 | controller | "issock": false, 2025-10-13 20:41:31.528397 | controller | "isuid": false, 2025-10-13 20:41:31.528431 | controller | "mode": "0644", 2025-10-13 20:41:31.528465 | controller | "mtime": 1760383923.4470463, 2025-10-13 20:41:31.528500 | controller | "nlink": 1, 2025-10-13 20:41:31.528534 | controller | "path": "/home/zuul/ci-framework-data/artifacts/parameters/zuul-params.yml", 2025-10-13 20:41:31.528570 | controller | "pw_name": "zuul", 2025-10-13 20:41:31.528605 | controller | "rgrp": true, 2025-10-13 20:41:31.528659 | controller | "roth": true, 2025-10-13 20:41:31.528701 | controller | "rusr": true, 2025-10-13 20:41:31.528784 | controller | "size": 17295, 2025-10-13 20:41:31.528832 | controller | "uid": 1000, 2025-10-13 20:41:31.528871 | controller | "wgrp": false, 2025-10-13 20:41:31.528907 | controller | "woth": false, 2025-10-13 20:41:31.528942 | controller | "wusr": true, 2025-10-13 20:41:31.528976 | controller | "xgrp": false, 2025-10-13 20:41:31.529010 | controller | "xoth": false, 2025-10-13 20:41:31.529048 | controller | "xusr": false 2025-10-13 20:41:31.529081 | controller | } 2025-10-13 20:41:31.529149 | 2025-10-13 20:41:31.718291 | controller | ok: 2025-10-13 20:41:31.718496 | controller | { 2025-10-13 20:41:31.718549 | controller | "atime": 1760384042.2409546, 2025-10-13 20:41:31.718588 | controller | "ctime": 1760384029.9456508, 2025-10-13 20:41:31.718626 | controller | "dev": 64513, 2025-10-13 20:41:31.718662 | controller | "gid": 1000, 2025-10-13 20:41:31.718697 | controller | "gr_name": "zuul", 2025-10-13 20:41:31.718768 | controller | "inode": 38033313, 2025-10-13 20:41:31.718809 | controller | "isblk": false, 2025-10-13 20:41:31.718843 | controller | "ischr": false, 2025-10-13 20:41:31.718876 | controller | "isdir": false, 2025-10-13 20:41:31.718910 | controller | "isfifo": false, 2025-10-13 20:41:31.718943 | controller | "isgid": false, 2025-10-13 20:41:31.718975 | controller | "islnk": false, 2025-10-13 20:41:31.719008 | controller | "isreg": true, 2025-10-13 20:41:31.719040 | controller | "issock": false, 2025-10-13 20:41:31.719073 | controller | "isuid": false, 2025-10-13 20:41:31.719107 | controller | "mode": "0600", 2025-10-13 20:41:31.719139 | controller | "mtime": 1760384029.7836468, 2025-10-13 20:41:31.719173 | controller | "nlink": 1, 2025-10-13 20:41:31.719207 | controller | "path": "/home/zuul/ci-framework-data/artifacts/parameters/install-yamls-params.yml", 2025-10-13 20:41:31.719241 | controller | "pw_name": "zuul", 2025-10-13 20:41:31.719275 | controller | "rgrp": false, 2025-10-13 20:41:31.719307 | controller | "roth": false, 2025-10-13 20:41:31.719339 | controller | "rusr": true, 2025-10-13 20:41:31.719372 | controller | "size": 27928, 2025-10-13 20:41:31.719404 | controller | "uid": 1000, 2025-10-13 20:41:31.719436 | controller | "wgrp": false, 2025-10-13 20:41:31.719467 | controller | "woth": false, 2025-10-13 20:41:31.719499 | controller | "wusr": true, 2025-10-13 20:41:31.719530 | controller | "xgrp": false, 2025-10-13 20:41:31.719561 | controller | "xoth": false, 2025-10-13 20:41:31.719592 | controller | "xusr": false 2025-10-13 20:41:31.719625 | controller | } 2025-10-13 20:41:31.900000 | controller | ok: 2025-10-13 20:41:31.900313 | controller | { 2025-10-13 20:41:31.900379 | controller | "atime": 1760384042.253955, 2025-10-13 20:41:31.900421 | controller | "ctime": 1760383991.187702, 2025-10-13 20:41:31.900460 | controller | "dev": 64513, 2025-10-13 20:41:31.900499 | controller | "gid": 1000, 2025-10-13 20:41:31.900537 | controller | "gr_name": "zuul", 2025-10-13 20:41:31.900573 | controller | "inode": 41968944, 2025-10-13 20:41:31.900609 | controller | "isblk": false, 2025-10-13 20:41:31.900644 | controller | "ischr": false, 2025-10-13 20:41:31.900679 | controller | "isdir": false, 2025-10-13 20:41:31.900713 | controller | "isfifo": false, 2025-10-13 20:41:31.900791 | controller | "isgid": false, 2025-10-13 20:41:31.900830 | controller | "islnk": false, 2025-10-13 20:41:31.900866 | controller | "isreg": true, 2025-10-13 20:41:31.900901 | controller | "issock": false, 2025-10-13 20:41:31.900936 | controller | "isuid": false, 2025-10-13 20:41:31.900971 | controller | "mode": "0644", 2025-10-13 20:41:31.901005 | controller | "mtime": 1760383991.0176978, 2025-10-13 20:41:31.901040 | controller | "nlink": 1, 2025-10-13 20:41:31.901075 | controller | "path": "/home/zuul/ci-framework-data/artifacts/parameters/custom-params.yml", 2025-10-13 20:41:31.901110 | controller | "pw_name": "zuul", 2025-10-13 20:41:31.901145 | controller | "rgrp": true, 2025-10-13 20:41:31.901183 | controller | "roth": true, 2025-10-13 20:41:31.901219 | controller | "rusr": true, 2025-10-13 20:41:31.901254 | controller | "size": 1785, 2025-10-13 20:41:31.901289 | controller | "uid": 1000, 2025-10-13 20:41:31.901324 | controller | "wgrp": false, 2025-10-13 20:41:31.901358 | controller | "woth": false, 2025-10-13 20:41:31.901393 | controller | "wusr": true, 2025-10-13 20:41:31.901427 | controller | "xgrp": false, 2025-10-13 20:41:31.901461 | controller | "xoth": false, 2025-10-13 20:41:31.901496 | controller | "xusr": false 2025-10-13 20:41:31.901530 | controller | } 2025-10-13 20:41:32.089259 | controller | ok: 2025-10-13 20:41:32.089413 | controller | { 2025-10-13 20:41:32.089469 | controller | "atime": 1760384042.254955, 2025-10-13 20:41:32.089510 | controller | "ctime": 1760384029.1906323, 2025-10-13 20:41:32.089547 | controller | "dev": 64513, 2025-10-13 20:41:32.089584 | controller | "gid": 1000, 2025-10-13 20:41:32.089621 | controller | "gr_name": "zuul", 2025-10-13 20:41:32.089656 | controller | "inode": 21267888, 2025-10-13 20:41:32.089690 | controller | "isblk": false, 2025-10-13 20:41:32.089761 | controller | "ischr": false, 2025-10-13 20:41:32.089958 | controller | "isdir": false, 2025-10-13 20:41:32.090009 | controller | "isfifo": false, 2025-10-13 20:41:32.090044 | controller | "isgid": false, 2025-10-13 20:41:32.090078 | controller | "islnk": false, 2025-10-13 20:41:32.090111 | controller | "isreg": true, 2025-10-13 20:41:32.090145 | controller | "issock": false, 2025-10-13 20:41:32.090178 | controller | "isuid": false, 2025-10-13 20:41:32.090210 | controller | "mode": "0600", 2025-10-13 20:41:32.090242 | controller | "mtime": 1760384029.0336285, 2025-10-13 20:41:32.090275 | controller | "nlink": 1, 2025-10-13 20:41:32.090307 | controller | "path": "/home/zuul/ci-framework-data/artifacts/parameters/openshift-login-params.yml", 2025-10-13 20:41:32.090340 | controller | "pw_name": "zuul", 2025-10-13 20:41:32.090373 | controller | "rgrp": false, 2025-10-13 20:41:32.090406 | controller | "roth": false, 2025-10-13 20:41:32.090440 | controller | "rusr": true, 2025-10-13 20:41:32.090473 | controller | "size": 280, 2025-10-13 20:41:32.090505 | controller | "uid": 1000, 2025-10-13 20:41:32.090536 | controller | "wgrp": false, 2025-10-13 20:41:32.090568 | controller | "woth": false, 2025-10-13 20:41:32.090600 | controller | "wusr": true, 2025-10-13 20:41:32.090632 | controller | "xgrp": false, 2025-10-13 20:41:32.090665 | controller | "xoth": false, 2025-10-13 20:41:32.090716 | controller | "xusr": false 2025-10-13 20:41:32.090807 | controller | } 2025-10-13 20:41:32.273826 | controller | ok: 2025-10-13 20:41:32.273976 | controller | { 2025-10-13 20:41:32.274027 | controller | "atime": 1760384045.0920255, 2025-10-13 20:41:32.274070 | controller | "ctime": 1760384043.2879806, 2025-10-13 20:41:32.274107 | controller | "dev": 64513, 2025-10-13 20:41:32.274143 | controller | "gid": 1000, 2025-10-13 20:41:32.274180 | controller | "gr_name": "zuul", 2025-10-13 20:41:32.274216 | controller | "inode": 42071463, 2025-10-13 20:41:32.274251 | controller | "isblk": false, 2025-10-13 20:41:32.274285 | controller | "ischr": false, 2025-10-13 20:41:32.274320 | controller | "isdir": false, 2025-10-13 20:41:32.274354 | controller | "isfifo": false, 2025-10-13 20:41:32.274388 | controller | "isgid": false, 2025-10-13 20:41:32.274422 | controller | "islnk": false, 2025-10-13 20:41:32.274455 | controller | "isreg": true, 2025-10-13 20:41:32.274491 | controller | "issock": false, 2025-10-13 20:41:32.274532 | controller | "isuid": false, 2025-10-13 20:41:32.274569 | controller | "mode": "0644", 2025-10-13 20:41:32.274604 | controller | "mtime": 1760384042.9959733, 2025-10-13 20:41:32.274639 | controller | "nlink": 1, 2025-10-13 20:41:32.274674 | controller | "path": "/home/zuul/ci-framework-data/artifacts/parameters/pre_kuttl_fetch_crc_facts_and_save_them_.yml", 2025-10-13 20:41:32.274711 | controller | "pw_name": "zuul", 2025-10-13 20:41:32.274812 | controller | "rgrp": true, 2025-10-13 20:41:32.274853 | controller | "roth": true, 2025-10-13 20:41:32.274890 | controller | "rusr": true, 2025-10-13 20:41:32.274926 | controller | "size": 116, 2025-10-13 20:41:32.274961 | controller | "uid": 1000, 2025-10-13 20:41:32.274996 | controller | "wgrp": false, 2025-10-13 20:41:32.275030 | controller | "woth": false, 2025-10-13 20:41:32.275065 | controller | "wusr": true, 2025-10-13 20:41:32.275099 | controller | "xgrp": false, 2025-10-13 20:41:32.275133 | controller | "xoth": false, 2025-10-13 20:41:32.275167 | controller | "xusr": false 2025-10-13 20:41:32.275201 | controller | } 2025-10-13 20:41:32.301121 | 2025-10-13 20:41:32.301314 | LOOP [cifmw_helpers : Call task to parse all files as fact] 2025-10-13 20:41:32.373450 | controller | Output suppressed because no_log was given 2025-10-13 20:41:32.389690 | controller | Output suppressed because no_log was given 2025-10-13 20:41:32.401792 | controller | Output suppressed because no_log was given 2025-10-13 20:41:32.413771 | controller | Output suppressed because no_log was given 2025-10-13 20:41:32.422039 | controller | Output suppressed because no_log was given 2025-10-13 20:41:32.451511 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/set_dir_facts.yml 2025-10-13 20:41:32.454135 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/set_dir_facts.yml 2025-10-13 20:41:32.456411 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/set_dir_facts.yml 2025-10-13 20:41:32.458625 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/set_dir_facts.yml 2025-10-13 20:41:32.461347 | controller | included: /var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/roles/cifmw_helpers/tasks/set_dir_facts.yml 2025-10-13 20:41:32.475806 | 2025-10-13 20:41:32.475919 | LOOP [cifmw_helpers : Set files as fact] 2025-10-13 20:41:32.533560 | controller | ok: 2025-10-13 20:41:32.534097 | controller | { 2025-10-13 20:41:32.534171 | controller | "key": "cifmw_artifacts_crc_sshkey", 2025-10-13 20:41:32.534228 | controller | "value": "~/.ssh/id_cifw" 2025-10-13 20:41:32.534269 | controller | } 2025-10-13 20:41:32.534344 | controller | ok: All items complete 2025-10-13 20:41:32.534393 | 2025-10-13 20:41:32.547557 | controller | ok: 2025-10-13 20:41:32.547670 | controller | { 2025-10-13 20:41:32.547801 | controller | "key": "cifmw_dlrn_report_result", 2025-10-13 20:41:32.547858 | controller | "value": false 2025-10-13 20:41:32.547901 | controller | } 2025-10-13 20:41:32.561268 | controller | ok: 2025-10-13 20:41:32.561370 | controller | { 2025-10-13 20:41:32.561420 | controller | "key": "cifmw_extras", 2025-10-13 20:41:32.561459 | controller | "value": [ 2025-10-13 20:41:32.561495 | controller | "@scenarios/centos-9/kuttl_multinode.yml" 2025-10-13 20:41:32.561530 | controller | ] 2025-10-13 20:41:32.561565 | controller | } 2025-10-13 20:41:32.570174 | controller | ok: 2025-10-13 20:41:32.570261 | controller | { 2025-10-13 20:41:32.570293 | controller | "key": "cifmw_kuttl_tests_operator_list", 2025-10-13 20:41:32.570319 | controller | "value": [ 2025-10-13 20:41:32.570344 | controller | "openstack", 2025-10-13 20:41:32.570368 | controller | "barbican", 2025-10-13 20:41:32.570392 | controller | "keystone", 2025-10-13 20:41:32.570414 | controller | "horizon" 2025-10-13 20:41:32.570436 | controller | ] 2025-10-13 20:41:32.570459 | controller | } 2025-10-13 20:41:32.577850 | controller | ok: 2025-10-13 20:41:32.577911 | controller | { 2025-10-13 20:41:32.577943 | controller | "key": "cifmw_openshift_api", 2025-10-13 20:41:32.577969 | controller | "value": "api.crc.testing:6443" 2025-10-13 20:41:32.577993 | controller | } 2025-10-13 20:41:32.585485 | controller | ok: 2025-10-13 20:41:32.585582 | controller | { 2025-10-13 20:41:32.585617 | controller | "key": "cifmw_openshift_kubeconfig", 2025-10-13 20:41:32.585643 | controller | "value": "{{ ansible_user_dir }}/.crc/machines/crc/kubeconfig" 2025-10-13 20:41:32.585669 | controller | } 2025-10-13 20:41:32.593188 | controller | ok: 2025-10-13 20:41:32.593250 | controller | { 2025-10-13 20:41:32.593281 | controller | "key": "cifmw_openshift_password", 2025-10-13 20:41:32.593306 | controller | "value": "123456789" 2025-10-13 20:41:32.593330 | controller | } 2025-10-13 20:41:32.600976 | controller | ok: 2025-10-13 20:41:32.601120 | controller | { 2025-10-13 20:41:32.601145 | controller | "key": "cifmw_openshift_skip_tls_verify", 2025-10-13 20:41:32.601168 | controller | "value": true 2025-10-13 20:41:32.601194 | controller | } 2025-10-13 20:41:32.607198 | controller | ok: 2025-10-13 20:41:32.607249 | controller | { 2025-10-13 20:41:32.607274 | controller | "key": "cifmw_openshift_user", 2025-10-13 20:41:32.607298 | controller | "value": "kubeadmin" 2025-10-13 20:41:32.607317 | controller | } 2025-10-13 20:41:32.612570 | controller | ok: 2025-10-13 20:41:32.612624 | controller | { 2025-10-13 20:41:32.612654 | controller | "key": "cifmw_use_libvirt", 2025-10-13 20:41:32.612676 | controller | "value": false 2025-10-13 20:41:32.612698 | controller | } 2025-10-13 20:41:32.618014 | controller | ok: 2025-10-13 20:41:32.618066 | controller | { 2025-10-13 20:41:32.618089 | controller | "key": "cifmw_zuul_target_host", 2025-10-13 20:41:32.618106 | controller | "value": "controller" 2025-10-13 20:41:32.618122 | controller | } 2025-10-13 20:41:32.623192 | controller | ok: 2025-10-13 20:41:32.623236 | controller | { 2025-10-13 20:41:32.623258 | controller | "key": "commands_after_kuttl_run", 2025-10-13 20:41:32.623276 | controller | "value": [ 2025-10-13 20:41:32.623293 | controller | "oc get pv", 2025-10-13 20:41:32.623309 | controller | "oc get all" 2025-10-13 20:41:32.623324 | controller | ] 2025-10-13 20:41:32.623341 | controller | } 2025-10-13 20:41:32.628596 | controller | ok: 2025-10-13 20:41:32.628643 | controller | { 2025-10-13 20:41:32.628673 | controller | "key": "commands_before_kuttl_run", 2025-10-13 20:41:32.628755 | controller | "value": [ 2025-10-13 20:41:32.628783 | controller | "oc get pv", 2025-10-13 20:41:32.628808 | controller | "oc get all" 2025-10-13 20:41:32.628824 | controller | ] 2025-10-13 20:41:32.628840 | controller | } 2025-10-13 20:41:32.634014 | controller | ok: 2025-10-13 20:41:32.634138 | controller | { 2025-10-13 20:41:32.634166 | controller | "key": "crc_ci_bootstrap_cloud_name", 2025-10-13 20:41:32.634184 | controller | "value": "{{ nodepool.cloud | replace('-nodepool-tripleo','') }}" 2025-10-13 20:41:32.634201 | controller | } 2025-10-13 20:41:32.639609 | controller | ok: 2025-10-13 20:41:32.639654 | controller | { 2025-10-13 20:41:32.639676 | controller | "key": "crc_ci_bootstrap_networking", 2025-10-13 20:41:32.639693 | controller | "value": { 2025-10-13 20:41:32.639709 | controller | "instances": { 2025-10-13 20:41:32.639757 | controller | "controller": { 2025-10-13 20:41:32.639781 | controller | "networks": { 2025-10-13 20:41:32.639798 | controller | "default": { 2025-10-13 20:41:32.639814 | controller | "ip": "192.168.122.11" 2025-10-13 20:41:32.639829 | controller | } 2025-10-13 20:41:32.639844 | controller | } 2025-10-13 20:41:32.639859 | controller | }, 2025-10-13 20:41:32.639874 | controller | "crc": { 2025-10-13 20:41:32.639908 | controller | "networks": { 2025-10-13 20:41:32.639928 | controller | "default": { 2025-10-13 20:41:32.639946 | controller | "ip": "192.168.122.10" 2025-10-13 20:41:32.639963 | controller | }, 2025-10-13 20:41:32.639979 | controller | "internal-api": { 2025-10-13 20:41:32.639996 | controller | "ip": "172.17.0.5" 2025-10-13 20:41:32.640013 | controller | }, 2025-10-13 20:41:32.640029 | controller | "storage": { 2025-10-13 20:41:32.640045 | controller | "ip": "172.18.0.5" 2025-10-13 20:41:32.640062 | controller | }, 2025-10-13 20:41:32.640078 | controller | "tenant": { 2025-10-13 20:41:32.640095 | controller | "ip": "172.19.0.5" 2025-10-13 20:41:32.640111 | controller | } 2025-10-13 20:41:32.640127 | controller | } 2025-10-13 20:41:32.640144 | controller | } 2025-10-13 20:41:32.640159 | controller | }, 2025-10-13 20:41:32.640174 | controller | "networks": { 2025-10-13 20:41:32.640189 | controller | "default": { 2025-10-13 20:41:32.640204 | controller | "mtu": "{{ ('ibm' in nodepool.cloud) | ternary('1440', '1500') }}", 2025-10-13 20:41:32.640219 | controller | "range": "192.168.122.0/24", 2025-10-13 20:41:32.640234 | controller | "router": false, 2025-10-13 20:41:32.640249 | controller | "router_net": "", 2025-10-13 20:41:32.640264 | controller | "transparent": true 2025-10-13 20:41:32.640278 | controller | }, 2025-10-13 20:41:32.640293 | controller | "internal-api": { 2025-10-13 20:41:32.640308 | controller | "range": "172.17.0.0/24", 2025-10-13 20:41:32.640322 | controller | "vlan": 20 2025-10-13 20:41:32.640337 | controller | }, 2025-10-13 20:41:32.640352 | controller | "storage": { 2025-10-13 20:41:32.640367 | controller | "range": "172.18.0.0/24", 2025-10-13 20:41:32.640381 | controller | "vlan": 21 2025-10-13 20:41:32.640397 | controller | }, 2025-10-13 20:41:32.640412 | controller | "tenant": { 2025-10-13 20:41:32.640427 | controller | "range": "172.19.0.0/24", 2025-10-13 20:41:32.640442 | controller | "vlan": 22 2025-10-13 20:41:32.640456 | controller | } 2025-10-13 20:41:32.640471 | controller | } 2025-10-13 20:41:32.640485 | controller | } 2025-10-13 20:41:32.640499 | controller | } 2025-10-13 20:41:32.646212 | controller | ok: 2025-10-13 20:41:32.646267 | controller | { 2025-10-13 20:41:32.646290 | controller | "key": "enable_ramdisk", 2025-10-13 20:41:32.646308 | controller | "value": true 2025-10-13 20:41:32.646326 | controller | } 2025-10-13 20:41:32.651806 | controller | ok: 2025-10-13 20:41:32.651869 | controller | { 2025-10-13 20:41:32.651953 | controller | "key": "push_registry", 2025-10-13 20:41:32.651977 | controller | "value": "quay.rdoproject.org" 2025-10-13 20:41:32.651995 | controller | } 2025-10-13 20:41:32.657464 | controller | ok: 2025-10-13 20:41:32.657509 | controller | { 2025-10-13 20:41:32.657531 | controller | "key": "quay_login_secret_name", 2025-10-13 20:41:32.657548 | controller | "value": "quay_nextgen_zuulgithubci" 2025-10-13 20:41:32.657566 | controller | } 2025-10-13 20:41:32.662741 | controller | ok: 2025-10-13 20:41:32.662786 | controller | { 2025-10-13 20:41:32.662809 | controller | "key": "registry_login_enabled", 2025-10-13 20:41:32.662826 | controller | "value": true 2025-10-13 20:41:32.662842 | controller | } 2025-10-13 20:41:32.708499 | controller | ok: 2025-10-13 20:41:32.708603 | controller | { 2025-10-13 20:41:32.708626 | controller | "key": "zuul", 2025-10-13 20:41:32.708643 | controller | "value": { 2025-10-13 20:41:32.708660 | controller | "_inheritance_path": [ 2025-10-13 20:41:32.708677 | controller | "", 2025-10-13 20:41:32.708693 | controller | "", 2025-10-13 20:41:32.708709 | controller | "", 2025-10-13 20:41:32.708740 | controller | "", 2025-10-13 20:41:32.708763 | controller | "", 2025-10-13 20:41:32.708779 | controller | "" 2025-10-13 20:41:32.708795 | controller | ], 2025-10-13 20:41:32.708810 | controller | "ansible_version": "8", 2025-10-13 20:41:32.708825 | controller | "attempts": 1, 2025-10-13 20:41:32.708840 | controller | "branch": "main", 2025-10-13 20:41:32.708855 | controller | "build": "99d5f1cd38d94d13a70c490f97e6f024", 2025-10-13 20:41:32.708870 | controller | "build_refs": [ 2025-10-13 20:41:32.708885 | controller | { 2025-10-13 20:41:32.708899 | controller | "branch": "main", 2025-10-13 20:41:32.708914 | controller | "change": "3402", 2025-10-13 20:41:32.708929 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3402", 2025-10-13 20:41:32.708944 | controller | "commit_id": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.708958 | controller | "patchset": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.708974 | controller | "project": { 2025-10-13 20:41:32.708992 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.709007 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709023 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709038 | controller | "short_name": "ci-framework" 2025-10-13 20:41:32.709053 | controller | }, 2025-10-13 20:41:32.709069 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709086 | controller | "topic": null 2025-10-13 20:41:32.709102 | controller | } 2025-10-13 20:41:32.709117 | controller | ], 2025-10-13 20:41:32.709132 | controller | "buildset": "e5c2c74e6a054797a69748296705be8d", 2025-10-13 20:41:32.709146 | controller | "buildset_refs": [ 2025-10-13 20:41:32.709161 | controller | { 2025-10-13 20:41:32.709176 | controller | "branch": "main", 2025-10-13 20:41:32.709192 | controller | "change": "3402", 2025-10-13 20:41:32.709207 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3402", 2025-10-13 20:41:32.709231 | controller | "commit_id": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.709247 | controller | "patchset": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.709263 | controller | "project": { 2025-10-13 20:41:32.709278 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.709293 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709308 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709322 | controller | "short_name": "ci-framework" 2025-10-13 20:41:32.709337 | controller | }, 2025-10-13 20:41:32.709351 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709366 | controller | "topic": null 2025-10-13 20:41:32.709381 | controller | } 2025-10-13 20:41:32.709395 | controller | ], 2025-10-13 20:41:32.709410 | controller | "change": "3402", 2025-10-13 20:41:32.709425 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3402", 2025-10-13 20:41:32.709439 | controller | "child_jobs": [], 2025-10-13 20:41:32.709453 | controller | "commit_id": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.709467 | controller | "event_id": "8207d830-a869-11f0-8ae9-c38a08a1225e", 2025-10-13 20:41:32.709481 | controller | "executor": { 2025-10-13 20:41:32.709495 | controller | "hostname": "ze03.softwarefactory-project.io", 2025-10-13 20:41:32.709509 | controller | "inventory_file": "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/ansible/inventory.yaml", 2025-10-13 20:41:32.709524 | controller | "log_root": "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/logs", 2025-10-13 20:41:32.709538 | controller | "result_data_file": "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/results.json", 2025-10-13 20:41:32.709553 | controller | "src_root": "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/src", 2025-10-13 20:41:32.709567 | controller | "work_root": "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work" 2025-10-13 20:41:32.709582 | controller | }, 2025-10-13 20:41:32.709596 | controller | "items": [ 2025-10-13 20:41:32.709611 | controller | { 2025-10-13 20:41:32.709629 | controller | "branch": "main", 2025-10-13 20:41:32.709645 | controller | "change": "3404", 2025-10-13 20:41:32.709660 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3404", 2025-10-13 20:41:32.709676 | controller | "commit_id": "9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8", 2025-10-13 20:41:32.709690 | controller | "patchset": "9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8", 2025-10-13 20:41:32.709705 | controller | "project": { 2025-10-13 20:41:32.709719 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.709755 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709771 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709786 | controller | "short_name": "ci-framework", 2025-10-13 20:41:32.709801 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:32.709815 | controller | }, 2025-10-13 20:41:32.709831 | controller | "topic": null 2025-10-13 20:41:32.709846 | controller | }, 2025-10-13 20:41:32.709860 | controller | { 2025-10-13 20:41:32.709876 | controller | "branch": "main", 2025-10-13 20:41:32.709890 | controller | "change": "3406", 2025-10-13 20:41:32.709905 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3406", 2025-10-13 20:41:32.709920 | controller | "commit_id": "3b7e5d87cb08f8ceea89c6e58502f20dfffec667", 2025-10-13 20:41:32.709941 | controller | "patchset": "3b7e5d87cb08f8ceea89c6e58502f20dfffec667", 2025-10-13 20:41:32.709956 | controller | "project": { 2025-10-13 20:41:32.709970 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.709985 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.709999 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.710013 | controller | "short_name": "ci-framework", 2025-10-13 20:41:32.710028 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:32.710043 | controller | }, 2025-10-13 20:41:32.710058 | controller | "topic": null 2025-10-13 20:41:32.710072 | controller | }, 2025-10-13 20:41:32.710087 | controller | { 2025-10-13 20:41:32.710102 | controller | "branch": "main", 2025-10-13 20:41:32.710117 | controller | "change": "3402", 2025-10-13 20:41:32.710132 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3402", 2025-10-13 20:41:32.710147 | controller | "commit_id": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.710162 | controller | "patchset": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.710176 | controller | "project": { 2025-10-13 20:41:32.710190 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.710204 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.710219 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.710233 | controller | "short_name": "ci-framework", 2025-10-13 20:41:32.710247 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:32.710262 | controller | }, 2025-10-13 20:41:32.710276 | controller | "topic": null 2025-10-13 20:41:32.710291 | controller | } 2025-10-13 20:41:32.710306 | controller | ], 2025-10-13 20:41:32.710322 | controller | "job": "cifmw-multinode-kuttl", 2025-10-13 20:41:32.710337 | controller | "jobtags": [], 2025-10-13 20:41:32.710351 | controller | "max_attempts": 1, 2025-10-13 20:41:32.710366 | controller | "message": "Q2hlY2sgZ2xvYmFsIHZhcnMKCkNoZWNraW5nIEFtYXJ0eWEgY2hhbmdlIGh0dHBzOi8vZ2l0aHViLmNvbS9vcGVuc3RhY2stazhzLW9wZXJhdG9ycy9jaS1mcmFtZXdvcmsvcHVsbC8zMjM3DQoNCkRlcGVuZHMtT246IGh0dHBzOi8vZ2l0aHViLmNvbS9vcGVuc3RhY2stazhzLW9wZXJhdG9ycy9jaS1mcmFtZXdvcmsvcHVsbC8zNDA0DQpEZXBlbmRzLU9uOiBodHRwczovL2dpdGh1Yi5jb20vb3BlbnN0YWNrLWs4cy1vcGVyYXRvcnMvY2ktZnJhbWV3b3JrL3B1bGwvMzQwNg==", 2025-10-13 20:41:32.710382 | controller | "patchset": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:32.710397 | controller | "pipeline": "github-check", 2025-10-13 20:41:32.710412 | controller | "playbook_context": { 2025-10-13 20:41:32.710426 | controller | "playbook_projects": { 2025-10-13 20:41:32.710441 | controller | "trusted/project_0/review.rdoproject.org/config": { 2025-10-13 20:41:32.710456 | controller | "canonical_name": "review.rdoproject.org/config", 2025-10-13 20:41:32.710470 | controller | "checkout": "master", 2025-10-13 20:41:32.710485 | controller | "commit": "381c86678f470a5590d19274a2eb914e95b81bb7" 2025-10-13 20:41:32.710500 | controller | }, 2025-10-13 20:41:32.710515 | controller | "trusted/project_1/opendev.org/zuul/zuul-jobs": { 2025-10-13 20:41:32.710530 | controller | "canonical_name": "opendev.org/zuul/zuul-jobs", 2025-10-13 20:41:32.710544 | controller | "checkout": "master", 2025-10-13 20:41:32.710559 | controller | "commit": "3f62739c27168ebe05c65ba9b26a90fe6a6268df" 2025-10-13 20:41:32.710573 | controller | }, 2025-10-13 20:41:32.710587 | controller | "trusted/project_2/review.rdoproject.org/rdo-jobs": { 2025-10-13 20:41:32.710606 | controller | "canonical_name": "review.rdoproject.org/rdo-jobs", 2025-10-13 20:41:32.710621 | controller | "checkout": "master", 2025-10-13 20:41:32.710635 | controller | "commit": "d207d5ad1c5824d6db58c2eb5935a8b36674cbe4" 2025-10-13 20:41:32.710649 | controller | }, 2025-10-13 20:41:32.710663 | controller | "trusted/project_3/github.com/openstack-k8s-operators/ci-framework": { 2025-10-13 20:41:32.710677 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.710691 | controller | "checkout": "main", 2025-10-13 20:41:32.710706 | controller | "commit": "83c519fd71419e4026bedcf1c5a674babf8a073c" 2025-10-13 20:41:32.710720 | controller | }, 2025-10-13 20:41:32.710766 | controller | "untrusted/project_0/github.com/openstack-k8s-operators/ci-framework": { 2025-10-13 20:41:32.710782 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.710796 | controller | "checkout": "main", 2025-10-13 20:41:32.710811 | controller | "commit": "c48116c389d8d4c922f296352783dcbbacce7087" 2025-10-13 20:41:32.710825 | controller | }, 2025-10-13 20:41:32.710840 | controller | "untrusted/project_1/review.rdoproject.org/config": { 2025-10-13 20:41:32.710854 | controller | "canonical_name": "review.rdoproject.org/config", 2025-10-13 20:41:32.710868 | controller | "checkout": "master", 2025-10-13 20:41:32.710883 | controller | "commit": "381c86678f470a5590d19274a2eb914e95b81bb7" 2025-10-13 20:41:32.710897 | controller | }, 2025-10-13 20:41:32.710911 | controller | "untrusted/project_2/opendev.org/zuul/zuul-jobs": { 2025-10-13 20:41:32.710926 | controller | "canonical_name": "opendev.org/zuul/zuul-jobs", 2025-10-13 20:41:32.710940 | controller | "checkout": "master", 2025-10-13 20:41:32.710955 | controller | "commit": "3f62739c27168ebe05c65ba9b26a90fe6a6268df" 2025-10-13 20:41:32.710969 | controller | }, 2025-10-13 20:41:32.710984 | controller | "untrusted/project_3/review.rdoproject.org/rdo-jobs": { 2025-10-13 20:41:32.710998 | controller | "canonical_name": "review.rdoproject.org/rdo-jobs", 2025-10-13 20:41:32.711012 | controller | "checkout": "master", 2025-10-13 20:41:32.711026 | controller | "commit": "d207d5ad1c5824d6db58c2eb5935a8b36674cbe4" 2025-10-13 20:41:32.711040 | controller | } 2025-10-13 20:41:32.711055 | controller | }, 2025-10-13 20:41:32.711069 | controller | "playbooks": [ 2025-10-13 20:41:32.711083 | controller | { 2025-10-13 20:41:32.711098 | controller | "path": "untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/dump_zuul_data.yml", 2025-10-13 20:41:32.711114 | controller | "roles": [ 2025-10-13 20:41:32.711129 | controller | { 2025-10-13 20:41:32.711143 | controller | "checkout": "main", 2025-10-13 20:41:32.711158 | controller | "checkout_description": "playbook branch", 2025-10-13 20:41:32.711173 | controller | "link_name": "ansible/playbook_0/role_0/ci-framework", 2025-10-13 20:41:32.711187 | controller | "link_target": "untrusted/project_0/github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.711201 | controller | "role_path": "ansible/playbook_0/role_0/ci-framework/roles" 2025-10-13 20:41:32.711216 | controller | }, 2025-10-13 20:41:32.711231 | controller | { 2025-10-13 20:41:32.711246 | controller | "checkout": "master", 2025-10-13 20:41:32.711261 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.711275 | controller | "link_name": "ansible/playbook_0/role_1/config", 2025-10-13 20:41:32.711290 | controller | "link_target": "untrusted/project_1/review.rdoproject.org/config", 2025-10-13 20:41:32.711309 | controller | "role_path": "ansible/playbook_0/role_1/config/roles" 2025-10-13 20:41:32.711324 | controller | }, 2025-10-13 20:41:32.711339 | controller | { 2025-10-13 20:41:32.711354 | controller | "checkout": "master", 2025-10-13 20:41:32.711369 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.711384 | controller | "link_name": "ansible/playbook_0/role_2/zuul-jobs", 2025-10-13 20:41:32.711399 | controller | "link_target": "untrusted/project_2/opendev.org/zuul/zuul-jobs", 2025-10-13 20:41:32.711413 | controller | "role_path": "ansible/playbook_0/role_2/zuul-jobs/roles" 2025-10-13 20:41:32.711428 | controller | }, 2025-10-13 20:41:32.711442 | controller | { 2025-10-13 20:41:32.711457 | controller | "checkout": "master", 2025-10-13 20:41:32.711471 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.711486 | controller | "link_name": "ansible/playbook_0/role_3/rdo-jobs", 2025-10-13 20:41:32.711500 | controller | "link_target": "untrusted/project_3/review.rdoproject.org/rdo-jobs", 2025-10-13 20:41:32.711515 | controller | "role_path": "ansible/playbook_0/role_3/rdo-jobs/roles" 2025-10-13 20:41:32.711530 | controller | } 2025-10-13 20:41:32.711545 | controller | ] 2025-10-13 20:41:32.711559 | controller | }, 2025-10-13 20:41:32.711574 | controller | { 2025-10-13 20:41:32.711588 | controller | "path": "untrusted/project_0/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run.yml", 2025-10-13 20:41:32.711603 | controller | "roles": [ 2025-10-13 20:41:32.711618 | controller | { 2025-10-13 20:41:32.711632 | controller | "checkout": "main", 2025-10-13 20:41:32.711647 | controller | "checkout_description": "playbook branch", 2025-10-13 20:41:32.711661 | controller | "link_name": "ansible/playbook_1/role_0/ci-framework", 2025-10-13 20:41:32.711676 | controller | "link_target": "untrusted/project_0/github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.711690 | controller | "role_path": "ansible/playbook_1/role_0/ci-framework/roles" 2025-10-13 20:41:32.711704 | controller | }, 2025-10-13 20:41:32.711719 | controller | { 2025-10-13 20:41:32.711753 | controller | "checkout": "master", 2025-10-13 20:41:32.711770 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.711786 | controller | "link_name": "ansible/playbook_1/role_1/config", 2025-10-13 20:41:32.711801 | controller | "link_target": "untrusted/project_1/review.rdoproject.org/config", 2025-10-13 20:41:32.711815 | controller | "role_path": "ansible/playbook_1/role_1/config/roles" 2025-10-13 20:41:32.711830 | controller | }, 2025-10-13 20:41:32.711846 | controller | { 2025-10-13 20:41:32.711862 | controller | "checkout": "master", 2025-10-13 20:41:32.711878 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.711892 | controller | "link_name": "ansible/playbook_1/role_2/zuul-jobs", 2025-10-13 20:41:32.711907 | controller | "link_target": "untrusted/project_2/opendev.org/zuul/zuul-jobs", 2025-10-13 20:41:32.711921 | controller | "role_path": "ansible/playbook_1/role_2/zuul-jobs/roles" 2025-10-13 20:41:32.711936 | controller | }, 2025-10-13 20:41:32.711950 | controller | { 2025-10-13 20:41:32.711965 | controller | "checkout": "master", 2025-10-13 20:41:32.711979 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.712013 | controller | "link_name": "ansible/playbook_1/role_3/rdo-jobs", 2025-10-13 20:41:32.712034 | controller | "link_target": "untrusted/project_3/review.rdoproject.org/rdo-jobs", 2025-10-13 20:41:32.712049 | controller | "role_path": "ansible/playbook_1/role_3/rdo-jobs/roles" 2025-10-13 20:41:32.712064 | controller | } 2025-10-13 20:41:32.712078 | controller | ] 2025-10-13 20:41:32.712093 | controller | } 2025-10-13 20:41:32.712107 | controller | ] 2025-10-13 20:41:32.712122 | controller | }, 2025-10-13 20:41:32.712136 | controller | "post_review": false, 2025-10-13 20:41:32.712151 | controller | "project": { 2025-10-13 20:41:32.712166 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.712181 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.712195 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.712210 | controller | "short_name": "ci-framework", 2025-10-13 20:41:32.712224 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:32.712239 | controller | }, 2025-10-13 20:41:32.712254 | controller | "projects": { 2025-10-13 20:41:32.712271 | controller | "github.com/crc-org/crc-cloud": { 2025-10-13 20:41:32.712286 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.712301 | controller | "canonical_name": "github.com/crc-org/crc-cloud", 2025-10-13 20:41:32.712315 | controller | "checkout": "main", 2025-10-13 20:41:32.712330 | controller | "checkout_description": "project override ref", 2025-10-13 20:41:32.712345 | controller | "commit": "f6ed2f2d118884a075895bbf954ff6000e540430", 2025-10-13 20:41:32.712360 | controller | "name": "crc-org/crc-cloud", 2025-10-13 20:41:32.712375 | controller | "required": true, 2025-10-13 20:41:32.712390 | controller | "short_name": "crc-cloud", 2025-10-13 20:41:32.712405 | controller | "src_dir": "src/github.com/crc-org/crc-cloud" 2025-10-13 20:41:32.712419 | controller | }, 2025-10-13 20:41:32.712435 | controller | "github.com/openstack-k8s-operators/ci-framework": { 2025-10-13 20:41:32.712449 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.712464 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.712479 | controller | "checkout": "main", 2025-10-13 20:41:32.712494 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.712509 | controller | "commit": "c48116c389d8d4c922f296352783dcbbacce7087", 2025-10-13 20:41:32.712523 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:32.712538 | controller | "required": true, 2025-10-13 20:41:32.712552 | controller | "short_name": "ci-framework", 2025-10-13 20:41:32.712566 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:32.712580 | controller | }, 2025-10-13 20:41:32.712595 | controller | "github.com/openstack-k8s-operators/edpm-ansible": { 2025-10-13 20:41:32.712609 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.712623 | controller | "canonical_name": "github.com/openstack-k8s-operators/edpm-ansible", 2025-10-13 20:41:32.712638 | controller | "checkout": "main", 2025-10-13 20:41:32.712652 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.712666 | controller | "commit": "95aa63de3182faad63a69301d101debad3efc936", 2025-10-13 20:41:32.712680 | controller | "name": "openstack-k8s-operators/edpm-ansible", 2025-10-13 20:41:32.712694 | controller | "required": true, 2025-10-13 20:41:32.712708 | controller | "short_name": "edpm-ansible", 2025-10-13 20:41:32.712722 | controller | "src_dir": "src/github.com/openstack-k8s-operators/edpm-ansible" 2025-10-13 20:41:32.712761 | controller | }, 2025-10-13 20:41:32.712778 | controller | "github.com/openstack-k8s-operators/infra-operator": { 2025-10-13 20:41:32.712793 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.712808 | controller | "canonical_name": "github.com/openstack-k8s-operators/infra-operator", 2025-10-13 20:41:32.712822 | controller | "checkout": "main", 2025-10-13 20:41:32.712836 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.712850 | controller | "commit": "5a8ec0e2bf69b554d65dcbbe333ec4e56e559a32", 2025-10-13 20:41:32.712864 | controller | "name": "openstack-k8s-operators/infra-operator", 2025-10-13 20:41:32.712878 | controller | "required": true, 2025-10-13 20:41:32.712893 | controller | "short_name": "infra-operator", 2025-10-13 20:41:32.712907 | controller | "src_dir": "src/github.com/openstack-k8s-operators/infra-operator" 2025-10-13 20:41:32.712921 | controller | }, 2025-10-13 20:41:32.712936 | controller | "github.com/openstack-k8s-operators/install_yamls": { 2025-10-13 20:41:32.712950 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.712964 | controller | "canonical_name": "github.com/openstack-k8s-operators/install_yamls", 2025-10-13 20:41:32.712979 | controller | "checkout": "main", 2025-10-13 20:41:32.712993 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.713007 | controller | "commit": "cd83effcf3e2ad1f42b8b0a7f7e4cf815d4264b8", 2025-10-13 20:41:32.713021 | controller | "name": "openstack-k8s-operators/install_yamls", 2025-10-13 20:41:32.713036 | controller | "required": true, 2025-10-13 20:41:32.713050 | controller | "short_name": "install_yamls", 2025-10-13 20:41:32.713064 | controller | "src_dir": "src/github.com/openstack-k8s-operators/install_yamls" 2025-10-13 20:41:32.713078 | controller | }, 2025-10-13 20:41:32.713092 | controller | "github.com/openstack-k8s-operators/openstack-baremetal-operator": { 2025-10-13 20:41:32.713109 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.713126 | controller | "canonical_name": "github.com/openstack-k8s-operators/openstack-baremetal-operator", 2025-10-13 20:41:32.713141 | controller | "checkout": "main", 2025-10-13 20:41:32.713155 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.713170 | controller | "commit": "73411ba262221bf7c55117ca16717368be5dcfe1", 2025-10-13 20:41:32.713197 | controller | "name": "openstack-k8s-operators/openstack-baremetal-operator", 2025-10-13 20:41:32.713217 | controller | "required": true, 2025-10-13 20:41:32.713236 | controller | "short_name": "openstack-baremetal-operator", 2025-10-13 20:41:32.713361 | controller | "src_dir": "src/github.com/openstack-k8s-operators/openstack-baremetal-operator" 2025-10-13 20:41:32.713383 | controller | }, 2025-10-13 20:41:32.713399 | controller | "github.com/openstack-k8s-operators/openstack-must-gather": { 2025-10-13 20:41:32.713415 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.713431 | controller | "canonical_name": "github.com/openstack-k8s-operators/openstack-must-gather", 2025-10-13 20:41:32.713446 | controller | "checkout": "main", 2025-10-13 20:41:32.713460 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.713475 | controller | "commit": "b568b45052464ddc51ab2cd3235689894448b954", 2025-10-13 20:41:32.713490 | controller | "name": "openstack-k8s-operators/openstack-must-gather", 2025-10-13 20:41:32.713504 | controller | "required": true, 2025-10-13 20:41:32.713519 | controller | "short_name": "openstack-must-gather", 2025-10-13 20:41:32.713533 | controller | "src_dir": "src/github.com/openstack-k8s-operators/openstack-must-gather" 2025-10-13 20:41:32.713548 | controller | }, 2025-10-13 20:41:32.713568 | controller | "github.com/openstack-k8s-operators/openstack-operator": { 2025-10-13 20:41:32.713584 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.713598 | controller | "canonical_name": "github.com/openstack-k8s-operators/openstack-operator", 2025-10-13 20:41:32.713613 | controller | "checkout": "main", 2025-10-13 20:41:32.713627 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.713642 | controller | "commit": "db2406fc6f4d16351b74a75ecc7148f821e0f917", 2025-10-13 20:41:32.713656 | controller | "name": "openstack-k8s-operators/openstack-operator", 2025-10-13 20:41:32.713670 | controller | "required": true, 2025-10-13 20:41:32.713685 | controller | "short_name": "openstack-operator", 2025-10-13 20:41:32.713699 | controller | "src_dir": "src/github.com/openstack-k8s-operators/openstack-operator" 2025-10-13 20:41:32.713714 | controller | }, 2025-10-13 20:41:32.713748 | controller | "github.com/openstack-k8s-operators/repo-setup": { 2025-10-13 20:41:32.713766 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:32.713780 | controller | "canonical_name": "github.com/openstack-k8s-operators/repo-setup", 2025-10-13 20:41:32.713795 | controller | "checkout": "main", 2025-10-13 20:41:32.713810 | controller | "checkout_description": "zuul branch", 2025-10-13 20:41:32.713824 | controller | "commit": "37b10946c6a10f9fa26c13305f06bfd6867e723f", 2025-10-13 20:41:32.713838 | controller | "name": "openstack-k8s-operators/repo-setup", 2025-10-13 20:41:32.713853 | controller | "required": true, 2025-10-13 20:41:32.713867 | controller | "short_name": "repo-setup", 2025-10-13 20:41:32.713880 | controller | "src_dir": "src/github.com/openstack-k8s-operators/repo-setup" 2025-10-13 20:41:32.713894 | controller | }, 2025-10-13 20:41:32.713908 | controller | "opendev.org/zuul/zuul-jobs": { 2025-10-13 20:41:32.713922 | controller | "canonical_hostname": "opendev.org", 2025-10-13 20:41:32.713936 | controller | "canonical_name": "opendev.org/zuul/zuul-jobs", 2025-10-13 20:41:32.713950 | controller | "checkout": "master", 2025-10-13 20:41:32.713964 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.713978 | controller | "commit": "3f62739c27168ebe05c65ba9b26a90fe6a6268df", 2025-10-13 20:41:32.713993 | controller | "name": "zuul/zuul-jobs", 2025-10-13 20:41:32.714007 | controller | "required": true, 2025-10-13 20:41:32.714021 | controller | "short_name": "zuul-jobs", 2025-10-13 20:41:32.714035 | controller | "src_dir": "src/opendev.org/zuul/zuul-jobs" 2025-10-13 20:41:32.714049 | controller | }, 2025-10-13 20:41:32.714063 | controller | "review.rdoproject.org/config": { 2025-10-13 20:41:32.714077 | controller | "canonical_hostname": "review.rdoproject.org", 2025-10-13 20:41:32.714091 | controller | "canonical_name": "review.rdoproject.org/config", 2025-10-13 20:41:32.714106 | controller | "checkout": "master", 2025-10-13 20:41:32.714120 | controller | "checkout_description": "project default branch", 2025-10-13 20:41:32.714134 | controller | "commit": "381c86678f470a5590d19274a2eb914e95b81bb7", 2025-10-13 20:41:32.714148 | controller | "name": "config", 2025-10-13 20:41:32.714162 | controller | "required": true, 2025-10-13 20:41:32.714176 | controller | "short_name": "config", 2025-10-13 20:41:32.714190 | controller | "src_dir": "src/review.rdoproject.org/config" 2025-10-13 20:41:32.714204 | controller | } 2025-10-13 20:41:32.714218 | controller | }, 2025-10-13 20:41:32.714232 | controller | "ref": "refs/pull/3402/head", 2025-10-13 20:41:32.714246 | controller | "resources": {}, 2025-10-13 20:41:32.714260 | controller | "tenant": "rdoproject.org", 2025-10-13 20:41:32.714278 | controller | "timeout": 9000, 2025-10-13 20:41:32.714292 | controller | "topic": null, 2025-10-13 20:41:32.714307 | controller | "voting": true 2025-10-13 20:41:32.714321 | controller | } 2025-10-13 20:41:32.714336 | controller | } 2025-10-13 20:41:32.723990 | controller | ok: 2025-10-13 20:41:32.724061 | controller | { 2025-10-13 20:41:32.724204 | controller | "key": "zuul_log_collection", 2025-10-13 20:41:32.724230 | controller | "value": true 2025-10-13 20:41:32.724248 | controller | } 2025-10-13 20:41:32.802077 | 2025-10-13 20:41:32.802266 | LOOP [cifmw_helpers : Set files as fact] 2025-10-13 20:41:32.888327 | controller | ok: 2025-10-13 20:41:32.888569 | controller | { 2025-10-13 20:41:32.888596 | controller | "key": "cifmw_install_yamls_defaults", 2025-10-13 20:41:32.888614 | controller | "value": { 2025-10-13 20:41:32.888630 | controller | "ADOPTED_EXTERNAL_NETWORK": "172.21.1.0/24", 2025-10-13 20:41:32.888646 | controller | "ADOPTED_INTERNALAPI_NETWORK": "172.17.1.0/24", 2025-10-13 20:41:32.888662 | controller | "ADOPTED_STORAGEMGMT_NETWORK": "172.20.1.0/24", 2025-10-13 20:41:32.888678 | controller | "ADOPTED_STORAGE_NETWORK": "172.18.1.0/24", 2025-10-13 20:41:32.888697 | controller | "ADOPTED_TENANT_NETWORK": "172.9.1.0/24", 2025-10-13 20:41:32.888719 | controller | "ANSIBLEEE": "config/samples/_v1beta1_ansibleee.yaml", 2025-10-13 20:41:32.888766 | controller | "ANSIBLEEE_BRANCH": "main", 2025-10-13 20:41:32.888783 | controller | "ANSIBLEEE_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/config/samples/_v1beta1_ansibleee.yaml", 2025-10-13 20:41:32.888798 | controller | "ANSIBLEEE_IMG": "quay.io/openstack-k8s-operators/openstack-ansibleee-operator-index:latest", 2025-10-13 20:41:32.888813 | controller | "ANSIBLEEE_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/kuttl-test.yaml", 2025-10-13 20:41:32.888828 | controller | "ANSIBLEEE_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/tests/kuttl/tests", 2025-10-13 20:41:32.888843 | controller | "ANSIBLEEE_KUTTL_NAMESPACE": "ansibleee-kuttl-tests", 2025-10-13 20:41:32.888858 | controller | "ANSIBLEEE_REPO": "https://github.com/openstack-k8s-operators/openstack-ansibleee-operator", 2025-10-13 20:41:32.888873 | controller | "ANSIBLEE_COMMIT_HASH": "", 2025-10-13 20:41:32.888888 | controller | "BARBICAN": "config/samples/barbican_v1beta1_barbican.yaml", 2025-10-13 20:41:32.888902 | controller | "BARBICAN_BRANCH": "main", 2025-10-13 20:41:32.888919 | controller | "BARBICAN_COMMIT_HASH": "", 2025-10-13 20:41:32.888941 | controller | "BARBICAN_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/config/samples/barbican_v1beta1_barbican.yaml", 2025-10-13 20:41:32.888963 | controller | "BARBICAN_DEPL_IMG": "unused", 2025-10-13 20:41:32.888979 | controller | "BARBICAN_IMG": "quay.io/openstack-k8s-operators/barbican-operator-index:latest", 2025-10-13 20:41:32.888994 | controller | "BARBICAN_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/kuttl-test.yaml", 2025-10-13 20:41:32.889009 | controller | "BARBICAN_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/tests/kuttl/tests", 2025-10-13 20:41:32.889024 | controller | "BARBICAN_KUTTL_NAMESPACE": "barbican-kuttl-tests", 2025-10-13 20:41:32.889038 | controller | "BARBICAN_REPO": "https://github.com/openstack-k8s-operators/barbican-operator.git", 2025-10-13 20:41:32.889053 | controller | "BARBICAN_SERVICE_ENABLED": "true", 2025-10-13 20:41:32.889068 | controller | "BARBICAN_SIMPLE_CRYPTO_ENCRYPTION_KEY": "sEFmdFjDUqRM2VemYslV5yGNWjokioJXsg8Nrlc3drU=", 2025-10-13 20:41:32.889082 | controller | "BAREMETAL_BRANCH": "main", 2025-10-13 20:41:32.889097 | controller | "BAREMETAL_COMMIT_HASH": "", 2025-10-13 20:41:32.889111 | controller | "BAREMETAL_IMG": "quay.io/openstack-k8s-operators/openstack-baremetal-operator-index:latest", 2025-10-13 20:41:32.889133 | controller | "BAREMETAL_OS_CONTAINER_IMG": "", 2025-10-13 20:41:32.889148 | controller | "BAREMETAL_OS_IMG": "", 2025-10-13 20:41:32.889162 | controller | "BAREMETAL_REPO": "https://github.com/openstack-k8s-operators/openstack-baremetal-operator.git", 2025-10-13 20:41:32.889176 | controller | "BAREMETAL_TIMEOUT": "20m", 2025-10-13 20:41:32.889190 | controller | "BASH_IMG": "quay.io/openstack-k8s-operators/bash:latest", 2025-10-13 20:41:32.889204 | controller | "BGP_ASN": "64999", 2025-10-13 20:41:32.889218 | controller | "BGP_LEAF_1": "100.65.4.1", 2025-10-13 20:41:32.889232 | controller | "BGP_LEAF_2": "100.64.4.1", 2025-10-13 20:41:32.889246 | controller | "BGP_OVN_ROUTING": "false", 2025-10-13 20:41:32.889260 | controller | "BGP_PEER_ASN": "64999", 2025-10-13 20:41:32.889274 | controller | "BGP_SOURCE_IP": "172.30.4.2", 2025-10-13 20:41:32.889288 | controller | "BGP_SOURCE_IP6": "f00d:f00d:f00d:f00d:f00d:f00d:f00d:42", 2025-10-13 20:41:32.889302 | controller | "BMAAS_BRIDGE_IPV4_PREFIX": "172.20.1.2/24", 2025-10-13 20:41:32.889316 | controller | "BMAAS_BRIDGE_IPV6_PREFIX": "fd00:bbbb::2/64", 2025-10-13 20:41:32.889330 | controller | "BMAAS_INSTANCE_DISK_SIZE": "20", 2025-10-13 20:41:32.889344 | controller | "BMAAS_INSTANCE_MEMORY": "4096", 2025-10-13 20:41:32.889358 | controller | "BMAAS_INSTANCE_NAME_PREFIX": "crc-bmaas", 2025-10-13 20:41:32.889372 | controller | "BMAAS_INSTANCE_NET_MODEL": "virtio", 2025-10-13 20:41:32.889385 | controller | "BMAAS_INSTANCE_OS_VARIANT": "centos-stream9", 2025-10-13 20:41:32.889399 | controller | "BMAAS_INSTANCE_VCPUS": "2", 2025-10-13 20:41:32.889415 | controller | "BMAAS_INSTANCE_VIRT_TYPE": "kvm", 2025-10-13 20:41:32.889436 | controller | "BMAAS_IPV4": "true", 2025-10-13 20:41:32.889453 | controller | "BMAAS_IPV6": "false", 2025-10-13 20:41:32.889467 | controller | "BMAAS_LIBVIRT_USER": "sushyemu", 2025-10-13 20:41:32.889481 | controller | "BMAAS_METALLB_ADDRESS_POOL": "172.20.1.64/26", 2025-10-13 20:41:32.889495 | controller | "BMAAS_METALLB_POOL_NAME": "baremetal", 2025-10-13 20:41:32.889510 | controller | "BMAAS_NETWORK_IPV4_PREFIX": "172.20.1.1/24", 2025-10-13 20:41:32.889531 | controller | "BMAAS_NETWORK_IPV6_PREFIX": "fd00:bbbb::1/64", 2025-10-13 20:41:32.889549 | controller | "BMAAS_NETWORK_NAME": "crc-bmaas", 2025-10-13 20:41:32.889571 | controller | "BMAAS_NODE_COUNT": "1", 2025-10-13 20:41:32.889588 | controller | "BMAAS_OCP_INSTANCE_NAME": "crc", 2025-10-13 20:41:32.889603 | controller | "BMAAS_REDFISH_PASSWORD": "password", 2025-10-13 20:41:32.889618 | controller | "BMAAS_REDFISH_USERNAME": "admin", 2025-10-13 20:41:32.889632 | controller | "BMAAS_ROUTE_LIBVIRT_NETWORKS": "crc-bmaas,crc,default", 2025-10-13 20:41:32.889647 | controller | "BMAAS_SUSHY_EMULATOR_DRIVER": "libvirt", 2025-10-13 20:41:32.889661 | controller | "BMAAS_SUSHY_EMULATOR_IMAGE": "quay.io/metal3-io/sushy-tools:latest", 2025-10-13 20:41:32.889676 | controller | "BMAAS_SUSHY_EMULATOR_NAMESPACE": "sushy-emulator", 2025-10-13 20:41:32.889690 | controller | "BMAAS_SUSHY_EMULATOR_OS_CLIENT_CONFIG_FILE": "/etc/openstack/clouds.yaml", 2025-10-13 20:41:32.889704 | controller | "BMAAS_SUSHY_EMULATOR_OS_CLOUD": "openstack", 2025-10-13 20:41:32.889720 | controller | "BMH_NAMESPACE": "openstack", 2025-10-13 20:41:32.889762 | controller | "BMO_BRANCH": "release-0.9", 2025-10-13 20:41:32.889778 | controller | "BMO_COMMIT_HASH": "", 2025-10-13 20:41:32.889793 | controller | "BMO_IPA_BRANCH": "stable/2024.1", 2025-10-13 20:41:32.889808 | controller | "BMO_IRONIC_HOST": "192.168.122.10", 2025-10-13 20:41:32.889823 | controller | "BMO_PROVISIONING_INTERFACE": "", 2025-10-13 20:41:32.889838 | controller | "BMO_REPO": "https://github.com/metal3-io/baremetal-operator", 2025-10-13 20:41:32.889852 | controller | "BMO_SETUP": false, 2025-10-13 20:41:32.889872 | controller | "BMO_SETUP_ROUTE_REPLACE": "true", 2025-10-13 20:41:32.889888 | controller | "BM_CTLPLANE_INTERFACE": "enp1s0", 2025-10-13 20:41:32.889902 | controller | "BM_INSTANCE_MEMORY": "8192", 2025-10-13 20:41:32.889917 | controller | "BM_INSTANCE_NAME_PREFIX": "edpm-compute-baremetal", 2025-10-13 20:41:32.889931 | controller | "BM_INSTANCE_NAME_SUFFIX": "0", 2025-10-13 20:41:32.889945 | controller | "BM_NETWORK_NAME": "default", 2025-10-13 20:41:32.889960 | controller | "BM_NODE_COUNT": "1", 2025-10-13 20:41:32.889974 | controller | "BM_ROOT_PASSWORD": "", 2025-10-13 20:41:32.889988 | controller | "BM_ROOT_PASSWORD_SECRET": "", 2025-10-13 20:41:32.890002 | controller | "CEILOMETER_CENTRAL_DEPL_IMG": "unused", 2025-10-13 20:41:32.890016 | controller | "CEILOMETER_NOTIFICATION_DEPL_IMG": "unused", 2025-10-13 20:41:32.890030 | controller | "CEPH_BRANCH": "release-1.15", 2025-10-13 20:41:32.890045 | controller | "CEPH_CLIENT": "/home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/toolbox.yaml", 2025-10-13 20:41:32.890067 | controller | "CEPH_COMMON": "/home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/common.yaml", 2025-10-13 20:41:32.890085 | controller | "CEPH_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/cluster-test.yaml", 2025-10-13 20:41:32.890100 | controller | "CEPH_CRDS": "/home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/crds.yaml", 2025-10-13 20:41:32.890114 | controller | "CEPH_IMG": "quay.io/ceph/demo:latest-squid", 2025-10-13 20:41:32.890129 | controller | "CEPH_OP": "/home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/operator-openshift.yaml", 2025-10-13 20:41:32.890143 | controller | "CEPH_REPO": "https://github.com/rook/rook.git", 2025-10-13 20:41:32.890157 | controller | "CERTMANAGER_TIMEOUT": "300s", 2025-10-13 20:41:32.890171 | controller | "CHECKOUT_FROM_OPENSTACK_REF": "true", 2025-10-13 20:41:32.890184 | controller | "CINDER": "config/samples/cinder_v1beta1_cinder.yaml", 2025-10-13 20:41:32.890198 | controller | "CINDERAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.890212 | controller | "CINDERBKP_DEPL_IMG": "unused", 2025-10-13 20:41:32.890227 | controller | "CINDERSCH_DEPL_IMG": "unused", 2025-10-13 20:41:32.890245 | controller | "CINDERVOL_DEPL_IMG": "unused", 2025-10-13 20:41:32.890265 | controller | "CINDER_BRANCH": "main", 2025-10-13 20:41:32.890281 | controller | "CINDER_COMMIT_HASH": "", 2025-10-13 20:41:32.890302 | controller | "CINDER_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/config/samples/cinder_v1beta1_cinder.yaml", 2025-10-13 20:41:32.890318 | controller | "CINDER_IMG": "quay.io/openstack-k8s-operators/cinder-operator-index:latest", 2025-10-13 20:41:32.890333 | controller | "CINDER_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/kuttl-test.yaml", 2025-10-13 20:41:32.890348 | controller | "CINDER_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/test/kuttl/tests", 2025-10-13 20:41:32.890362 | controller | "CINDER_KUTTL_NAMESPACE": "cinder-kuttl-tests", 2025-10-13 20:41:32.890377 | controller | "CINDER_REPO": "https://github.com/openstack-k8s-operators/cinder-operator.git", 2025-10-13 20:41:32.890391 | controller | "CLEANUP_DIR_CMD": "rm -Rf", 2025-10-13 20:41:32.890405 | controller | "CRC_BGP_NIC_1_MAC": "52:54:00:11:11:11", 2025-10-13 20:41:32.890420 | controller | "CRC_BGP_NIC_2_MAC": "52:54:00:11:11:12", 2025-10-13 20:41:32.890434 | controller | "CRC_HTTPS_PROXY": "", 2025-10-13 20:41:32.890448 | controller | "CRC_HTTP_PROXY": "", 2025-10-13 20:41:32.890462 | controller | "CRC_STORAGE_NAMESPACE": "crc-storage", 2025-10-13 20:41:32.890475 | controller | "CRC_STORAGE_RETRIES": "3", 2025-10-13 20:41:32.890490 | controller | "CRC_URL": "'https://developers.redhat.com/content-gateway/rest/mirror/pub/openshift-v4/clients/crc/latest/crc-linux-amd64.tar.xz'", 2025-10-13 20:41:32.890508 | controller | "CRC_VERSION": "latest", 2025-10-13 20:41:32.890522 | controller | "DATAPLANE_ANSIBLE_SECRET": "dataplane-ansible-ssh-private-key-secret", 2025-10-13 20:41:32.890537 | controller | "DATAPLANE_ANSIBLE_USER": "", 2025-10-13 20:41:32.890551 | controller | "DATAPLANE_COMPUTE_IP": "192.168.122.100", 2025-10-13 20:41:32.890565 | controller | "DATAPLANE_CONTAINER_PREFIX": "openstack", 2025-10-13 20:41:32.890579 | controller | "DATAPLANE_CONTAINER_TAG": "current-podified", 2025-10-13 20:41:32.890593 | controller | "DATAPLANE_CUSTOM_SERVICE_RUNNER_IMG": "quay.io/openstack-k8s-operators/openstack-ansibleee-runner:latest", 2025-10-13 20:41:32.890607 | controller | "DATAPLANE_DEFAULT_GW": "192.168.122.1", 2025-10-13 20:41:32.890622 | controller | "DATAPLANE_EXTRA_NOVA_CONFIG_FILE": "/dev/null", 2025-10-13 20:41:32.890638 | controller | "DATAPLANE_GROWVOLS_ARGS": "/=8GB /tmp=1GB /home=1GB /var=100%", 2025-10-13 20:41:32.890653 | controller | "DATAPLANE_KUSTOMIZE_SCENARIO": "preprovisioned", 2025-10-13 20:41:32.890668 | controller | "DATAPLANE_NETWORKER_IP": "192.168.122.200", 2025-10-13 20:41:32.890682 | controller | "DATAPLANE_NETWORK_INTERFACE_NAME": "eth0", 2025-10-13 20:41:32.890697 | controller | "DATAPLANE_NOVA_NFS_PATH": "", 2025-10-13 20:41:32.890711 | controller | "DATAPLANE_NTP_SERVER": "pool.ntp.org", 2025-10-13 20:41:32.890745 | controller | "DATAPLANE_PLAYBOOK": "osp.edpm.download_cache", 2025-10-13 20:41:32.890763 | controller | "DATAPLANE_REGISTRY_URL": "quay.io/podified-antelope-centos9", 2025-10-13 20:41:32.890785 | controller | "DATAPLANE_RUNNER_IMG": "", 2025-10-13 20:41:32.890804 | controller | "DATAPLANE_SERVER_ROLE": "compute", 2025-10-13 20:41:32.890819 | controller | "DATAPLANE_SSHD_ALLOWED_RANGES": "['192.168.122.0/24']", 2025-10-13 20:41:32.890834 | controller | "DATAPLANE_TIMEOUT": "30m", 2025-10-13 20:41:32.890848 | controller | "DATAPLANE_TLS_ENABLED": "true", 2025-10-13 20:41:32.890863 | controller | "DATAPLANE_TOTAL_NETWORKER_NODES": "1", 2025-10-13 20:41:32.890877 | controller | "DATAPLANE_TOTAL_NODES": "1", 2025-10-13 20:41:32.890892 | controller | "DBSERVICE": "galera", 2025-10-13 20:41:32.890906 | controller | "DESIGNATE": "config/samples/designate_v1beta1_designate.yaml", 2025-10-13 20:41:32.890921 | controller | "DESIGNATE_BRANCH": "main", 2025-10-13 20:41:32.890935 | controller | "DESIGNATE_COMMIT_HASH": "", 2025-10-13 20:41:32.890949 | controller | "DESIGNATE_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/config/samples/designate_v1beta1_designate.yaml", 2025-10-13 20:41:32.890963 | controller | "DESIGNATE_IMG": "quay.io/openstack-k8s-operators/designate-operator-index:latest", 2025-10-13 20:41:32.890980 | controller | "DESIGNATE_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/kuttl-test.yaml", 2025-10-13 20:41:32.891002 | controller | "DESIGNATE_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/tests/kuttl/tests", 2025-10-13 20:41:32.891023 | controller | "DESIGNATE_KUTTL_NAMESPACE": "designate-kuttl-tests", 2025-10-13 20:41:32.891040 | controller | "DESIGNATE_REPO": "https://github.com/openstack-k8s-operators/designate-operator.git", 2025-10-13 20:41:32.891054 | controller | "DNSDATA": "config/samples/network_v1beta1_dnsdata.yaml", 2025-10-13 20:41:32.891068 | controller | "DNSDATA_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_dnsdata.yaml", 2025-10-13 20:41:32.891083 | controller | "DNSMASQ": "config/samples/network_v1beta1_dnsmasq.yaml", 2025-10-13 20:41:32.891097 | controller | "DNSMASQ_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_dnsmasq.yaml", 2025-10-13 20:41:32.891115 | controller | "DNS_DEPL_IMG": "unused", 2025-10-13 20:41:32.891130 | controller | "DNS_DOMAIN": "localdomain", 2025-10-13 20:41:32.891144 | controller | "DOWNLOAD_TOOLS_SELECTION": "all", 2025-10-13 20:41:32.891159 | controller | "EDPM_ATTACH_EXTNET": "true", 2025-10-13 20:41:32.891173 | controller | "EDPM_COMPUTE_ADDITIONAL_HOST_ROUTES": "'[]'", 2025-10-13 20:41:32.891187 | controller | "EDPM_COMPUTE_ADDITIONAL_NETWORKS": "'[]'", 2025-10-13 20:41:32.891201 | controller | "EDPM_COMPUTE_CELLS": "1", 2025-10-13 20:41:32.891215 | controller | "EDPM_COMPUTE_CEPH_ENABLED": "true", 2025-10-13 20:41:32.891229 | controller | "EDPM_COMPUTE_CEPH_NOVA": "true", 2025-10-13 20:41:32.891243 | controller | "EDPM_COMPUTE_DHCP_AGENT_ENABLED": "true", 2025-10-13 20:41:32.891257 | controller | "EDPM_COMPUTE_SRIOV_ENABLED": "true", 2025-10-13 20:41:32.891271 | controller | "EDPM_COMPUTE_SUFFIX": "0", 2025-10-13 20:41:32.891286 | controller | "EDPM_CONFIGURE_DEFAULT_ROUTE": "true", 2025-10-13 20:41:32.891300 | controller | "EDPM_CONFIGURE_HUGEPAGES": "false", 2025-10-13 20:41:32.891314 | controller | "EDPM_CONFIGURE_NETWORKING": "true", 2025-10-13 20:41:32.891331 | controller | "EDPM_FIRSTBOOT_EXTRA": "/tmp/edpm-firstboot-extra", 2025-10-13 20:41:32.891473 | controller | "EDPM_NETWORKER_SUFFIX": "0", 2025-10-13 20:41:32.891500 | controller | "EDPM_TOTAL_NETWORKERS": "1", 2025-10-13 20:41:32.891515 | controller | "EDPM_TOTAL_NODES": "1", 2025-10-13 20:41:32.891530 | controller | "GALERA_REPLICAS": "", 2025-10-13 20:41:32.891544 | controller | "GENERATE_SSH_KEYS": "true", 2025-10-13 20:41:32.891558 | controller | "GIT_CLONE_OPTS": "", 2025-10-13 20:41:32.891574 | controller | "GLANCE": "config/samples/glance_v1beta1_glance.yaml", 2025-10-13 20:41:32.891595 | controller | "GLANCEAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.891612 | controller | "GLANCE_BRANCH": "main", 2025-10-13 20:41:32.891626 | controller | "GLANCE_COMMIT_HASH": "", 2025-10-13 20:41:32.891640 | controller | "GLANCE_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/config/samples/glance_v1beta1_glance.yaml", 2025-10-13 20:41:32.891655 | controller | "GLANCE_IMG": "quay.io/openstack-k8s-operators/glance-operator-index:latest", 2025-10-13 20:41:32.891669 | controller | "GLANCE_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/kuttl-test.yaml", 2025-10-13 20:41:32.891683 | controller | "GLANCE_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/test/kuttl/tests", 2025-10-13 20:41:32.891697 | controller | "GLANCE_KUTTL_NAMESPACE": "glance-kuttl-tests", 2025-10-13 20:41:32.891710 | controller | "GLANCE_REPO": "https://github.com/openstack-k8s-operators/glance-operator.git", 2025-10-13 20:41:32.891756 | controller | "HEAT": "config/samples/heat_v1beta1_heat.yaml", 2025-10-13 20:41:32.891779 | controller | "HEATAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.891796 | controller | "HEATCFNAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.891811 | controller | "HEATENGINE_DEPL_IMG": "unused", 2025-10-13 20:41:32.891827 | controller | "HEAT_AUTH_ENCRYPTION_KEY": "767c3ed056cbaa3b9dfedb8c6f825bf0", 2025-10-13 20:41:32.891843 | controller | "HEAT_BRANCH": "main", 2025-10-13 20:41:32.891859 | controller | "HEAT_COMMIT_HASH": "", 2025-10-13 20:41:32.891875 | controller | "HEAT_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/config/samples/heat_v1beta1_heat.yaml", 2025-10-13 20:41:32.891891 | controller | "HEAT_IMG": "quay.io/openstack-k8s-operators/heat-operator-index:latest", 2025-10-13 20:41:32.891907 | controller | "HEAT_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/kuttl-test.yaml", 2025-10-13 20:41:32.891925 | controller | "HEAT_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/tests/kuttl/tests", 2025-10-13 20:41:32.891948 | controller | "HEAT_KUTTL_NAMESPACE": "heat-kuttl-tests", 2025-10-13 20:41:32.891965 | controller | "HEAT_REPO": "https://github.com/openstack-k8s-operators/heat-operator.git", 2025-10-13 20:41:32.891981 | controller | "HEAT_SERVICE_ENABLED": "true", 2025-10-13 20:41:32.891997 | controller | "HORIZON": "config/samples/horizon_v1beta1_horizon.yaml", 2025-10-13 20:41:32.892012 | controller | "HORIZON_BRANCH": "main", 2025-10-13 20:41:32.892027 | controller | "HORIZON_COMMIT_HASH": "", 2025-10-13 20:41:32.892043 | controller | "HORIZON_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/config/samples/horizon_v1beta1_horizon.yaml", 2025-10-13 20:41:32.892058 | controller | "HORIZON_DEPL_IMG": "unused", 2025-10-13 20:41:32.892074 | controller | "HORIZON_IMG": "quay.io/openstack-k8s-operators/horizon-operator-index:latest", 2025-10-13 20:41:32.892092 | controller | "HORIZON_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/kuttl-test.yaml", 2025-10-13 20:41:32.892110 | controller | "HORIZON_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/tests/kuttl/tests", 2025-10-13 20:41:32.892125 | controller | "HORIZON_KUTTL_NAMESPACE": "horizon-kuttl-tests", 2025-10-13 20:41:32.892141 | controller | "HORIZON_REPO": "https://github.com/openstack-k8s-operators/horizon-operator.git", 2025-10-13 20:41:32.892157 | controller | "INFRA_BRANCH": "main", 2025-10-13 20:41:32.892172 | controller | "INFRA_COMMIT_HASH": "", 2025-10-13 20:41:32.892188 | controller | "INFRA_IMG": "quay.io/openstack-k8s-operators/infra-operator-index:latest", 2025-10-13 20:41:32.892203 | controller | "INFRA_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/kuttl-test.yaml", 2025-10-13 20:41:32.892217 | controller | "INFRA_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/tests/kuttl/tests", 2025-10-13 20:41:32.892232 | controller | "INFRA_KUTTL_NAMESPACE": "infra-kuttl-tests", 2025-10-13 20:41:32.892273 | controller | "INFRA_REPO": "https://github.com/openstack-k8s-operators/infra-operator.git", 2025-10-13 20:41:32.892292 | controller | "INSTALL_CERT_MANAGER": "true", 2025-10-13 20:41:32.892308 | controller | "INSTALL_NMSTATE": "true || false", 2025-10-13 20:41:32.892324 | controller | "INSTALL_NNCP": "true || false", 2025-10-13 20:41:32.892339 | controller | "INTERNALAPI_HOST_ROUTES": "", 2025-10-13 20:41:32.892354 | controller | "IPV6_LAB_IPV4_NETWORK_IPADDRESS": "172.30.0.1/24", 2025-10-13 20:41:32.892369 | controller | "IPV6_LAB_IPV6_NETWORK_IPADDRESS": "fd00:abcd:abcd:fc00::1/64", 2025-10-13 20:41:32.892383 | controller | "IPV6_LAB_LIBVIRT_STORAGE_POOL": "default", 2025-10-13 20:41:32.892398 | controller | "IPV6_LAB_MANAGE_FIREWALLD": "true", 2025-10-13 20:41:32.892413 | controller | "IPV6_LAB_NAT64_HOST_IPV4": "172.30.0.2/24", 2025-10-13 20:41:32.892428 | controller | "IPV6_LAB_NAT64_HOST_IPV6": "fd00:abcd:abcd:fc00::2/64", 2025-10-13 20:41:32.892443 | controller | "IPV6_LAB_NAT64_INSTANCE_NAME": "nat64-router", 2025-10-13 20:41:32.892457 | controller | "IPV6_LAB_NAT64_IPV6_NETWORK": "fd00:abcd:abcd:fc00::/64", 2025-10-13 20:41:32.892472 | controller | "IPV6_LAB_NAT64_TAYGA_DYNAMIC_POOL": "192.168.255.0/24", 2025-10-13 20:41:32.892488 | controller | "IPV6_LAB_NAT64_TAYGA_IPV4": "192.168.255.1", 2025-10-13 20:41:32.892503 | controller | "IPV6_LAB_NAT64_TAYGA_IPV6": "fd00:abcd:abcd:fc00::3", 2025-10-13 20:41:32.892518 | controller | "IPV6_LAB_NAT64_TAYGA_IPV6_PREFIX": "fd00:abcd:abcd:fcff::/96", 2025-10-13 20:41:32.892533 | controller | "IPV6_LAB_NAT64_UPDATE_PACKAGES": "false", 2025-10-13 20:41:32.892548 | controller | "IPV6_LAB_NETWORK_NAME": "nat64", 2025-10-13 20:41:32.892563 | controller | "IPV6_LAB_SNO_CLUSTER_NETWORK": "fd00:abcd:0::/48", 2025-10-13 20:41:32.892577 | controller | "IPV6_LAB_SNO_HOST_IP": "fd00:abcd:abcd:fc00::11", 2025-10-13 20:41:32.892595 | controller | "IPV6_LAB_SNO_HOST_PREFIX": "64", 2025-10-13 20:41:32.892610 | controller | "IPV6_LAB_SNO_INSTANCE_NAME": "sno", 2025-10-13 20:41:32.892625 | controller | "IPV6_LAB_SNO_MACHINE_NETWORK": "fd00:abcd:abcd:fc00::/64", 2025-10-13 20:41:32.892640 | controller | "IPV6_LAB_SNO_OCP_MIRROR_URL": "https://mirror.openshift.com/pub/openshift-v4/clients/ocp", 2025-10-13 20:41:32.892655 | controller | "IPV6_LAB_SNO_OCP_VERSION": "latest-4.14", 2025-10-13 20:41:32.892669 | controller | "IPV6_LAB_SNO_SERVICE_NETWORK": "fd00:abcd:abcd:fc03::/112", 2025-10-13 20:41:32.892684 | controller | "IPV6_LAB_SSH_PUB_KEY": "/home/zuul/.ssh/id_rsa.pub", 2025-10-13 20:41:32.892699 | controller | "IPV6_LAB_WORK_DIR": "/home/zuul/.ipv6lab", 2025-10-13 20:41:32.892714 | controller | "IRONIC": "config/samples/ironic_v1beta1_ironic.yaml", 2025-10-13 20:41:32.892749 | controller | "IRONICAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.892766 | controller | "IRONICCON_DEPL_IMG": "unused", 2025-10-13 20:41:32.892782 | controller | "IRONICINS_DEPL_IMG": "unused", 2025-10-13 20:41:32.892797 | controller | "IRONICNAG_DEPL_IMG": "unused", 2025-10-13 20:41:32.892812 | controller | "IRONICPXE_DEPL_IMG": "unused", 2025-10-13 20:41:32.892826 | controller | "IRONIC_BRANCH": "main", 2025-10-13 20:41:32.892841 | controller | "IRONIC_COMMIT_HASH": "", 2025-10-13 20:41:32.892856 | controller | "IRONIC_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/config/samples/ironic_v1beta1_ironic.yaml", 2025-10-13 20:41:32.892870 | controller | "IRONIC_IMAGE_TAG": "release-24.1", 2025-10-13 20:41:32.892885 | controller | "IRONIC_IMG": "quay.io/openstack-k8s-operators/ironic-operator-index:latest", 2025-10-13 20:41:32.892900 | controller | "IRONIC_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/kuttl-test.yaml", 2025-10-13 20:41:32.892915 | controller | "IRONIC_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/tests/kuttl/tests", 2025-10-13 20:41:32.892930 | controller | "IRONIC_KUTTL_NAMESPACE": "ironic-kuttl-tests", 2025-10-13 20:41:32.892945 | controller | "IRONIC_REPO": "https://github.com/openstack-k8s-operators/ironic-operator.git", 2025-10-13 20:41:32.892961 | controller | "KEYSTONEAPI": "config/samples/keystone_v1beta1_keystoneapi.yaml", 2025-10-13 20:41:32.892977 | controller | "KEYSTONEAPI_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/config/samples/keystone_v1beta1_keystoneapi.yaml", 2025-10-13 20:41:32.892992 | controller | "KEYSTONEAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.893008 | controller | "KEYSTONE_BRANCH": "main", 2025-10-13 20:41:32.893024 | controller | "KEYSTONE_COMMIT_HASH": "", 2025-10-13 20:41:32.893039 | controller | "KEYSTONE_FEDERATION_CLIENT_SECRET": "COX8bmlKAWn56XCGMrKQJj7dgHNAOl6f", 2025-10-13 20:41:32.893055 | controller | "KEYSTONE_FEDERATION_CRYPTO_PASSPHRASE": "openstack", 2025-10-13 20:41:32.893070 | controller | "KEYSTONE_IMG": "quay.io/openstack-k8s-operators/keystone-operator-index:latest", 2025-10-13 20:41:32.893086 | controller | "KEYSTONE_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/kuttl-test.yaml", 2025-10-13 20:41:32.893101 | controller | "KEYSTONE_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/tests/kuttl/tests", 2025-10-13 20:41:32.893116 | controller | "KEYSTONE_KUTTL_NAMESPACE": "keystone-kuttl-tests", 2025-10-13 20:41:32.893132 | controller | "KEYSTONE_REPO": "https://github.com/openstack-k8s-operators/keystone-operator.git", 2025-10-13 20:41:32.893147 | controller | "KUBEADMIN_PWD": "12345678", 2025-10-13 20:41:32.893163 | controller | "LIBVIRT_SECRET": "libvirt-secret", 2025-10-13 20:41:32.893178 | controller | "LOKI_DEPLOY_MODE": "openshift-network", 2025-10-13 20:41:32.893198 | controller | "LOKI_DEPLOY_NAMESPACE": "netobserv", 2025-10-13 20:41:32.893215 | controller | "LOKI_DEPLOY_SIZE": "1x.demo", 2025-10-13 20:41:32.893230 | controller | "LOKI_NAMESPACE": "openshift-operators-redhat", 2025-10-13 20:41:32.893247 | controller | "LOKI_OPERATOR_GROUP": "openshift-operators-redhat-loki", 2025-10-13 20:41:32.893262 | controller | "LOKI_SUBSCRIPTION": "loki-operator", 2025-10-13 20:41:32.893277 | controller | "LVMS_CR": "1", 2025-10-13 20:41:32.893293 | controller | "MANILA": "config/samples/manila_v1beta1_manila.yaml", 2025-10-13 20:41:32.893308 | controller | "MANILAAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.893323 | controller | "MANILASCH_DEPL_IMG": "unused", 2025-10-13 20:41:32.893338 | controller | "MANILASHARE_DEPL_IMG": "unused", 2025-10-13 20:41:32.893352 | controller | "MANILA_BRANCH": "main", 2025-10-13 20:41:32.893367 | controller | "MANILA_COMMIT_HASH": "", 2025-10-13 20:41:32.893381 | controller | "MANILA_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/config/samples/manila_v1beta1_manila.yaml", 2025-10-13 20:41:32.893397 | controller | "MANILA_IMG": "quay.io/openstack-k8s-operators/manila-operator-index:latest", 2025-10-13 20:41:32.893412 | controller | "MANILA_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/kuttl-test.yaml", 2025-10-13 20:41:32.893426 | controller | "MANILA_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/test/kuttl/tests", 2025-10-13 20:41:32.893441 | controller | "MANILA_KUTTL_NAMESPACE": "manila-kuttl-tests", 2025-10-13 20:41:32.893455 | controller | "MANILA_REPO": "https://github.com/openstack-k8s-operators/manila-operator.git", 2025-10-13 20:41:32.893470 | controller | "MANILA_SERVICE_ENABLED": "true", 2025-10-13 20:41:32.893485 | controller | "MARIADB": "config/samples/mariadb_v1beta1_galera.yaml", 2025-10-13 20:41:32.893499 | controller | "MARIADB_BRANCH": "main", 2025-10-13 20:41:32.893514 | controller | "MARIADB_CHAINSAW_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/chainsaw/config.yaml", 2025-10-13 20:41:32.893529 | controller | "MARIADB_CHAINSAW_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/chainsaw/tests", 2025-10-13 20:41:32.893543 | controller | "MARIADB_CHAINSAW_NAMESPACE": "mariadb-chainsaw-tests", 2025-10-13 20:41:32.893558 | controller | "MARIADB_COMMIT_HASH": "", 2025-10-13 20:41:32.893573 | controller | "MARIADB_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/config/samples/mariadb_v1beta1_galera.yaml", 2025-10-13 20:41:32.893587 | controller | "MARIADB_DEPL_IMG": "unused", 2025-10-13 20:41:32.893601 | controller | "MARIADB_IMG": "quay.io/openstack-k8s-operators/mariadb-operator-index:latest", 2025-10-13 20:41:32.893616 | controller | "MARIADB_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/kuttl-test.yaml", 2025-10-13 20:41:32.893631 | controller | "MARIADB_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/kuttl/tests", 2025-10-13 20:41:32.893645 | controller | "MARIADB_KUTTL_NAMESPACE": "mariadb-kuttl-tests", 2025-10-13 20:41:32.893660 | controller | "MARIADB_REPO": "https://github.com/openstack-k8s-operators/mariadb-operator.git", 2025-10-13 20:41:32.893674 | controller | "MEMCACHED": "config/samples/memcached_v1beta1_memcached.yaml", 2025-10-13 20:41:32.893690 | controller | "MEMCACHED_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/memcached_v1beta1_memcached.yaml", 2025-10-13 20:41:32.893705 | controller | "MEMCACHED_DEPL_IMG": "unused", 2025-10-13 20:41:32.893719 | controller | "METADATA_SHARED_SECRET": "1234567842", 2025-10-13 20:41:32.893759 | controller | "METALLB_IPV6_POOL": "fd00:aaaa::80-fd00:aaaa::90", 2025-10-13 20:41:32.893780 | controller | "METALLB_POOL": "192.168.122.80-192.168.122.90", 2025-10-13 20:41:32.893797 | controller | "MICROSHIFT": "0", 2025-10-13 20:41:32.893812 | controller | "NAMESPACE": "openstack", 2025-10-13 20:41:32.893827 | controller | "NETCONFIG": "config/samples/network_v1beta1_netconfig.yaml", 2025-10-13 20:41:32.893842 | controller | "NETCONFIG_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_netconfig.yaml", 2025-10-13 20:41:32.893857 | controller | "NETCONFIG_DEPL_IMG": "unused", 2025-10-13 20:41:32.893872 | controller | "NETOBSERV_DEPLOY_NAMESPACE": "netobserv", 2025-10-13 20:41:32.893886 | controller | "NETOBSERV_NAMESPACE": "openshift-netobserv-operator", 2025-10-13 20:41:32.893901 | controller | "NETOBSERV_OPERATOR_GROUP": "openshift-netobserv-operator-net", 2025-10-13 20:41:32.893916 | controller | "NETOBSERV_SUBSCRIPTION": "netobserv-operator", 2025-10-13 20:41:32.893930 | controller | "NETWORK_BGP": "false", 2025-10-13 20:41:32.893945 | controller | "NETWORK_DESIGNATE_ADDRESS_PREFIX": "172.28.0", 2025-10-13 20:41:32.893959 | controller | "NETWORK_DESIGNATE_EXT_ADDRESS_PREFIX": "172.50.0", 2025-10-13 20:41:32.893974 | controller | "NETWORK_INTERNALAPI_ADDRESS_PREFIX": "172.17.0", 2025-10-13 20:41:32.893988 | controller | "NETWORK_ISOLATION": "true", 2025-10-13 20:41:32.894003 | controller | "NETWORK_ISOLATION_INSTANCE_NAME": "crc", 2025-10-13 20:41:32.894019 | controller | "NETWORK_ISOLATION_IPV4": "true", 2025-10-13 20:41:32.894034 | controller | "NETWORK_ISOLATION_IPV4_ADDRESS": "172.16.1.1/24", 2025-10-13 20:41:32.894050 | controller | "NETWORK_ISOLATION_IPV4_NAT": "true", 2025-10-13 20:41:32.894065 | controller | "NETWORK_ISOLATION_IPV6": "false", 2025-10-13 20:41:32.894083 | controller | "NETWORK_ISOLATION_IPV6_ADDRESS": "fd00:aaaa::1/64", 2025-10-13 20:41:32.894101 | controller | "NETWORK_ISOLATION_IP_ADDRESS": "192.168.122.10", 2025-10-13 20:41:32.894116 | controller | "NETWORK_ISOLATION_MAC": "52:54:00:11:11:10", 2025-10-13 20:41:32.894131 | controller | "NETWORK_ISOLATION_NETWORK_NAME": "net-iso", 2025-10-13 20:41:32.894146 | controller | "NETWORK_ISOLATION_NET_NAME": "default", 2025-10-13 20:41:32.894163 | controller | "NETWORK_ISOLATION_USE_DEFAULT_NETWORK": "true", 2025-10-13 20:41:32.894179 | controller | "NETWORK_MTU": "1500", 2025-10-13 20:41:32.894194 | controller | "NETWORK_STORAGEMGMT_ADDRESS_PREFIX": "172.20.0", 2025-10-13 20:41:32.894209 | controller | "NETWORK_STORAGE_ADDRESS_PREFIX": "172.18.0", 2025-10-13 20:41:32.894224 | controller | "NETWORK_STORAGE_MACVLAN": "", 2025-10-13 20:41:32.894240 | controller | "NETWORK_TENANT_ADDRESS_PREFIX": "172.19.0", 2025-10-13 20:41:32.894255 | controller | "NETWORK_VLAN_START": "20", 2025-10-13 20:41:32.894270 | controller | "NETWORK_VLAN_STEP": "1", 2025-10-13 20:41:32.894286 | controller | "NEUTRONAPI": "config/samples/neutron_v1beta1_neutronapi.yaml", 2025-10-13 20:41:32.894302 | controller | "NEUTRONAPI_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/config/samples/neutron_v1beta1_neutronapi.yaml", 2025-10-13 20:41:32.894317 | controller | "NEUTRONAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.894332 | controller | "NEUTRON_BRANCH": "main", 2025-10-13 20:41:32.894347 | controller | "NEUTRON_COMMIT_HASH": "", 2025-10-13 20:41:32.894362 | controller | "NEUTRON_IMG": "quay.io/openstack-k8s-operators/neutron-operator-index:latest", 2025-10-13 20:41:32.894376 | controller | "NEUTRON_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/kuttl-test.yaml", 2025-10-13 20:41:32.894391 | controller | "NEUTRON_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/test/kuttl/tests", 2025-10-13 20:41:32.894407 | controller | "NEUTRON_KUTTL_NAMESPACE": "neutron-kuttl-tests", 2025-10-13 20:41:32.894421 | controller | "NEUTRON_REPO": "https://github.com/openstack-k8s-operators/neutron-operator.git", 2025-10-13 20:41:32.894440 | controller | "NFS_HOME": "/home/nfs", 2025-10-13 20:41:32.894456 | controller | "NMSTATE_NAMESPACE": "openshift-nmstate", 2025-10-13 20:41:32.894471 | controller | "NMSTATE_OPERATOR_GROUP": "openshift-nmstate-tn6k8", 2025-10-13 20:41:32.894486 | controller | "NMSTATE_SUBSCRIPTION": "kubernetes-nmstate-operator", 2025-10-13 20:41:32.894501 | controller | "NNCP_ADDITIONAL_HOST_ROUTES": "", 2025-10-13 20:41:32.894516 | controller | "NNCP_BGP_1_INTERFACE": "enp7s0", 2025-10-13 20:41:32.894531 | controller | "NNCP_BGP_1_IP_ADDRESS": "100.65.4.2", 2025-10-13 20:41:32.894546 | controller | "NNCP_BGP_2_INTERFACE": "enp8s0", 2025-10-13 20:41:32.894562 | controller | "NNCP_BGP_2_IP_ADDRESS": "100.64.4.2", 2025-10-13 20:41:32.894577 | controller | "NNCP_BRIDGE": "ospbr", 2025-10-13 20:41:32.894592 | controller | "NNCP_CLEANUP_TIMEOUT": "120s", 2025-10-13 20:41:32.894607 | controller | "NNCP_CTLPLANE_IPV6_ADDRESS_PREFIX": "fd00:aaaa::", 2025-10-13 20:41:32.894621 | controller | "NNCP_CTLPLANE_IPV6_ADDRESS_SUFFIX": "10", 2025-10-13 20:41:32.894636 | controller | "NNCP_CTLPLANE_IP_ADDRESS_PREFIX": "192.168.122", 2025-10-13 20:41:32.894651 | controller | "NNCP_CTLPLANE_IP_ADDRESS_SUFFIX": "10", 2025-10-13 20:41:32.894665 | controller | "NNCP_DNS_SERVER": "192.168.122.1", 2025-10-13 20:41:32.894680 | controller | "NNCP_DNS_SERVER_IPV6": "fd00:aaaa::1", 2025-10-13 20:41:32.894694 | controller | "NNCP_GATEWAY": "192.168.122.1", 2025-10-13 20:41:32.894709 | controller | "NNCP_GATEWAY_IPV6": "fd00:aaaa::1", 2025-10-13 20:41:32.894738 | controller | "NNCP_INTERFACE": "enp6s0", 2025-10-13 20:41:32.894759 | controller | "NNCP_NODES": "", 2025-10-13 20:41:32.894775 | controller | "NNCP_TIMEOUT": "240s", 2025-10-13 20:41:32.894790 | controller | "NOVA": "config/samples/nova_v1beta1_nova_collapsed_cell.yaml", 2025-10-13 20:41:32.894804 | controller | "NOVA_BRANCH": "main", 2025-10-13 20:41:32.894819 | controller | "NOVA_COMMIT_HASH": "", 2025-10-13 20:41:32.894833 | controller | "NOVA_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/nova-operator/config/samples/nova_v1beta1_nova_collapsed_cell.yaml", 2025-10-13 20:41:32.894847 | controller | "NOVA_IMG": "quay.io/openstack-k8s-operators/nova-operator-index:latest", 2025-10-13 20:41:32.894862 | controller | "NOVA_REPO": "https://github.com/openstack-k8s-operators/nova-operator.git", 2025-10-13 20:41:32.894877 | controller | "NUMBER_OF_INSTANCES": "1", 2025-10-13 20:41:32.894891 | controller | "OCP_NETWORK_NAME": "crc", 2025-10-13 20:41:32.894905 | controller | "OCTAVIA": "config/samples/octavia_v1beta1_octavia.yaml", 2025-10-13 20:41:32.894919 | controller | "OCTAVIA_BRANCH": "main", 2025-10-13 20:41:32.894933 | controller | "OCTAVIA_COMMIT_HASH": "", 2025-10-13 20:41:32.894947 | controller | "OCTAVIA_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/config/samples/octavia_v1beta1_octavia.yaml", 2025-10-13 20:41:32.894961 | controller | "OCTAVIA_IMG": "quay.io/openstack-k8s-operators/octavia-operator-index:latest", 2025-10-13 20:41:32.894975 | controller | "OCTAVIA_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/kuttl-test.yaml", 2025-10-13 20:41:32.894990 | controller | "OCTAVIA_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/tests/kuttl/tests", 2025-10-13 20:41:32.895004 | controller | "OCTAVIA_KUTTL_NAMESPACE": "octavia-kuttl-tests", 2025-10-13 20:41:32.895018 | controller | "OCTAVIA_REPO": "https://github.com/openstack-k8s-operators/octavia-operator.git", 2025-10-13 20:41:32.895032 | controller | "OKD": "false", 2025-10-13 20:41:32.895046 | controller | "OPENSTACK_BRANCH": "main", 2025-10-13 20:41:32.895061 | controller | "OPENSTACK_BUNDLE_IMG": "quay.io/openstack-k8s-operators/openstack-operator-bundle:latest", 2025-10-13 20:41:32.895079 | controller | "OPENSTACK_COMMIT_HASH": "", 2025-10-13 20:41:32.895095 | controller | "OPENSTACK_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml", 2025-10-13 20:41:32.895115 | controller | "OPENSTACK_CRDS_DIR": "openstack_crds", 2025-10-13 20:41:32.895130 | controller | "OPENSTACK_CTLPLANE": "config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml", 2025-10-13 20:41:32.895145 | controller | "OPENSTACK_IMG": "quay.io/openstack-k8s-operators/openstack-operator-index:latest", 2025-10-13 20:41:32.895159 | controller | "OPENSTACK_K8S_BRANCH": "main", 2025-10-13 20:41:32.895174 | controller | "OPENSTACK_K8S_TAG": "latest", 2025-10-13 20:41:32.895188 | controller | "OPENSTACK_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/kuttl-test.yaml", 2025-10-13 20:41:32.895203 | controller | "OPENSTACK_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests", 2025-10-13 20:41:32.895217 | controller | "OPENSTACK_KUTTL_NAMESPACE": "openstack-kuttl-tests", 2025-10-13 20:41:32.895232 | controller | "OPENSTACK_NEUTRON_CUSTOM_CONF": "", 2025-10-13 20:41:32.895246 | controller | "OPENSTACK_REPO": "https://github.com/openstack-k8s-operators/openstack-operator.git", 2025-10-13 20:41:32.895261 | controller | "OPENSTACK_STORAGE_BUNDLE_IMG": "quay.io/openstack-k8s-operators/openstack-operator-storage-bundle:latest", 2025-10-13 20:41:32.895275 | controller | "OPERATOR_BASE_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator", 2025-10-13 20:41:32.895289 | controller | "OPERATOR_CHANNEL": "", 2025-10-13 20:41:32.895304 | controller | "OPERATOR_NAMESPACE": "openstack-operators", 2025-10-13 20:41:32.895319 | controller | "OPERATOR_SOURCE": "", 2025-10-13 20:41:32.895334 | controller | "OPERATOR_SOURCE_NAMESPACE": "", 2025-10-13 20:41:32.895349 | controller | "OUT": "/home/zuul/ci-framework-data/artifacts/manifests", 2025-10-13 20:41:32.895364 | controller | "OUTPUT_DIR": "/home/zuul/ci-framework-data/artifacts/edpm", 2025-10-13 20:41:32.895378 | controller | "OVNCONTROLLER": "config/samples/ovn_v1beta1_ovncontroller.yaml", 2025-10-13 20:41:32.895392 | controller | "OVNCONTROLLER_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovncontroller.yaml", 2025-10-13 20:41:32.895406 | controller | "OVNCONTROLLER_NMAP": "true", 2025-10-13 20:41:32.895421 | controller | "OVNDBS": "config/samples/ovn_v1beta1_ovndbcluster.yaml", 2025-10-13 20:41:32.895435 | controller | "OVNDBS_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovndbcluster.yaml", 2025-10-13 20:41:32.895449 | controller | "OVNNORTHD": "config/samples/ovn_v1beta1_ovnnorthd.yaml", 2025-10-13 20:41:32.895463 | controller | "OVNNORTHD_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovnnorthd.yaml", 2025-10-13 20:41:32.895477 | controller | "OVN_BRANCH": "main", 2025-10-13 20:41:32.895491 | controller | "OVN_COMMIT_HASH": "", 2025-10-13 20:41:32.895504 | controller | "OVN_IMG": "quay.io/openstack-k8s-operators/ovn-operator-index:latest", 2025-10-13 20:41:32.895518 | controller | "OVN_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/kuttl-test.yaml", 2025-10-13 20:41:32.895532 | controller | "OVN_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/tests/kuttl/tests", 2025-10-13 20:41:32.895545 | controller | "OVN_KUTTL_NAMESPACE": "ovn-kuttl-tests", 2025-10-13 20:41:32.895559 | controller | "OVN_REPO": "https://github.com/openstack-k8s-operators/ovn-operator.git", 2025-10-13 20:41:32.895573 | controller | "PASSWORD": "12345678", 2025-10-13 20:41:32.895590 | controller | "PLACEMENTAPI": "config/samples/placement_v1beta1_placementapi.yaml", 2025-10-13 20:41:32.895605 | controller | "PLACEMENTAPI_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/config/samples/placement_v1beta1_placementapi.yaml", 2025-10-13 20:41:32.895619 | controller | "PLACEMENTAPI_DEPL_IMG": "unused", 2025-10-13 20:41:32.895632 | controller | "PLACEMENT_BRANCH": "main", 2025-10-13 20:41:32.895646 | controller | "PLACEMENT_COMMIT_HASH": "", 2025-10-13 20:41:32.895660 | controller | "PLACEMENT_IMG": "quay.io/openstack-k8s-operators/placement-operator-index:latest", 2025-10-13 20:41:32.895674 | controller | "PLACEMENT_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/kuttl-test.yaml", 2025-10-13 20:41:32.895688 | controller | "PLACEMENT_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/tests/kuttl/tests", 2025-10-13 20:41:32.895702 | controller | "PLACEMENT_KUTTL_NAMESPACE": "placement-kuttl-tests", 2025-10-13 20:41:32.895715 | controller | "PLACEMENT_REPO": "https://github.com/openstack-k8s-operators/placement-operator.git", 2025-10-13 20:41:32.895755 | controller | "PULL_SECRET": "/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/pull-secret.txt", 2025-10-13 20:41:32.895772 | controller | "RABBITMQ": "docs/examples/default-security-context/rabbitmq.yaml", 2025-10-13 20:41:32.895787 | controller | "RABBITMQ_BRANCH": "patches", 2025-10-13 20:41:32.895802 | controller | "RABBITMQ_COMMIT_HASH": "", 2025-10-13 20:41:32.895816 | controller | "RABBITMQ_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/rabbitmq-operator/docs/examples/default-security-context/rabbitmq.yaml", 2025-10-13 20:41:32.895830 | controller | "RABBITMQ_DEPL_IMG": "unused", 2025-10-13 20:41:32.895844 | controller | "RABBITMQ_IMG": "quay.io/openstack-k8s-operators/rabbitmq-cluster-operator-index:latest", 2025-10-13 20:41:32.895858 | controller | "RABBITMQ_REPO": "https://github.com/openstack-k8s-operators/rabbitmq-cluster-operator.git", 2025-10-13 20:41:32.895872 | controller | "REDHAT_OPERATORS": "false", 2025-10-13 20:41:32.895886 | controller | "REDIS": "config/samples/redis_v1beta1_redis.yaml", 2025-10-13 20:41:32.895900 | controller | "REDIS_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator-redis/config/samples/redis_v1beta1_redis.yaml", 2025-10-13 20:41:32.895914 | controller | "REDIS_DEPL_IMG": "unused", 2025-10-13 20:41:32.895928 | controller | "RH_REGISTRY_PWD": "", 2025-10-13 20:41:32.895942 | controller | "RH_REGISTRY_USER": "", 2025-10-13 20:41:32.895956 | controller | "SECRET": "osp-secret", 2025-10-13 20:41:32.895969 | controller | "SG_CORE_DEPL_IMG": "unused", 2025-10-13 20:41:32.895983 | controller | "STANDALONE_COMPUTE_DRIVER": "libvirt", 2025-10-13 20:41:32.895998 | controller | "STANDALONE_EXTERNAL_NET_PREFFIX": "172.21.0", 2025-10-13 20:41:32.896012 | controller | "STANDALONE_INTERNALAPI_NET_PREFIX": "172.17.0", 2025-10-13 20:41:32.896026 | controller | "STANDALONE_STORAGEMGMT_NET_PREFIX": "172.20.0", 2025-10-13 20:41:32.896040 | controller | "STANDALONE_STORAGE_NET_PREFIX": "172.18.0", 2025-10-13 20:41:32.896054 | controller | "STANDALONE_TENANT_NET_PREFIX": "172.19.0", 2025-10-13 20:41:32.896068 | controller | "STORAGEMGMT_HOST_ROUTES": "", 2025-10-13 20:41:32.896083 | controller | "STORAGE_CLASS": "local-storage", 2025-10-13 20:41:32.896104 | controller | "STORAGE_HOST_ROUTES": "", 2025-10-13 20:41:32.896126 | controller | "SWIFT": "config/samples/swift_v1beta1_swift.yaml", 2025-10-13 20:41:32.896149 | controller | "SWIFT_BRANCH": "main", 2025-10-13 20:41:32.896166 | controller | "SWIFT_COMMIT_HASH": "", 2025-10-13 20:41:32.896181 | controller | "SWIFT_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/config/samples/swift_v1beta1_swift.yaml", 2025-10-13 20:41:32.896200 | controller | "SWIFT_IMG": "quay.io/openstack-k8s-operators/swift-operator-index:latest", 2025-10-13 20:41:32.896215 | controller | "SWIFT_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/kuttl-test.yaml", 2025-10-13 20:41:32.896230 | controller | "SWIFT_KUTTL_DIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/tests/kuttl/tests", 2025-10-13 20:41:32.896245 | controller | "SWIFT_KUTTL_NAMESPACE": "swift-kuttl-tests", 2025-10-13 20:41:32.896278 | controller | "SWIFT_REPO": "https://github.com/openstack-k8s-operators/swift-operator.git", 2025-10-13 20:41:32.896294 | controller | "TELEMETRY": "config/samples/telemetry_v1beta1_telemetry.yaml", 2025-10-13 20:41:32.896309 | controller | "TELEMETRY_BRANCH": "main", 2025-10-13 20:41:32.896323 | controller | "TELEMETRY_COMMIT_HASH": "", 2025-10-13 20:41:32.896338 | controller | "TELEMETRY_CR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator/config/samples/telemetry_v1beta1_telemetry.yaml", 2025-10-13 20:41:32.896352 | controller | "TELEMETRY_IMG": "quay.io/openstack-k8s-operators/telemetry-operator-index:latest", 2025-10-13 20:41:32.896367 | controller | "TELEMETRY_KUTTL_BASEDIR": "/home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator", 2025-10-13 20:41:32.896381 | controller | "TELEMETRY_KUTTL_CONF": "/home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator/kuttl-test.yaml", 2025-10-13 20:41:32.896396 | controller | "TELEMETRY_KUTTL_NAMESPACE": "telemetry-kuttl-tests", 2025-10-13 20:41:32.896410 | controller | "TELEMETRY_KUTTL_RELPATH": "tests/kuttl/suites", 2025-10-13 20:41:32.896425 | controller | "TELEMETRY_REPO": "https://github.com/openstack-k8s-operators/telemetry-operator.git", 2025-10-13 20:41:32.896439 | controller | "TENANT_HOST_ROUTES": "", 2025-10-13 20:41:32.896453 | controller | "TIMEOUT": "300s", 2025-10-13 20:41:32.896467 | controller | "TLS_ENABLED": "false", 2025-10-13 20:41:32.896481 | controller | "tripleo_deploy": "export REGISTRY_USER:" 2025-10-13 20:41:32.896496 | controller | } 2025-10-13 20:41:32.896511 | controller | } 2025-10-13 20:41:32.909643 | controller | ok: 2025-10-13 20:41:32.909709 | controller | { 2025-10-13 20:41:32.909759 | controller | "key": "cifmw_install_yamls_environment", 2025-10-13 20:41:32.909785 | controller | "value": { 2025-10-13 20:41:32.909806 | controller | "BMO_SETUP": false, 2025-10-13 20:41:32.909826 | controller | "CHECKOUT_FROM_OPENSTACK_REF": "true", 2025-10-13 20:41:32.909847 | controller | "KUBECONFIG": "/home/zuul/.crc/machines/crc/kubeconfig", 2025-10-13 20:41:32.909868 | controller | "OPENSTACK_K8S_BRANCH": "main", 2025-10-13 20:41:32.909887 | controller | "OUT": "/home/zuul/ci-framework-data/artifacts/manifests", 2025-10-13 20:41:32.909907 | controller | "OUTPUT_DIR": "/home/zuul/ci-framework-data/artifacts/edpm" 2025-10-13 20:41:32.909927 | controller | } 2025-10-13 20:41:32.909948 | controller | } 2025-10-13 20:41:32.965885 | 2025-10-13 20:41:32.966026 | LOOP [cifmw_helpers : Set files as fact] 2025-10-13 20:41:33.026082 | controller | ok: 2025-10-13 20:41:33.026305 | controller | { 2025-10-13 20:41:33.026331 | controller | "key": "cifmw_artifacts_basedir", 2025-10-13 20:41:33.026349 | controller | "value": "/home/zuul/ci-framework-data" 2025-10-13 20:41:33.026365 | controller | } 2025-10-13 20:41:33.026403 | controller | ok: All items complete 2025-10-13 20:41:33.026424 | 2025-10-13 20:41:33.036549 | controller | ok: 2025-10-13 20:41:33.036595 | controller | { 2025-10-13 20:41:33.036618 | controller | "key": "cifmw_artifacts_crc_sshkey", 2025-10-13 20:41:33.036635 | controller | "value": "~/.ssh/id_cifw" 2025-10-13 20:41:33.036652 | controller | } 2025-10-13 20:41:33.050781 | controller | ok: 2025-10-13 20:41:33.050827 | controller | { 2025-10-13 20:41:33.050849 | controller | "key": "cifmw_basedir", 2025-10-13 20:41:33.050866 | controller | "value": "/home/zuul/ci-framework-data" 2025-10-13 20:41:33.050889 | controller | } 2025-10-13 20:41:33.061323 | controller | ok: 2025-10-13 20:41:33.061368 | controller | { 2025-10-13 20:41:33.061390 | controller | "key": "cifmw_dlrn_report_result", 2025-10-13 20:41:33.061408 | controller | "value": false 2025-10-13 20:41:33.061425 | controller | } 2025-10-13 20:41:33.069826 | controller | ok: 2025-10-13 20:41:33.069871 | controller | { 2025-10-13 20:41:33.069894 | controller | "key": "cifmw_extras", 2025-10-13 20:41:33.069911 | controller | "value": [ 2025-10-13 20:41:33.069927 | controller | "@scenarios/centos-9/kuttl_multinode.yml" 2025-10-13 20:41:33.069955 | controller | ] 2025-10-13 20:41:33.069973 | controller | } 2025-10-13 20:41:33.077458 | controller | ok: 2025-10-13 20:41:33.077504 | controller | { 2025-10-13 20:41:33.077526 | controller | "key": "cifmw_installyamls_repos", 2025-10-13 20:41:33.077544 | controller | "value": "/home/zuul/src/github.com/openstack-k8s-operators/install_yamls" 2025-10-13 20:41:33.077561 | controller | } 2025-10-13 20:41:33.085474 | controller | ok: 2025-10-13 20:41:33.085530 | controller | { 2025-10-13 20:41:33.085559 | controller | "key": "cifmw_kuttl_tests_env_vars", 2025-10-13 20:41:33.085579 | controller | "value": { 2025-10-13 20:41:33.085806 | controller | "PV_NUM": 20 2025-10-13 20:41:33.085851 | controller | } 2025-10-13 20:41:33.085872 | controller | } 2025-10-13 20:41:33.093548 | controller | ok: 2025-10-13 20:41:33.093594 | controller | { 2025-10-13 20:41:33.093616 | controller | "key": "cifmw_kuttl_tests_operator_list", 2025-10-13 20:41:33.093634 | controller | "value": [ 2025-10-13 20:41:33.093651 | controller | "openstack", 2025-10-13 20:41:33.093666 | controller | "barbican", 2025-10-13 20:41:33.093682 | controller | "keystone", 2025-10-13 20:41:33.093697 | controller | "horizon" 2025-10-13 20:41:33.093712 | controller | ] 2025-10-13 20:41:33.093746 | controller | } 2025-10-13 20:41:33.102195 | controller | ok: 2025-10-13 20:41:33.102240 | controller | { 2025-10-13 20:41:33.102262 | controller | "key": "cifmw_make_ceph_environment", 2025-10-13 20:41:33.102280 | controller | "value": { 2025-10-13 20:41:33.102296 | controller | "CEPH_TIMEOUT": 120 2025-10-13 20:41:33.102312 | controller | } 2025-10-13 20:41:33.102327 | controller | } 2025-10-13 20:41:33.109061 | controller | ok: 2025-10-13 20:41:33.109110 | controller | { 2025-10-13 20:41:33.109132 | controller | "key": "cifmw_openshift_api", 2025-10-13 20:41:33.109150 | controller | "value": "api.crc.testing:6443" 2025-10-13 20:41:33.109166 | controller | } 2025-10-13 20:41:33.115685 | controller | ok: 2025-10-13 20:41:33.115743 | controller | { 2025-10-13 20:41:33.115768 | controller | "key": "cifmw_openshift_password", 2025-10-13 20:41:33.115785 | controller | "value": "123456789" 2025-10-13 20:41:33.115801 | controller | } 2025-10-13 20:41:33.122351 | controller | ok: 2025-10-13 20:41:33.122393 | controller | { 2025-10-13 20:41:33.122414 | controller | "key": "cifmw_openshift_setup_skip_internal_registry", 2025-10-13 20:41:33.122431 | controller | "value": true 2025-10-13 20:41:33.122447 | controller | } 2025-10-13 20:41:33.129209 | controller | ok: 2025-10-13 20:41:33.129262 | controller | { 2025-10-13 20:41:33.129398 | controller | "key": "cifmw_openshift_skip_tls_verify", 2025-10-13 20:41:33.129424 | controller | "value": true 2025-10-13 20:41:33.129442 | controller | } 2025-10-13 20:41:33.135923 | controller | ok: 2025-10-13 20:41:33.135967 | controller | { 2025-10-13 20:41:33.135989 | controller | "key": "cifmw_openshift_user", 2025-10-13 20:41:33.136006 | controller | "value": "kubeadmin" 2025-10-13 20:41:33.136022 | controller | } 2025-10-13 20:41:33.142820 | controller | ok: 2025-10-13 20:41:33.142864 | controller | { 2025-10-13 20:41:33.142886 | controller | "key": "cifmw_path", 2025-10-13 20:41:33.142904 | controller | "value": "/home/zuul/.crc/bin:/home/zuul/.crc/bin/oc:/home/zuul/bin:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin" 2025-10-13 20:41:33.142929 | controller | } 2025-10-13 20:41:33.149631 | controller | ok: 2025-10-13 20:41:33.149683 | controller | { 2025-10-13 20:41:33.149714 | controller | "key": "cifmw_project_dir", 2025-10-13 20:41:33.149758 | controller | "value": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:33.149781 | controller | } 2025-10-13 20:41:33.157143 | controller | ok: 2025-10-13 20:41:33.157188 | controller | { 2025-10-13 20:41:33.157210 | controller | "key": "cifmw_project_dir_absolute", 2025-10-13 20:41:33.157229 | controller | "value": "/home/zuul/src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:33.157245 | controller | } 2025-10-13 20:41:33.164116 | controller | ok: 2025-10-13 20:41:33.164161 | controller | { 2025-10-13 20:41:33.164186 | controller | "key": "cifmw_repo_setup_dist_major_version", 2025-10-13 20:41:33.164211 | controller | "value": 9 2025-10-13 20:41:33.164237 | controller | } 2025-10-13 20:41:33.170919 | controller | ok: 2025-10-13 20:41:33.170963 | controller | { 2025-10-13 20:41:33.170986 | controller | "key": "cifmw_repo_setup_os_release", 2025-10-13 20:41:33.171003 | controller | "value": "centos" 2025-10-13 20:41:33.171019 | controller | } 2025-10-13 20:41:33.177627 | controller | ok: 2025-10-13 20:41:33.177674 | controller | { 2025-10-13 20:41:33.177696 | controller | "key": "cifmw_run_tests", 2025-10-13 20:41:33.177713 | controller | "value": true 2025-10-13 20:41:33.177753 | controller | } 2025-10-13 20:41:33.184483 | controller | ok: 2025-10-13 20:41:33.184528 | controller | { 2025-10-13 20:41:33.184550 | controller | "key": "cifmw_use_libvirt", 2025-10-13 20:41:33.184567 | controller | "value": false 2025-10-13 20:41:33.184583 | controller | } 2025-10-13 20:41:33.191050 | controller | ok: 2025-10-13 20:41:33.191100 | controller | { 2025-10-13 20:41:33.191122 | controller | "key": "cifmw_zuul_target_host", 2025-10-13 20:41:33.191139 | controller | "value": "controller" 2025-10-13 20:41:33.191156 | controller | } 2025-10-13 20:41:33.197928 | controller | ok: 2025-10-13 20:41:33.197975 | controller | { 2025-10-13 20:41:33.197996 | controller | "key": "post_ctlplane_deploy", 2025-10-13 20:41:33.198013 | controller | "value": [ 2025-10-13 20:41:33.198029 | controller | { 2025-10-13 20:41:33.198046 | controller | "name": "Tune rabbitmq resources", 2025-10-13 20:41:33.198061 | controller | "source": "rabbitmq_tuning.yml", 2025-10-13 20:41:33.198076 | controller | "type": "playbook" 2025-10-13 20:41:33.198093 | controller | } 2025-10-13 20:41:33.198111 | controller | ] 2025-10-13 20:41:33.198126 | controller | } 2025-10-13 20:41:33.205091 | controller | ok: 2025-10-13 20:41:33.205137 | controller | { 2025-10-13 20:41:33.205159 | controller | "key": "pre_deploy", 2025-10-13 20:41:33.205176 | controller | "value": [ 2025-10-13 20:41:33.205192 | controller | { 2025-10-13 20:41:33.205208 | controller | "name": "Deploy toy ceph", 2025-10-13 20:41:33.205248 | controller | "source": "ceph-deploy.yml", 2025-10-13 20:41:33.205265 | controller | "type": "playbook" 2025-10-13 20:41:33.205280 | controller | } 2025-10-13 20:41:33.205295 | controller | ] 2025-10-13 20:41:33.205310 | controller | } 2025-10-13 20:41:33.212233 | controller | ok: 2025-10-13 20:41:33.212278 | controller | { 2025-10-13 20:41:33.212299 | controller | "key": "pre_infra", 2025-10-13 20:41:33.212316 | controller | "value": [ 2025-10-13 20:41:33.212332 | controller | { 2025-10-13 20:41:33.212348 | controller | "connection": "local", 2025-10-13 20:41:33.212363 | controller | "inventory": "localhost,", 2025-10-13 20:41:33.212404 | controller | "name": "Download needed tools", 2025-10-13 20:41:33.212421 | controller | "source": "/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/devsetup/download_tools.yaml", 2025-10-13 20:41:33.212436 | controller | "type": "playbook" 2025-10-13 20:41:33.212452 | controller | } 2025-10-13 20:41:33.212476 | controller | ] 2025-10-13 20:41:33.212491 | controller | } 2025-10-13 20:41:33.220672 | controller | ok: 2025-10-13 20:41:33.220753 | controller | { 2025-10-13 20:41:33.220784 | controller | "key": "pre_kuttl", 2025-10-13 20:41:33.220804 | controller | "value": [ 2025-10-13 20:41:33.220824 | controller | { 2025-10-13 20:41:33.220869 | controller | "inventory": "/home/zuul/ci-framework-data/artifacts/zuul_inventory.yml", 2025-10-13 20:41:33.220892 | controller | "name": "Fetch crc facts and save them as parameters for kuttl jobs", 2025-10-13 20:41:33.220911 | controller | "source": "kuttl_openstack_prep.yml", 2025-10-13 20:41:33.220930 | controller | "type": "playbook" 2025-10-13 20:41:33.220948 | controller | } 2025-10-13 20:41:33.220967 | controller | ] 2025-10-13 20:41:33.220984 | controller | } 2025-10-13 20:41:33.332915 | 2025-10-13 20:41:33.333067 | LOOP [cifmw_helpers : Set files as fact] 2025-10-13 20:41:33.402815 | controller | ok: 2025-10-13 20:41:33.403264 | controller | { 2025-10-13 20:41:33.403328 | controller | "key": "cifmw_openshift_api", 2025-10-13 20:41:33.403369 | controller | "value": "api.crc.testing:6443" 2025-10-13 20:41:33.403406 | controller | } 2025-10-13 20:41:33.421243 | controller | ok: 2025-10-13 20:41:33.421355 | controller | { 2025-10-13 20:41:33.421403 | controller | "key": "cifmw_openshift_context", 2025-10-13 20:41:33.421441 | controller | "value": "default/api-crc-testing:6443/kubeadmin" 2025-10-13 20:41:33.421478 | controller | } 2025-10-13 20:41:33.437876 | controller | ok: 2025-10-13 20:41:33.437991 | controller | { 2025-10-13 20:41:33.438051 | controller | "key": "cifmw_openshift_kubeconfig", 2025-10-13 20:41:33.438099 | controller | "value": "/home/zuul/.crc/machines/crc/kubeconfig" 2025-10-13 20:41:33.438133 | controller | } 2025-10-13 20:41:33.447671 | controller | ok: 2025-10-13 20:41:33.447754 | controller | { 2025-10-13 20:41:33.447793 | controller | "key": "cifmw_openshift_token", 2025-10-13 20:41:33.447818 | controller | "value": "sha256~CH_Lq1VEYIClPoI0VtN5tHLU_G7p3cOvtsQbWmbK0Kg" 2025-10-13 20:41:33.447841 | controller | } 2025-10-13 20:41:33.457842 | controller | ok: 2025-10-13 20:41:33.457906 | controller | { 2025-10-13 20:41:33.457937 | controller | "key": "cifmw_openshift_user", 2025-10-13 20:41:33.457962 | controller | "value": "kubeadmin" 2025-10-13 20:41:33.457984 | controller | } 2025-10-13 20:41:33.511361 | 2025-10-13 20:41:33.511513 | LOOP [cifmw_helpers : Set files as fact] 2025-10-13 20:41:33.561930 | controller | ok: 2025-10-13 20:41:33.562343 | controller | { 2025-10-13 20:41:33.562411 | controller | "key": "cifmw_kuttl_openstack_prep_vars", 2025-10-13 20:41:33.562454 | controller | "value": { 2025-10-13 20:41:33.562492 | controller | "NETWORK_MTU": 1500, 2025-10-13 20:41:33.562529 | controller | "NNCP_DNS_SERVER": "192.168.122.10", 2025-10-13 20:41:33.562564 | controller | "NNCP_INTERFACE": "ens7" 2025-10-13 20:41:33.562598 | controller | } 2025-10-13 20:41:33.562633 | controller | } 2025-10-13 20:41:33.562690 | controller | ok: All items complete 2025-10-13 20:41:33.562783 | 2025-10-13 20:41:33.596633 | 2025-10-13 20:41:33.596785 | TASK [cifmw_setup : Set custom cifmw PATH reusable fact] 2025-10-13 20:41:33.622499 | controller | skipping: Conditional result was False 2025-10-13 20:41:33.634356 | 2025-10-13 20:41:33.634440 | TASK [cifmw_setup : Set destination folder for the logs] 2025-10-13 20:41:33.721401 | controller | ok 2025-10-13 20:41:33.729020 | 2025-10-13 20:41:33.729082 | TASK [artifacts : Verify if "success" flag exists after successful tests execution] 2025-10-13 20:41:34.014682 | controller | ok 2025-10-13 20:41:34.031390 | 2025-10-13 20:41:34.031521 | TASK [artifacts : Ensure we have at least minimal ansible facts] 2025-10-13 20:41:34.734823 | controller | ok 2025-10-13 20:41:34.753691 | 2025-10-13 20:41:34.753855 | LOOP [artifacts : Ensure base directory exists] 2025-10-13 20:41:35.178349 | controller | ok: "artifacts" 2025-10-13 20:41:35.397626 | controller | ok: "logs" 2025-10-13 20:41:35.443808 | 2025-10-13 20:41:35.444023 | TASK [artifacts : Load generated hook environment for further usage] 2025-10-13 20:41:35.499828 | controller | ERROR 2025-10-13 20:41:35.500257 | controller | { 2025-10-13 20:41:35.500323 | controller | "ansible_facts": {}, 2025-10-13 20:41:35.500366 | controller | "ansible_included_var_files": [], 2025-10-13 20:41:35.500404 | controller | "message": "/home/zuul/ci-framework-data/artifacts directory does not exist" 2025-10-13 20:41:35.500447 | controller | } 2025-10-13 20:41:35.500495 | controller | ERROR: Ignoring Errors 2025-10-13 20:41:35.518419 | 2025-10-13 20:41:35.518552 | TASK [artifacts : Gather parameter passed to the playbook] 2025-10-13 20:41:36.564842 | controller | changed 2025-10-13 20:41:36.583257 | 2025-10-13 20:41:36.583415 | TASK [artifacts : Gather facts] 2025-10-13 20:41:37.424156 | controller | changed 2025-10-13 20:41:37.436386 | 2025-10-13 20:41:37.436495 | TASK [artifacts : Copy some network configuration files] 2025-10-13 20:41:38.035301 | controller | changed 2025-10-13 20:41:38.043126 | 2025-10-13 20:41:38.043189 | TASK [artifacts : Get installed packages list] 2025-10-13 20:41:39.034196 | controller | ok 2025-10-13 20:41:39.144182 | 2025-10-13 20:41:39.144341 | TASK [artifacts : Output package list] 2025-10-13 20:41:39.895823 | controller | changed 2025-10-13 20:41:39.927636 | 2025-10-13 20:41:39.927800 | LOOP [artifacts : Cleanup unnecesary directories] 2025-10-13 20:41:40.305250 | controller | changed: "/home/zuul/ci-framework-data/artifacts/manifests/operator" 2025-10-13 20:41:40.305701 | controller | ok: All items complete 2025-10-13 20:41:40.305805 | 2025-10-13 20:41:40.370556 | 2025-10-13 20:41:40.370808 | TASK [os_must_gather : Ensure directories are present] 2025-10-13 20:41:40.687330 | controller | changed 2025-10-13 20:41:40.717998 | 2025-10-13 20:41:40.718142 | LOOP [os_must_gather : Construct project change list] 2025-10-13 20:41:40.811547 | controller | ok: 2025-10-13 20:41:40.811930 | controller | { 2025-10-13 20:41:40.811995 | controller | "branch": "main", 2025-10-13 20:41:40.812035 | controller | "change": "3404", 2025-10-13 20:41:40.812074 | controller | "change_message": "Add loop_var in cifmw_helpers task files; trim vars in helper; improve finding files in var_dir\n\nTo avoid unecessary conflicts issue where \"item\" was already used in higher task, let's add loop_var to have better control on the vars what are parsed.\r\n\r\nAlso trim variables in var_dir and var_file and improve finding files\r\nto parse in var_dir helper.", 2025-10-13 20:41:40.812118 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3404", 2025-10-13 20:41:40.812154 | controller | "commit_id": "9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8", 2025-10-13 20:41:40.812188 | controller | "patchset": "9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8", 2025-10-13 20:41:40.812221 | controller | "project": { 2025-10-13 20:41:40.812255 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:40.812289 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:40.812322 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:40.812355 | controller | "short_name": "ci-framework", 2025-10-13 20:41:40.812389 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:40.812423 | controller | }, 2025-10-13 20:41:40.812456 | controller | "topic": null 2025-10-13 20:41:40.812488 | controller | } 2025-10-13 20:41:40.841838 | controller | ok: 2025-10-13 20:41:40.841919 | controller | { 2025-10-13 20:41:40.841955 | controller | "branch": "main", 2025-10-13 20:41:40.841980 | controller | "change": "3406", 2025-10-13 20:41:40.842007 | controller | "change_message": "Add include_file and include_dir helpers\n\nThe future group_vars directory, might not contain \"clear\" variables in the yaml file - instead of each variable has own type like string, integer, bool etc. it would be jinja2 variable, which is not \"translated\" in Ansible during setting facts.\r\n\r\nThis helper would be useful for parsing group_vars variables, that might be based on jinja2 vars.", 2025-10-13 20:41:40.842109 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3406", 2025-10-13 20:41:40.842137 | controller | "commit_id": "3b7e5d87cb08f8ceea89c6e58502f20dfffec667", 2025-10-13 20:41:40.842160 | controller | "patchset": "3b7e5d87cb08f8ceea89c6e58502f20dfffec667", 2025-10-13 20:41:40.842180 | controller | "project": { 2025-10-13 20:41:40.842202 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:40.842223 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:40.842243 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:40.842264 | controller | "short_name": "ci-framework", 2025-10-13 20:41:40.842284 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:40.842304 | controller | }, 2025-10-13 20:41:40.842324 | controller | "topic": null 2025-10-13 20:41:40.842344 | controller | } 2025-10-13 20:41:40.867149 | controller | ok: 2025-10-13 20:41:40.867228 | controller | { 2025-10-13 20:41:40.867264 | controller | "branch": "main", 2025-10-13 20:41:40.867290 | controller | "change": "3402", 2025-10-13 20:41:40.867316 | controller | "change_message": "Check global vars\n\nChecking Amartya change https://github.com/openstack-k8s-operators/ci-framework/pull/3237\r\n\r\nDepends-On: https://github.com/openstack-k8s-operators/ci-framework/pull/3404\r\nDepends-On: https://github.com/openstack-k8s-operators/ci-framework/pull/3406", 2025-10-13 20:41:40.867422 | controller | "change_url": "https://github.com/openstack-k8s-operators/ci-framework/pull/3402", 2025-10-13 20:41:40.867442 | controller | "commit_id": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:40.867462 | controller | "patchset": "a301e7c15ccc9d964f35eb738c51dc015730d4ed", 2025-10-13 20:41:40.867479 | controller | "project": { 2025-10-13 20:41:40.867495 | controller | "canonical_hostname": "github.com", 2025-10-13 20:41:40.867510 | controller | "canonical_name": "github.com/openstack-k8s-operators/ci-framework", 2025-10-13 20:41:40.867525 | controller | "name": "openstack-k8s-operators/ci-framework", 2025-10-13 20:41:40.867540 | controller | "short_name": "ci-framework", 2025-10-13 20:41:40.867555 | controller | "src_dir": "src/github.com/openstack-k8s-operators/ci-framework" 2025-10-13 20:41:40.867570 | controller | }, 2025-10-13 20:41:40.867584 | controller | "topic": null 2025-10-13 20:41:40.867599 | controller | } 2025-10-13 20:41:40.959780 | 2025-10-13 20:41:40.959912 | TASK [os_must_gather : Get git tag for image tagging] 2025-10-13 20:41:41.630609 | controller | skipping: Conditional result was False 2025-10-13 20:41:41.660510 | 2025-10-13 20:41:41.660632 | TASK [os_must_gather : Debug git show-ref] 2025-10-13 20:41:41.695551 | controller | skipping: Conditional result was False 2025-10-13 20:41:41.731818 | 2025-10-13 20:41:41.731966 | TASK [os_must_gather : Build openstack-must-gather container] 2025-10-13 20:41:41.768019 | controller | skipping: Conditional result was False 2025-10-13 20:41:41.800744 | 2025-10-13 20:41:41.800940 | TASK [os_must_gather : Push openstack-must-gather container] 2025-10-13 20:41:41.837509 | controller | skipping: Conditional result was False 2025-10-13 20:41:41.868924 | 2025-10-13 20:41:41.869083 | TASK [os_must_gather : Set cifmw_os_must_gather_image to new image tag] 2025-10-13 20:41:41.905409 | controller | skipping: Conditional result was False 2025-10-13 20:41:41.943838 | 2025-10-13 20:41:41.943997 | TASK [os_must_gather : Check for oc command] 2025-10-13 20:41:42.452314 | controller | changed 2025-10-13 20:41:42.483201 | 2025-10-13 20:41:42.483340 | TASK [os_must_gather : Check if kubeconfig exists] 2025-10-13 20:41:42.852346 | controller | ok 2025-10-13 20:41:42.926996 | 2025-10-13 20:41:42.927124 | TASK [os_must_gather : Run openstack-must-gather command] 2025-10-13 20:46:37.674925 | controller | changed 2025-10-13 20:46:37.727613 | 2025-10-13 20:46:37.727711 | TASK [os_must_gather : Find existing os-must-gather directories] 2025-10-13 20:46:38.060189 | controller | ok: All paths examined 2025-10-13 20:46:38.086799 | 2025-10-13 20:46:38.086902 | TASK [os_must_gather : Create a symlink to newest os-must-gather directory] 2025-10-13 20:46:38.493103 | controller | changed 2025-10-13 20:46:38.534109 | 2025-10-13 20:46:38.534245 | TASK [artifacts : Create crc logs directory] 2025-10-13 20:46:38.854595 | controller | changed 2025-10-13 20:46:38.875850 | 2025-10-13 20:46:38.875972 | TASK [artifacts : Ensure controller knows CRC ssh keys] 2025-10-13 20:46:39.517885 | controller | changed 2025-10-13 20:46:39.560207 | 2025-10-13 20:46:39.560395 | TASK [artifacts : Recognize new keypair] 2025-10-13 20:46:39.943560 | controller | ok 2025-10-13 20:46:39.964419 | 2025-10-13 20:46:39.964563 | TASK [artifacts : Set fact if new keypair exists] 2025-10-13 20:46:40.009653 | controller | skipping: Conditional result was False 2025-10-13 20:46:40.031020 | 2025-10-13 20:46:40.031149 | TASK [artifacts : Prepare root ssh accesses] 2025-10-13 20:46:45.548824 | controller | changed 2025-10-13 20:46:45.580878 | 2025-10-13 20:46:45.581008 | TASK [artifacts : Copy logs from CRC VM] 2025-10-13 20:46:50.759957 | controller | changed 2025-10-13 20:46:50.797623 | 2025-10-13 20:46:50.797759 | TASK [artifacts : List all of the existing virtual machines] 2025-10-13 20:46:50.832520 | controller | skipping: Conditional result was False 2025-10-13 20:46:50.856692 | 2025-10-13 20:46:50.856843 | TASK [artifacts : Filter out edpm vm] 2025-10-13 20:46:50.891973 | controller | skipping: Conditional result was False 2025-10-13 20:46:50.915367 | 2025-10-13 20:46:50.915506 | TASK [artifacts : Slurp zuul inventory file] 2025-10-13 20:46:51.291096 | controller | ok 2025-10-13 20:46:51.370347 | 2025-10-13 20:46:51.370467 | LOOP [artifacts : Extract Compute and Networker from zuul mapping if any] 2025-10-13 20:46:51.458407 | 2025-10-13 20:46:51.458571 | LOOP [artifacts : Generate logs on edpm vm {{ item.split('/')[0] }}] 2025-10-13 20:46:51.509479 | 2025-10-13 20:46:51.509652 | LOOP [artifacts : Copy logs to host machine from {{ item.split('/')[0] }}] 2025-10-13 20:46:51.567434 | 2025-10-13 20:46:51.567634 | TASK [artifacts : Generate list of ansible logs to collect in home directory] 2025-10-13 20:46:51.847191 | controller | ok: All paths examined 2025-10-13 20:46:51.877170 | 2025-10-13 20:46:51.877313 | LOOP [artifacts : Copy ansible logs to logs directory] 2025-10-13 20:46:52.440684 | controller | changed: 2025-10-13 20:46:52.441036 | controller | { 2025-10-13 20:46:52.441082 | controller | "atime": 1760383900.4734833, 2025-10-13 20:46:52.441109 | controller | "ctime": 1760388082.473843, 2025-10-13 20:46:52.441134 | controller | "dev": 64513, 2025-10-13 20:46:52.441158 | controller | "gid": 1000, 2025-10-13 20:46:52.441183 | controller | "gr_name": "zuul", 2025-10-13 20:46:52.441215 | controller | "inode": 4527274, 2025-10-13 20:46:52.441247 | controller | "isblk": false, 2025-10-13 20:46:52.441276 | controller | "ischr": false, 2025-10-13 20:46:52.441298 | controller | "isdir": false, 2025-10-13 20:46:52.441322 | controller | "isfifo": false, 2025-10-13 20:46:52.441345 | controller | "isgid": false, 2025-10-13 20:46:52.441366 | controller | "islnk": false, 2025-10-13 20:46:52.441388 | controller | "isreg": true, 2025-10-13 20:46:52.441409 | controller | "issock": false, 2025-10-13 20:46:52.441433 | controller | "isuid": false, 2025-10-13 20:46:52.441460 | controller | "mode": "0644", 2025-10-13 20:46:52.441483 | controller | "mtime": 1760388082.473843, 2025-10-13 20:46:52.441505 | controller | "nlink": 1, 2025-10-13 20:46:52.441527 | controller | "path": "/home/zuul/ansible.log", 2025-10-13 20:46:52.441550 | controller | "pw_name": "zuul", 2025-10-13 20:46:52.441589 | controller | "rgrp": true, 2025-10-13 20:46:52.441681 | controller | "roth": true, 2025-10-13 20:46:52.441715 | controller | "rusr": true, 2025-10-13 20:46:52.441779 | controller | "size": 2440749, 2025-10-13 20:46:52.441811 | controller | "uid": 1000, 2025-10-13 20:46:52.441842 | controller | "wgrp": false, 2025-10-13 20:46:52.441869 | controller | "woth": false, 2025-10-13 20:46:52.441897 | controller | "wusr": true, 2025-10-13 20:46:52.441925 | controller | "xgrp": false, 2025-10-13 20:46:52.441952 | controller | "xoth": false, 2025-10-13 20:46:52.441979 | controller | "xusr": false 2025-10-13 20:46:52.442004 | controller | } 2025-10-13 20:46:52.442042 | 2025-10-13 20:46:52.503983 | 2025-10-13 20:46:52.504242 | TASK [artifacts : Ensure we have proper rights on the gathered content] 2025-10-13 20:46:57.715160 | controller | changed 2025-10-13 20:46:57.744811 | 2025-10-13 20:46:57.744957 | LOOP [artifacts : Mask secrets in yaml log files] 2025-10-13 20:46:58.940677 | controller | changed: "/home/zuul/ci-framework-data/logs" 2025-10-13 20:46:59.287159 | controller | changed: "/home/zuul/ci-framework-data/artifacts" 2025-10-13 20:46:59.357445 | 2025-10-13 20:46:59.357571 | LOOP [env_op_images : Ensure directory is present] 2025-10-13 20:46:59.707875 | controller | ok: "artifacts" 2025-10-13 20:46:59.708399 | controller | changed: All items complete 2025-10-13 20:46:59.708451 | 2025-10-13 20:46:59.899661 | controller | ok: "logs" 2025-10-13 20:46:59.931350 | 2025-10-13 20:46:59.931507 | TASK [env_op_images : Check if OpenStackControlPlane is setup] 2025-10-13 20:47:00.655759 | controller | changed 2025-10-13 20:47:00.688906 | 2025-10-13 20:47:00.689051 | TASK [env_op_images : Get images from the CSV] 2025-10-13 20:47:01.320581 | controller | skipping: Conditional result was False 2025-10-13 20:47:01.366851 | 2025-10-13 20:47:01.367064 | TASK [env_op_images : Get the images name] 2025-10-13 20:47:02.059842 | controller | skipping: Conditional result was False 2025-10-13 20:47:02.107120 | 2025-10-13 20:47:02.107332 | TASK [env_op_images : Extract env variable name and images] 2025-10-13 20:47:02.145823 | controller | skipping: Conditional result was False 2025-10-13 20:47:02.191587 | 2025-10-13 20:47:02.191822 | TASK [env_op_images : Get all pods from all namespaces to find openstack-operator-index] 2025-10-13 20:47:02.228653 | controller | skipping: Conditional result was False 2025-10-13 20:47:02.270051 | 2025-10-13 20:47:02.270242 | TASK [env_op_images : Retrieve openstack-operator-index pod] 2025-10-13 20:47:02.306347 | controller | skipping: Conditional result was False 2025-10-13 20:47:02.338297 | 2025-10-13 20:47:02.338464 | TASK [env_op_images : Get all the pods in openstack-operator namespace] 2025-10-13 20:47:02.376481 | controller | skipping: Conditional result was False 2025-10-13 20:47:02.415577 | 2025-10-13 20:47:02.415762 | TASK [env_op_images : Get operator images and pods] 2025-10-13 20:47:02.452226 | controller | skipping: Conditional result was False 2025-10-13 20:47:02.484036 | 2025-10-13 20:47:02.484225 | LOOP [env_op_images : Add operator images to the dictionary] 2025-10-13 20:47:02.552053 | 2025-10-13 20:47:02.552280 | TASK [env_op_images : Write images to file] 2025-10-13 20:47:02.588764 | controller | skipping: Conditional result was False 2025-10-13 20:47:02.692980 | 2025-10-13 20:47:02.693106 | TASK [cifmw_setup : Create a versioned log folder] 2025-10-13 20:47:02.986689 | controller | changed 2025-10-13 20:47:03.018265 | 2025-10-13 20:47:03.018367 | TASK [cifmw_setup : Return a list of log files in home directory] 2025-10-13 20:47:03.319543 | controller | ok: All paths examined 2025-10-13 20:47:03.346233 | 2025-10-13 20:47:03.346330 | TASK [cifmw_setup : Ensure ansible facts cache exists] 2025-10-13 20:47:03.691892 | controller | ok 2025-10-13 20:47:03.718624 | 2025-10-13 20:47:03.718753 | LOOP [cifmw_setup : Copy logs to proper location] 2025-10-13 20:47:04.253075 | controller | changed: 2025-10-13 20:47:04.253380 | controller | { 2025-10-13 20:47:04.253437 | controller | "atime": 1760388412.3252547, 2025-10-13 20:47:04.253481 | controller | "ctime": 1760388082.473843, 2025-10-13 20:47:04.253519 | controller | "dev": 64513, 2025-10-13 20:47:04.253554 | controller | "gid": 1000, 2025-10-13 20:47:04.253589 | controller | "gr_name": "zuul", 2025-10-13 20:47:04.253622 | controller | "inode": 4527274, 2025-10-13 20:47:04.253668 | controller | "isblk": false, 2025-10-13 20:47:04.253715 | controller | "ischr": false, 2025-10-13 20:47:04.253797 | controller | "isdir": false, 2025-10-13 20:47:04.253834 | controller | "isfifo": false, 2025-10-13 20:47:04.253868 | controller | "isgid": false, 2025-10-13 20:47:04.253901 | controller | "islnk": false, 2025-10-13 20:47:04.253934 | controller | "isreg": true, 2025-10-13 20:47:04.253967 | controller | "issock": false, 2025-10-13 20:47:04.253999 | controller | "isuid": false, 2025-10-13 20:47:04.254031 | controller | "mode": "0644", 2025-10-13 20:47:04.254064 | controller | "mtime": 1760388082.473843, 2025-10-13 20:47:04.254097 | controller | "nlink": 1, 2025-10-13 20:47:04.254130 | controller | "path": "/home/zuul/ansible.log", 2025-10-13 20:47:04.254163 | controller | "pw_name": "zuul", 2025-10-13 20:47:04.254196 | controller | "rgrp": true, 2025-10-13 20:47:04.254230 | controller | "roth": true, 2025-10-13 20:47:04.254263 | controller | "rusr": true, 2025-10-13 20:47:04.254297 | controller | "size": 2440749, 2025-10-13 20:47:04.254331 | controller | "uid": 1000, 2025-10-13 20:47:04.254364 | controller | "wgrp": false, 2025-10-13 20:47:04.254397 | controller | "woth": false, 2025-10-13 20:47:04.254429 | controller | "wusr": true, 2025-10-13 20:47:04.254461 | controller | "xgrp": false, 2025-10-13 20:47:04.254493 | controller | "xoth": false, 2025-10-13 20:47:04.254524 | controller | "xusr": false 2025-10-13 20:47:04.254556 | controller | } 2025-10-13 20:47:04.254625 | 2025-10-13 20:47:04.302669 | 2025-10-13 20:47:04.302849 | LOOP [cifmw_setup : Remove original log from home directory] 2025-10-13 20:47:04.612120 | controller | changed: 2025-10-13 20:47:04.612409 | controller | { 2025-10-13 20:47:04.612463 | controller | "atime": 1760388412.3252547, 2025-10-13 20:47:04.612510 | controller | "ctime": 1760388082.473843, 2025-10-13 20:47:04.612548 | controller | "dev": 64513, 2025-10-13 20:47:04.612585 | controller | "gid": 1000, 2025-10-13 20:47:04.612622 | controller | "gr_name": "zuul", 2025-10-13 20:47:04.612657 | controller | "inode": 4527274, 2025-10-13 20:47:04.612692 | controller | "isblk": false, 2025-10-13 20:47:04.612756 | controller | "ischr": false, 2025-10-13 20:47:04.612802 | controller | "isdir": false, 2025-10-13 20:47:04.612838 | controller | "isfifo": false, 2025-10-13 20:47:04.612873 | controller | "isgid": false, 2025-10-13 20:47:04.612907 | controller | "islnk": false, 2025-10-13 20:47:04.612950 | controller | "isreg": true, 2025-10-13 20:47:04.613000 | controller | "issock": false, 2025-10-13 20:47:04.613052 | controller | "isuid": false, 2025-10-13 20:47:04.613100 | controller | "mode": "0644", 2025-10-13 20:47:04.613138 | controller | "mtime": 1760388082.473843, 2025-10-13 20:47:04.613174 | controller | "nlink": 1, 2025-10-13 20:47:04.613209 | controller | "path": "/home/zuul/ansible.log", 2025-10-13 20:47:04.613245 | controller | "pw_name": "zuul", 2025-10-13 20:47:04.613280 | controller | "rgrp": true, 2025-10-13 20:47:04.613315 | controller | "roth": true, 2025-10-13 20:47:04.613365 | controller | "rusr": true, 2025-10-13 20:47:04.613412 | controller | "size": 2440749, 2025-10-13 20:47:04.613455 | controller | "uid": 1000, 2025-10-13 20:47:04.613497 | controller | "wgrp": false, 2025-10-13 20:47:04.613538 | controller | "woth": false, 2025-10-13 20:47:04.613579 | controller | "wusr": true, 2025-10-13 20:47:04.613619 | controller | "xgrp": false, 2025-10-13 20:47:04.613660 | controller | "xoth": false, 2025-10-13 20:47:04.613700 | controller | "xusr": false 2025-10-13 20:47:04.613904 | controller | } 2025-10-13 20:47:04.668709 | 2025-10-13 20:47:04.668942 | TASK [cifmw_setup : Copy facts to dated directory] 2025-10-13 20:47:05.139746 | controller | changed 2025-10-13 20:47:05.287761 | 2025-10-13 20:47:05.287919 | PLAY [Run ci/playbooks/e2e-collect-logs.yml on CRC host] 2025-10-13 20:47:05.308121 | 2025-10-13 20:47:05.308198 | TASK [Get kubelet journalctl logs] 2025-10-13 20:47:07.347079 | crc | Output suppressed because no_log was given 2025-10-13 20:47:07.396358 | 2025-10-13 20:47:07.396467 | PLAY RECAP 2025-10-13 20:47:07.396528 | controller | ok: 62 changed: 23 unreachable: 0 failed: 0 skipped: 25 rescued: 0 ignored: 1 2025-10-13 20:47:07.396565 | crc | ok: 10 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-10-13 20:47:07.396591 | 2025-10-13 20:47:07.641256 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/e2e-collect-logs.yml@main] 2025-10-13 20:47:07.648088 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-10-13 20:47:08.272030 | 2025-10-13 20:47:08.272135 | PLAY [Run ci/playbooks/collect-logs.yml] 2025-10-13 20:47:08.397568 | 2025-10-13 20:47:08.397719 | TASK [Filter out host if needed] 2025-10-13 20:47:08.430507 | controller | skipping: end_host conditional evaluated to False, continuing execution for controller 2025-10-13 20:47:08.437081 | 2025-10-13 20:47:08.437157 | TASK [Filter out host if needed] 2025-10-13 20:47:08.473984 | 2025-10-13 20:47:08.474126 | TASK [Ensure file is present] 2025-10-13 20:47:09.057772 | controller | ok 2025-10-13 20:47:09.094180 | 2025-10-13 20:47:09.094270 | TASK [Manage molecule report file] 2025-10-13 20:47:09.793550 | controller | skipping: Conditional result was False 2025-10-13 20:47:09.840053 | 2025-10-13 20:47:09.840199 | TASK [Check if we get ci-framework-data basedir] 2025-10-13 20:47:10.127485 | controller | ok 2025-10-13 20:47:10.154228 | 2025-10-13 20:47:10.154302 | TASK [Create ci-framework-data log directory for zuul] 2025-10-13 20:47:10.531402 | controller | changed 2025-10-13 20:47:10.569230 | 2025-10-13 20:47:10.569326 | TASK [Copy ci-framework interesting files] 2025-10-13 20:47:21.800239 | controller | changed 2025-10-13 20:47:21.857046 | 2025-10-13 20:47:21.857183 | TASK [Get SELinux listing] 2025-10-13 20:47:32.581525 | controller | changed 2025-10-13 20:47:32.639082 | 2025-10-13 20:47:32.639215 | TASK [Generate log index] 2025-10-13 20:47:33.731898 | controller | changed 2025-10-13 20:47:33.766136 | 2025-10-13 20:47:33.766269 | TASK [Get some env related data] 2025-10-13 20:47:34.657506 | controller | /home/zuul/.local/bin/ansible 2025-10-13 20:47:45.513269 | controller | changed 2025-10-13 20:47:45.605658 | 2025-10-13 20:47:45.605873 | TASK [Generate list of logs to collect in home directory] 2025-10-13 20:47:46.057789 | controller | ok: All paths examined 2025-10-13 20:47:46.084043 | 2025-10-13 20:47:46.084167 | LOOP [Copy logs from home directory] 2025-10-13 20:47:46.143970 | 2025-10-13 20:47:46.144231 | TASK [Copy crio stats log file] 2025-10-13 20:47:46.179974 | controller | skipping: Conditional result was False 2025-10-13 20:47:46.217939 | 2025-10-13 20:47:46.218050 | TASK [Get SELinux related data] 2025-10-13 20:47:46.813000 | controller | 2025-10-13 20:47:57.039410 | controller | ERROR 2025-10-13 20:47:57.039597 | controller | { 2025-10-13 20:47:57.039655 | controller | "delta": "0:00:00.016683", 2025-10-13 20:47:57.039676 | controller | "end": "2025-10-13 20:47:46.814921", 2025-10-13 20:47:57.039694 | controller | "msg": "non-zero return code", 2025-10-13 20:47:57.039710 | controller | "rc": 1, 2025-10-13 20:47:57.039753 | controller | "start": "2025-10-13 20:47:46.798238" 2025-10-13 20:47:57.039772 | controller | } 2025-10-13 20:47:57.039794 | controller | ERROR: Ignoring Errors 2025-10-13 20:47:57.122257 | 2025-10-13 20:47:57.122410 | TASK [Create system configuration directory] 2025-10-13 20:47:57.529248 | controller | changed 2025-10-13 20:47:57.555063 | 2025-10-13 20:47:57.555180 | TASK [Get some of the system configurations] 2025-10-13 20:48:08.276809 | controller | changed 2025-10-13 20:48:08.309452 | 2025-10-13 20:48:08.309538 | TASK [Copy generated documentation if available] 2025-10-13 20:48:08.334986 | controller | skipping: Conditional result was False 2025-10-13 20:48:08.364742 | 2025-10-13 20:48:08.364863 | TASK [Copy generated AsciiDoc documentation if available] 2025-10-13 20:48:08.389979 | controller | skipping: Conditional result was False 2025-10-13 20:48:08.458446 | 2025-10-13 20:48:08.458571 | TASK [Compress logs bigger than 2MB] 2025-10-13 20:48:37.203355 | controller | changed 2025-10-13 20:48:37.262022 | 2025-10-13 20:48:37.262175 | TASK [Copy files from workspace on node] 2025-10-13 20:48:37.353486 | controller | ok 2025-10-13 20:48:37.421261 | 2025-10-13 20:48:37.421406 | TASK [fetch-output : Set log path for multiple nodes] 2025-10-13 20:48:37.495448 | controller | ok 2025-10-13 20:48:37.523589 | 2025-10-13 20:48:37.523700 | TASK [fetch-output : Set log path for single node] 2025-10-13 20:48:37.547592 | controller | skipping: Conditional result was False 2025-10-13 20:48:37.579833 | 2025-10-13 20:48:37.579956 | LOOP [fetch-output : Ensure local output dirs] 2025-10-13 20:48:37.830262 | controller -> localhost | changed: "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/logs/controller" 2025-10-13 20:48:37.830508 | 2025-10-13 20:48:38.042793 | controller -> localhost | changed: "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/artifacts" 2025-10-13 20:48:38.289599 | controller -> localhost | changed: "/var/lib/zuul/builds/99d5f1cd38d94d13a70c490f97e6f024/work/docs" 2025-10-13 20:48:38.361145 | 2025-10-13 20:48:38.361280 | LOOP [fetch-output : Collect logs, artifacts and docs] 2025-10-13 20:48:42.953779 | controller | changed: 2025-10-13 20:48:42.954043 | controller | .d..t...... ./ 2025-10-13 20:48:42.954080 | controller | >f+++++++++ README.html 2025-10-13 20:48:42.954107 | controller | >f+++++++++ dmesg.log 2025-10-13 20:48:42.954133 | controller | >f+++++++++ installed-pkgs.log 2025-10-13 20:48:42.954157 | controller | >f+++++++++ python.log 2025-10-13 20:48:42.954181 | controller | >f+++++++++ registries.conf 2025-10-13 20:48:42.954203 | controller | >f+++++++++ selinux-denials.log 2025-10-13 20:48:42.954226 | controller | >f+++++++++ selinux-listing.log 2025-10-13 20:48:42.954248 | controller | cd+++++++++ ci-framework-data/ 2025-10-13 20:48:42.954273 | controller | cd+++++++++ ci-framework-data/artifacts/ 2025-10-13 20:48:42.954296 | controller | >f+++++++++ ci-framework-data/artifacts/ansible-facts.yml 2025-10-13 20:48:42.954319 | controller | >f+++++++++ ci-framework-data/artifacts/ansible-vars.yml 2025-10-13 20:48:42.954341 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_000_check_for_oc.sh 2025-10-13 20:48:42.954362 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_000_copy_logs_from_crc.sh 2025-10-13 20:48:42.954385 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_000_prepare_root_ssh.sh 2025-10-13 20:48:42.954408 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_000_run_download.sh 2025-10-13 20:48:42.954429 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_000_run_openstack_must_gather.sh 2025-10-13 20:48:42.954451 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_001_fetch_openshift.sh 2025-10-13 20:48:42.954473 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_002_run_crc_attach_default.sh 2025-10-13 20:48:42.954494 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_003_run_hook_without_retry_fetch.sh 2025-10-13 20:48:42.954516 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_004_run_hook_without_retry_fetch.sh 2025-10-13 20:48:42.954537 | controller | >f+++++++++ ci-framework-data/artifacts/ci_script_005_run_openstack.sh 2025-10-13 20:48:42.954558 | controller | >f+++++++++ ci-framework-data/artifacts/hosts 2025-10-13 20:48:42.954588 | controller | >f+++++++++ ci-framework-data/artifacts/install_yamls.sh 2025-10-13 20:48:42.954611 | controller | >f+++++++++ ci-framework-data/artifacts/installed-packages.yml 2025-10-13 20:48:42.954632 | controller | >f+++++++++ ci-framework-data/artifacts/ip-network.txt 2025-10-13 20:48:42.954653 | controller | >f+++++++++ ci-framework-data/artifacts/resolv.conf 2025-10-13 20:48:42.954674 | controller | >f+++++++++ ci-framework-data/artifacts/zuul_inventory.yml 2025-10-13 20:48:42.954694 | controller | cd+++++++++ ci-framework-data/artifacts/NetworkManager/ 2025-10-13 20:48:42.954716 | controller | >f+++++++++ ci-framework-data/artifacts/NetworkManager/ci-private-network.nmconnection 2025-10-13 20:48:42.954763 | controller | >f+++++++++ ci-framework-data/artifacts/NetworkManager/ens3.nmconnection 2025-10-13 20:48:42.954787 | controller | cd+++++++++ ci-framework-data/artifacts/ansible_facts.2025-10-13_20-47/ 2025-10-13 20:48:42.954809 | controller | cd+++++++++ ci-framework-data/artifacts/ansible_facts.2025-10-13_20-47/ansible_facts_cache/ 2025-10-13 20:48:42.954830 | controller | >f+++++++++ ci-framework-data/artifacts/ansible_facts.2025-10-13_20-47/ansible_facts_cache/localhost 2025-10-13 20:48:42.954851 | controller | cd+++++++++ ci-framework-data/artifacts/ci-env/ 2025-10-13 20:48:42.954873 | controller | >f+++++++++ ci-framework-data/artifacts/ci-env/networking-info.yml 2025-10-13 20:48:42.954895 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/ 2025-10-13 20:48:42.954916 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/cert-manager-operator/ 2025-10-13 20:48:42.954938 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/cert-manager-operator/namespace.yaml 2025-10-13 20:48:42.954959 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/ 2025-10-13 20:48:42.954985 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op/ 2025-10-13 20:48:42.955009 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op/operatorgroup.yaml 2025-10-13 20:48:42.955032 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op/subscription.yaml 2025-10-13 20:48:42.955057 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/crc-storage/ 2025-10-13 20:48:42.955081 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml 2025-10-13 20:48:42.955104 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/crc/ 2025-10-13 20:48:42.955126 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/crc/storage.yaml 2025-10-13 20:48:42.955148 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/metallb-system/ 2025-10-13 20:48:42.955170 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/metallb-system/namespace.yaml 2025-10-13 20:48:42.955192 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/ 2025-10-13 20:48:42.955214 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ 2025-10-13 20:48:42.955235 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml 2025-10-13 20:48:42.955257 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml 2025-10-13 20:48:42.955278 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml 2025-10-13 20:48:42.955300 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/deploy_operator.yaml 2025-10-13 20:48:42.955321 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml 2025-10-13 20:48:42.955343 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml 2025-10-13 20:48:42.955366 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openshift-nmstate/ 2025-10-13 20:48:42.955393 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openshift-nmstate/namespace.yaml 2025-10-13 20:48:42.955416 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/ 2025-10-13 20:48:42.955438 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr/ 2025-10-13 20:48:42.955460 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr/deploy_operator.yaml 2025-10-13 20:48:42.955484 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ 2025-10-13 20:48:42.955508 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/namespace.yaml 2025-10-13 20:48:42.955528 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input/ 2025-10-13 20:48:42.955549 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input/kustomization.yaml 2025-10-13 20:48:42.955570 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/ 2025-10-13 20:48:42.955591 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/ 2025-10-13 20:48:42.955612 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/ctlplane.yaml 2025-10-13 20:48:42.955633 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/datacentre.yaml 2025-10-13 20:48:42.955654 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/designate.yaml 2025-10-13 20:48:42.955675 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/designateext.yaml 2025-10-13 20:48:42.955696 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/internalapi.yaml 2025-10-13 20:48:42.955717 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/octavia.yaml 2025-10-13 20:48:42.955778 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/storage.yaml 2025-10-13 20:48:42.955803 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/storagemgmt.yaml 2025-10-13 20:48:42.955824 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/tenant.yaml 2025-10-13 20:48:42.955845 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/ 2025-10-13 20:48:42.955867 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/ 2025-10-13 20:48:42.955888 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/crc_nncp.yaml 2025-10-13 20:48:42.955910 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/ 2025-10-13 20:48:42.955932 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr/ 2025-10-13 20:48:42.955953 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml 2025-10-13 20:48:42.955974 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr/kustomization.yaml 2025-10-13 20:48:42.955996 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/ 2025-10-13 20:48:42.956018 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/namespace.yaml 2025-10-13 20:48:42.956039 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/metallb/ 2025-10-13 20:48:42.956060 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/metallb/op/ 2025-10-13 20:48:42.956080 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/metallb/op/operatorgroup.yaml 2025-10-13 20:48:42.956106 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/metallb/op/subscription.yaml 2025-10-13 20:48:42.956128 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/nmstate/ 2025-10-13 20:48:42.956149 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op/ 2025-10-13 20:48:42.956171 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op/operatorgroup.yaml 2025-10-13 20:48:42.956192 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op/subscription.yaml 2025-10-13 20:48:42.956213 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/openstack/ 2025-10-13 20:48:42.956234 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/openstack/op/ 2025-10-13 20:48:42.956255 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/openstack/op/catalogsource.yaml 2025-10-13 20:48:42.956276 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/openstack/op/operatorgroup.yaml 2025-10-13 20:48:42.956297 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/openstack-operators/openstack/op/subscription.yaml 2025-10-13 20:48:42.956319 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack/ 2025-10-13 20:48:42.956341 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/openstack/cr/ 2025-10-13 20:48:42.956363 | controller | cd+++++++++ ci-framework-data/artifacts/manifests/storage/ 2025-10-13 20:48:42.956385 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/storage/storage-class.yaml 2025-10-13 20:48:42.956407 | controller | >f+++++++++ ci-framework-data/artifacts/manifests/storage/storage.yaml 2025-10-13 20:48:42.956428 | controller | cd+++++++++ ci-framework-data/artifacts/parameters/ 2025-10-13 20:48:42.956450 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/custom-params.yml 2025-10-13 20:48:42.956474 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/install-yamls-params.yml 2025-10-13 20:48:42.956498 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/openshift-login-params.yml 2025-10-13 20:48:42.956519 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/pre_kuttl_fetch_crc_facts_and_save_them_.yml 2025-10-13 20:48:42.956541 | controller | >f+++++++++ ci-framework-data/artifacts/parameters/zuul-params.yml 2025-10-13 20:48:42.956563 | controller | cd+++++++++ ci-framework-data/artifacts/repositories/ 2025-10-13 20:48:42.956586 | controller | >f+++++++++ ci-framework-data/artifacts/repositories/delorean-antelope-testing.repo 2025-10-13 20:48:42.956608 | controller | >f+++++++++ ci-framework-data/artifacts/repositories/delorean.repo 2025-10-13 20:48:42.956630 | controller | >f+++++++++ ci-framework-data/artifacts/repositories/delorean.repo.md5 2025-10-13 20:48:42.956652 | controller | >f+++++++++ ci-framework-data/artifacts/repositories/repo-setup-centos-appstream.repo 2025-10-13 20:48:42.956673 | controller | >f+++++++++ ci-framework-data/artifacts/repositories/repo-setup-centos-baseos.repo 2025-10-13 20:48:42.956696 | controller | >f+++++++++ ci-framework-data/artifacts/repositories/repo-setup-centos-highavailability.repo 2025-10-13 20:48:42.956717 | controller | >f+++++++++ ci-framework-data/artifacts/repositories/repo-setup-centos-powertools.repo 2025-10-13 20:48:42.956764 | controller | cd+++++++++ ci-framework-data/artifacts/roles/ 2025-10-13 20:48:42.956788 | controller | cd+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/ 2025-10-13 20:48:42.956810 | controller | cd+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/ 2025-10-13 20:48:42.956832 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_all.yml 2025-10-13 20:48:42.956863 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ansibleee.yml 2025-10-13 20:48:42.956886 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ansibleee_cleanup.yml 2025-10-13 20:48:42.956908 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ansibleee_kuttl.yml 2025-10-13 20:48:42.956930 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ansibleee_kuttl_cleanup.yml 2025-10-13 20:48:42.956953 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ansibleee_kuttl_prep.yml 2025-10-13 20:48:42.956975 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ansibleee_kuttl_run.yml 2025-10-13 20:48:42.956995 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ansibleee_prep.yml 2025-10-13 20:48:42.957016 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_attach_default_interface.yml 2025-10-13 20:48:42.957060 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_attach_default_interface_cleanup.yml 2025-10-13 20:48:42.957082 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican.yml 2025-10-13 20:48:42.957104 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_cleanup.yml 2025-10-13 20:48:42.957125 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_deploy.yml 2025-10-13 20:48:42.957146 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_deploy_cleanup.yml 2025-10-13 20:48:42.957167 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_deploy_prep.yml 2025-10-13 20:48:42.957188 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_deploy_validate.yml 2025-10-13 20:48:42.957209 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_kuttl.yml 2025-10-13 20:48:42.957230 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_kuttl_run.yml 2025-10-13 20:48:42.957250 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_barbican_prep.yml 2025-10-13 20:48:42.957271 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_baremetal.yml 2025-10-13 20:48:42.957292 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_baremetal_cleanup.yml 2025-10-13 20:48:42.957312 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_baremetal_prep.yml 2025-10-13 20:48:42.957333 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas.yml 2025-10-13 20:48:42.957354 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_baremetal_net_nad.yml 2025-10-13 20:48:42.957376 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_baremetal_net_nad_cleanup.yml 2025-10-13 20:48:42.957440 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_cleanup.yml 2025-10-13 20:48:42.957510 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_crc_attach_network.yml 2025-10-13 20:48:42.957548 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_crc_attach_network_cleanup.yml 2025-10-13 20:48:42.957574 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_crc_baremetal_bridge.yml 2025-10-13 20:48:42.957598 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_crc_baremetal_bridge_cleanup.yml 2025-10-13 20:48:42.957627 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_generate_nodes_yaml.yml 2025-10-13 20:48:42.957650 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_metallb.yml 2025-10-13 20:48:42.957672 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_metallb_cleanup.yml 2025-10-13 20:48:42.957694 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_network.yml 2025-10-13 20:48:42.957716 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_network_cleanup.yml 2025-10-13 20:48:42.957767 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_route_crc_and_crc_bmaas_networks.yml 2025-10-13 20:48:42.957792 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_route_crc_and_crc_bmaas_networks_cleanup.yml 2025-10-13 20:48:42.957815 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_sushy_emulator.yml 2025-10-13 20:48:42.957837 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_sushy_emulator_cleanup.yml 2025-10-13 20:48:42.957858 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_sushy_emulator_wait.yml 2025-10-13 20:48:42.957880 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_virtual_bms.yml 2025-10-13 20:48:42.957901 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_bmaas_virtual_bms_cleanup.yml 2025-10-13 20:48:42.957922 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ceph.yml 2025-10-13 20:48:42.957944 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ceph_cleanup.yml 2025-10-13 20:48:42.957965 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ceph_help.yml 2025-10-13 20:48:42.957987 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_certmanager.yml 2025-10-13 20:48:42.958009 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_certmanager_cleanup.yml 2025-10-13 20:48:42.958031 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cifmw_cleanup.yml 2025-10-13 20:48:42.958052 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cifmw_prepare.yml 2025-10-13 20:48:42.958077 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder.yml 2025-10-13 20:48:42.958106 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder_cleanup.yml 2025-10-13 20:48:42.958140 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder_deploy.yml 2025-10-13 20:48:42.958172 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder_deploy_cleanup.yml 2025-10-13 20:48:42.958195 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder_deploy_prep.yml 2025-10-13 20:48:42.958219 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder_kuttl.yml 2025-10-13 20:48:42.958241 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder_kuttl_run.yml 2025-10-13 20:48:42.958264 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cinder_prep.yml 2025-10-13 20:48:42.958286 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_cleanup.yml 2025-10-13 20:48:42.958309 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc.yml 2025-10-13 20:48:42.958337 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_attach_default_interface.yml 2025-10-13 20:48:42.958360 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_attach_default_interface_cleanup.yml 2025-10-13 20:48:42.958383 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_bmo_cleanup.yml 2025-10-13 20:48:42.958405 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_bmo_setup.yml 2025-10-13 20:48:42.958427 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_cleanup.yml 2025-10-13 20:48:42.958450 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_scrub.yml 2025-10-13 20:48:42.958472 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_storage.yml 2025-10-13 20:48:42.958493 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_storage_cleanup.yml 2025-10-13 20:48:42.958515 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_storage_cleanup_with_retries.yml 2025-10-13 20:48:42.958537 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_storage_release.yml 2025-10-13 20:48:42.958559 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_crc_storage_with_retries.yml 2025-10-13 20:48:42.958581 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_deploy_cleanup.yml 2025-10-13 20:48:42.958603 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate.yml 2025-10-13 20:48:42.958625 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate_cleanup.yml 2025-10-13 20:48:42.958648 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate_deploy.yml 2025-10-13 20:48:42.958670 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate_deploy_cleanup.yml 2025-10-13 20:48:42.958691 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate_deploy_prep.yml 2025-10-13 20:48:42.958713 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate_kuttl.yml 2025-10-13 20:48:42.958760 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate_kuttl_run.yml 2025-10-13 20:48:42.958784 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_designate_prep.yml 2025-10-13 20:48:42.958811 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_dns_deploy.yml 2025-10-13 20:48:42.958843 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_dns_deploy_cleanup.yml 2025-10-13 20:48:42.958875 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_dns_deploy_prep.yml 2025-10-13 20:48:42.958903 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_download_tools.yml 2025-10-13 20:48:42.958925 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_ansible_runner.yml 2025-10-13 20:48:42.958947 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_baremetal_compute.yml 2025-10-13 20:48:42.958969 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_compute.yml 2025-10-13 20:48:42.958991 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_compute_bootc.yml 2025-10-13 20:48:42.959012 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_compute_cleanup.yml 2025-10-13 20:48:42.959039 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_compute_repos.yml 2025-10-13 20:48:42.959062 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_computes_bgp.yml 2025-10-13 20:48:42.959083 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy.yml 2025-10-13 20:48:42.959105 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_baremetal.yml 2025-10-13 20:48:42.959126 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_baremetal_prep.yml 2025-10-13 20:48:42.959148 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_cleanup.yml 2025-10-13 20:48:42.959169 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_generate_keys.yml 2025-10-13 20:48:42.959191 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_instance.yml 2025-10-13 20:48:42.959212 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_networker.yml 2025-10-13 20:48:42.959234 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_networker_cleanup.yml 2025-10-13 20:48:42.959256 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_networker_prep.yml 2025-10-13 20:48:42.959278 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_deploy_prep.yml 2025-10-13 20:48:42.959299 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_networker.yml 2025-10-13 20:48:42.959321 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_networker_cleanup.yml 2025-10-13 20:48:42.959341 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_nova_discover_hosts.yml 2025-10-13 20:48:42.959365 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_patch_ansible_runner_image.yml 2025-10-13 20:48:42.959397 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_register_dns.yml 2025-10-13 20:48:42.959427 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_wait_deploy.yml 2025-10-13 20:48:42.959456 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_edpm_wait_deploy_baremetal.yml 2025-10-13 20:48:42.959480 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance.yml 2025-10-13 20:48:42.959506 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance_cleanup.yml 2025-10-13 20:48:42.959539 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance_deploy.yml 2025-10-13 20:48:42.959570 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance_deploy_cleanup.yml 2025-10-13 20:48:42.959602 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance_deploy_prep.yml 2025-10-13 20:48:42.959625 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance_kuttl.yml 2025-10-13 20:48:42.959647 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance_kuttl_run.yml 2025-10-13 20:48:42.959669 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_glance_prep.yml 2025-10-13 20:48:42.959690 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat.yml 2025-10-13 20:48:42.959712 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_cleanup.yml 2025-10-13 20:48:42.959780 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_deploy.yml 2025-10-13 20:48:42.959807 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_deploy_cleanup.yml 2025-10-13 20:48:42.959829 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_deploy_prep.yml 2025-10-13 20:48:42.959850 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_kuttl.yml 2025-10-13 20:48:42.959871 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_kuttl_crc.yml 2025-10-13 20:48:42.959892 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_kuttl_run.yml 2025-10-13 20:48:42.959913 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_heat_prep.yml 2025-10-13 20:48:42.959934 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_help.yml 2025-10-13 20:48:42.959956 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon.yml 2025-10-13 20:48:42.959978 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon_cleanup.yml 2025-10-13 20:48:42.960000 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon_deploy.yml 2025-10-13 20:48:42.960022 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon_deploy_cleanup.yml 2025-10-13 20:48:42.960044 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon_deploy_prep.yml 2025-10-13 20:48:42.960066 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon_kuttl.yml 2025-10-13 20:48:42.960088 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon_kuttl_run.yml 2025-10-13 20:48:42.960110 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_horizon_prep.yml 2025-10-13 20:48:42.960132 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_infra.yml 2025-10-13 20:48:42.960153 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_infra_cleanup.yml 2025-10-13 20:48:42.960184 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_infra_kuttl.yml 2025-10-13 20:48:42.960216 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_infra_kuttl_run.yml 2025-10-13 20:48:42.960248 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_infra_prep.yml 2025-10-13 20:48:42.960273 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_input.yml 2025-10-13 20:48:42.960296 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_input_cleanup.yml 2025-10-13 20:48:42.960319 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab.yml 2025-10-13 20:48:42.960342 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab_cleanup.yml 2025-10-13 20:48:42.960364 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab_nat64_router.yml 2025-10-13 20:48:42.960387 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab_nat64_router_cleanup.yml 2025-10-13 20:48:42.960409 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab_network.yml 2025-10-13 20:48:42.960431 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab_network_cleanup.yml 2025-10-13 20:48:42.960458 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab_sno.yml 2025-10-13 20:48:42.960480 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ipv6_lab_sno_cleanup.yml 2025-10-13 20:48:42.960503 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic.yml 2025-10-13 20:48:42.960524 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_cleanup.yml 2025-10-13 20:48:42.960546 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_deploy.yml 2025-10-13 20:48:42.960567 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_deploy_cleanup.yml 2025-10-13 20:48:42.960589 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_deploy_prep.yml 2025-10-13 20:48:42.960610 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_kuttl.yml 2025-10-13 20:48:42.960631 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_kuttl_crc.yml 2025-10-13 20:48:42.960653 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_kuttl_run.yml 2025-10-13 20:48:42.960674 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ironic_prep.yml 2025-10-13 20:48:42.960695 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone.yml 2025-10-13 20:48:42.960716 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone_cleanup.yml 2025-10-13 20:48:42.960765 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone_deploy.yml 2025-10-13 20:48:42.960789 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone_deploy_cleanup.yml 2025-10-13 20:48:42.960811 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone_deploy_prep.yml 2025-10-13 20:48:42.960833 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone_kuttl.yml 2025-10-13 20:48:42.960855 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone_kuttl_run.yml 2025-10-13 20:48:42.960876 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_keystone_prep.yml 2025-10-13 20:48:42.960898 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_kuttl_common_cleanup.yml 2025-10-13 20:48:42.960919 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_kuttl_common_prep.yml 2025-10-13 20:48:42.960940 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_kuttl_db_cleanup.yml 2025-10-13 20:48:42.960961 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_kuttl_db_prep.yml 2025-10-13 20:48:42.960982 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_loki.yml 2025-10-13 20:48:42.961003 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_loki_cleanup.yml 2025-10-13 20:48:42.961024 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_loki_deploy.yml 2025-10-13 20:48:42.961067 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_loki_deploy_cleanup.yml 2025-10-13 20:48:42.961180 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_lvms.yml 2025-10-13 20:48:42.961219 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila.yml 2025-10-13 20:48:42.961243 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila_cleanup.yml 2025-10-13 20:48:42.961273 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila_deploy.yml 2025-10-13 20:48:42.961297 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila_deploy_cleanup.yml 2025-10-13 20:48:42.961319 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila_deploy_prep.yml 2025-10-13 20:48:42.961341 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila_kuttl.yml 2025-10-13 20:48:42.961365 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila_kuttl_run.yml 2025-10-13 20:48:42.961397 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_manila_prep.yml 2025-10-13 20:48:42.961430 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb.yml 2025-10-13 20:48:42.961456 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_chainsaw.yml 2025-10-13 20:48:42.961478 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_chainsaw_run.yml 2025-10-13 20:48:42.961503 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_cleanup.yml 2025-10-13 20:48:42.961527 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_deploy.yml 2025-10-13 20:48:42.961548 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_deploy_cleanup.yml 2025-10-13 20:48:42.961570 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_deploy_prep.yml 2025-10-13 20:48:42.961592 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_kuttl.yml 2025-10-13 20:48:42.961613 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_mariadb_kuttl_run.yml 2025-10-13 20:48:42.961634 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_memcached_deploy.yml 2025-10-13 20:48:42.961655 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_memcached_deploy_cleanup.yml 2025-10-13 20:48:42.961677 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_memcached_deploy_prep.yml 2025-10-13 20:48:42.961700 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_metallb.yml 2025-10-13 20:48:42.961722 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_metallb_cleanup.yml 2025-10-13 20:48:42.961771 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_metallb_config.yml 2025-10-13 20:48:42.961794 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_metallb_config_cleanup.yml 2025-10-13 20:48:42.961817 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_namespace.yml 2025-10-13 20:48:42.961839 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_namespace_cleanup.yml 2025-10-13 20:48:42.961861 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netattach.yml 2025-10-13 20:48:42.961883 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netattach_cleanup.yml 2025-10-13 20:48:42.961904 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netconfig_deploy.yml 2025-10-13 20:48:42.961926 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netconfig_deploy_cleanup.yml 2025-10-13 20:48:42.961947 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netconfig_deploy_prep.yml 2025-10-13 20:48:42.961976 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netobserv.yml 2025-10-13 20:48:42.961998 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netobserv_cleanup.yml 2025-10-13 20:48:42.962020 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netobserv_deploy.yml 2025-10-13 20:48:42.962042 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_netobserv_deploy_cleanup.yml 2025-10-13 20:48:42.962064 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_network_isolation_bridge.yml 2025-10-13 20:48:42.962086 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_network_isolation_bridge_cleanup.yml 2025-10-13 20:48:42.962108 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron.yml 2025-10-13 20:48:42.962130 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron_cleanup.yml 2025-10-13 20:48:42.962152 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron_deploy.yml 2025-10-13 20:48:42.962173 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron_deploy_cleanup.yml 2025-10-13 20:48:42.962201 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron_deploy_prep.yml 2025-10-13 20:48:42.962234 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron_kuttl.yml 2025-10-13 20:48:42.962265 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron_kuttl_run.yml 2025-10-13 20:48:42.962295 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_neutron_prep.yml 2025-10-13 20:48:42.962318 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nfs.yml 2025-10-13 20:48:42.962340 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nfs_cleanup.yml 2025-10-13 20:48:42.962361 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nmstate.yml 2025-10-13 20:48:42.962383 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nncp.yml 2025-10-13 20:48:42.962404 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nncp_cleanup.yml 2025-10-13 20:48:42.962426 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nova.yml 2025-10-13 20:48:42.962448 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nova_cleanup.yml 2025-10-13 20:48:42.962512 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nova_deploy.yml 2025-10-13 20:48:42.962542 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nova_deploy_cleanup.yml 2025-10-13 20:48:42.962565 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nova_deploy_prep.yml 2025-10-13 20:48:42.962587 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_nova_prep.yml 2025-10-13 20:48:42.962608 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia.yml 2025-10-13 20:48:42.962630 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia_cleanup.yml 2025-10-13 20:48:42.962651 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia_deploy.yml 2025-10-13 20:48:42.962673 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia_deploy_cleanup.yml 2025-10-13 20:48:42.962694 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia_deploy_prep.yml 2025-10-13 20:48:42.962721 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia_kuttl.yml 2025-10-13 20:48:42.962766 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia_kuttl_run.yml 2025-10-13 20:48:42.962789 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_octavia_prep.yml 2025-10-13 20:48:42.962811 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack.yml 2025-10-13 20:48:42.962833 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_cleanup.yml 2025-10-13 20:48:42.962855 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_crds.yml 2025-10-13 20:48:42.962876 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_crds_cleanup.yml 2025-10-13 20:48:42.962897 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_deploy.yml 2025-10-13 20:48:42.962918 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_deploy_cleanup.yml 2025-10-13 20:48:42.962940 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_deploy_prep.yml 2025-10-13 20:48:42.962962 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_init.yml 2025-10-13 20:48:42.962983 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_kuttl.yml 2025-10-13 20:48:42.963005 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_kuttl_run.yml 2025-10-13 20:48:42.963026 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_patch_version.yml 2025-10-13 20:48:42.963047 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_prep.yml 2025-10-13 20:48:42.963068 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_repo.yml 2025-10-13 20:48:42.963089 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_update_run.yml 2025-10-13 20:48:42.963110 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_wait.yml 2025-10-13 20:48:42.963131 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_openstack_wait_deploy.yml 2025-10-13 20:48:42.963153 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_operator_namespace.yml 2025-10-13 20:48:42.963175 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn.yml 2025-10-13 20:48:42.963197 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn_cleanup.yml 2025-10-13 20:48:42.963218 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn_deploy.yml 2025-10-13 20:48:42.963240 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn_deploy_cleanup.yml 2025-10-13 20:48:42.963261 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn_deploy_prep.yml 2025-10-13 20:48:42.963282 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn_kuttl.yml 2025-10-13 20:48:42.963304 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn_kuttl_run.yml 2025-10-13 20:48:42.963325 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_ovn_prep.yml 2025-10-13 20:48:42.963347 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement.yml 2025-10-13 20:48:42.963374 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement_cleanup.yml 2025-10-13 20:48:42.963396 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement_deploy.yml 2025-10-13 20:48:42.963417 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement_deploy_cleanup.yml 2025-10-13 20:48:42.963439 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement_deploy_prep.yml 2025-10-13 20:48:42.963460 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement_kuttl.yml 2025-10-13 20:48:42.963482 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement_kuttl_run.yml 2025-10-13 20:48:42.963504 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_placement_prep.yml 2025-10-13 20:48:42.963525 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rabbitmq.yml 2025-10-13 20:48:42.963548 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rabbitmq_cleanup.yml 2025-10-13 20:48:42.963570 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rabbitmq_deploy.yml 2025-10-13 20:48:42.963591 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rabbitmq_deploy_cleanup.yml 2025-10-13 20:48:42.963622 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rabbitmq_deploy_prep.yml 2025-10-13 20:48:42.963645 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rabbitmq_prep.yml 2025-10-13 20:48:42.963676 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_redis_deploy.yml 2025-10-13 20:48:42.963828 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_redis_deploy_cleanup.yml 2025-10-13 20:48:42.963866 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_redis_deploy_prep.yml 2025-10-13 20:48:42.963890 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rook.yml 2025-10-13 20:48:42.963913 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rook_cleanup.yml 2025-10-13 20:48:42.963935 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rook_crc_disk.yml 2025-10-13 20:48:42.963958 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rook_deploy.yml 2025-10-13 20:48:42.963979 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rook_deploy_prep.yml 2025-10-13 20:48:42.964001 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_rook_prep.yml 2025-10-13 20:48:42.964023 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_set_slower_etcd_profile.yml 2025-10-13 20:48:42.964044 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_standalone.yml 2025-10-13 20:48:42.964066 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_standalone_cleanup.yml 2025-10-13 20:48:42.964087 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_standalone_deploy.yml 2025-10-13 20:48:42.964108 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_standalone_revert.yml 2025-10-13 20:48:42.964129 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_standalone_snapshot.yml 2025-10-13 20:48:42.964150 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_standalone_sync.yml 2025-10-13 20:48:42.964171 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift.yml 2025-10-13 20:48:42.964197 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift_cleanup.yml 2025-10-13 20:48:42.964219 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift_deploy.yml 2025-10-13 20:48:42.964241 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift_deploy_cleanup.yml 2025-10-13 20:48:42.964262 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift_deploy_prep.yml 2025-10-13 20:48:42.964283 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift_kuttl.yml 2025-10-13 20:48:42.964305 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift_kuttl_run.yml 2025-10-13 20:48:42.964326 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_swift_prep.yml 2025-10-13 20:48:42.964347 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry.yml 2025-10-13 20:48:42.964369 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry_cleanup.yml 2025-10-13 20:48:42.964390 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry_deploy.yml 2025-10-13 20:48:42.964414 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry_deploy_cleanup.yml 2025-10-13 20:48:42.964437 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry_deploy_prep.yml 2025-10-13 20:48:42.964460 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry_kuttl.yml 2025-10-13 20:48:42.964484 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry_kuttl_run.yml 2025-10-13 20:48:42.964508 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_telemetry_prep.yml 2025-10-13 20:48:42.964530 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_tripleo_deploy.yml 2025-10-13 20:48:42.964552 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_update_services.yml 2025-10-13 20:48:42.964574 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_update_system.yml 2025-10-13 20:48:42.964595 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_validate_marketplace.yml 2025-10-13 20:48:42.964616 | controller | >f+++++++++ ci-framework-data/artifacts/roles/install_yamls_makes/tasks/make_wait.yml 2025-10-13 20:48:42.964638 | controller | cd+++++++++ ci-framework-data/artifacts/yum_repos/ 2025-10-13 20:48:42.964660 | controller | >f+++++++++ ci-framework-data/artifacts/yum_repos/delorean-antelope-testing.repo 2025-10-13 20:48:42.964682 | controller | >f+++++++++ ci-framework-data/artifacts/yum_repos/delorean.repo 2025-10-13 20:48:42.964704 | controller | >f+++++++++ ci-framework-data/artifacts/yum_repos/delorean.repo.md5 2025-10-13 20:48:42.964746 | controller | >f+++++++++ ci-framework-data/artifacts/yum_repos/repo-setup-centos-appstream.repo 2025-10-13 20:48:42.964775 | controller | >f+++++++++ ci-framework-data/artifacts/yum_repos/repo-setup-centos-baseos.repo 2025-10-13 20:48:42.964798 | controller | >f+++++++++ ci-framework-data/artifacts/yum_repos/repo-setup-centos-highavailability.repo 2025-10-13 20:48:42.964821 | controller | >f+++++++++ ci-framework-data/artifacts/yum_repos/repo-setup-centos-powertools.repo 2025-10-13 20:48:42.964842 | controller | cd+++++++++ ci-framework-data/logs/ 2025-10-13 20:48:42.964864 | controller | >f+++++++++ ci-framework-data/logs/ansible.log.gz 2025-10-13 20:48:42.964886 | controller | >f+++++++++ ci-framework-data/logs/ci_script_000_copy_logs_from_crc.log 2025-10-13 20:48:42.964908 | controller | >f+++++++++ ci-framework-data/logs/ci_script_000_prepare_root_ssh.log 2025-10-13 20:48:42.964934 | controller | >f+++++++++ ci-framework-data/logs/ci_script_000_run_download.log 2025-10-13 20:48:42.964957 | controller | >f+++++++++ ci-framework-data/logs/ci_script_000_run_openstack_must_gather.log 2025-10-13 20:48:42.964978 | controller | >f+++++++++ ci-framework-data/logs/ci_script_001_fetch_openshift.log 2025-10-13 20:48:42.965000 | controller | >f+++++++++ ci-framework-data/logs/ci_script_002_run_crc_attach_default.log 2025-10-13 20:48:42.965022 | controller | >f+++++++++ ci-framework-data/logs/ci_script_003_run_hook_without_retry_fetch.log 2025-10-13 20:48:42.965067 | controller | >f+++++++++ ci-framework-data/logs/ci_script_004_run_hook_without_retry_fetch.log 2025-10-13 20:48:42.965094 | controller | >f+++++++++ ci-framework-data/logs/ci_script_005_run_openstack.log 2025-10-13 20:48:42.965119 | controller | >f+++++++++ ci-framework-data/logs/cmd_after_openstack_kuttl.log 2025-10-13 20:48:42.965143 | controller | >f+++++++++ ci-framework-data/logs/cmd_before_openstack_kuttl.log 2025-10-13 20:48:42.965168 | controller | >f+++++++++ ci-framework-data/logs/pre_kuttl_fetch_crc_facts_and_save_them_.log 2025-10-13 20:48:42.965192 | controller | cd+++++++++ ci-framework-data/logs/2025-10-13_20-41/ 2025-10-13 20:48:42.965217 | controller | >f+++++++++ ci-framework-data/logs/2025-10-13_20-41/ansible.log.gz 2025-10-13 20:48:42.965242 | controller | cd+++++++++ ci-framework-data/logs/crc/ 2025-10-13 20:48:42.965266 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/ 2025-10-13 20:48:42.965291 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/ 2025-10-13 20:48:42.965314 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager-operator_cert-manager-operator-controller-manager-57cd46d6d-t9wrm_65bc643f-9a01-490c-9abf-e97c3e073eff/ 2025-10-13 20:48:42.965337 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager-operator_cert-manager-operator-controller-manager-57cd46d6d-t9wrm_65bc643f-9a01-490c-9abf-e97c3e073eff/cert-manager-operator/ 2025-10-13 20:48:42.965360 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager-operator_cert-manager-operator-controller-manager-57cd46d6d-t9wrm_65bc643f-9a01-490c-9abf-e97c3e073eff/cert-manager-operator/0.log 2025-10-13 20:48:42.965392 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-7d4cc89fcb-452pc_299a48a0-5b8a-48b9-a956-01f9ed90b45b/ 2025-10-13 20:48:42.965426 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-7d4cc89fcb-452pc_299a48a0-5b8a-48b9-a956-01f9ed90b45b/cert-manager-controller/ 2025-10-13 20:48:42.965458 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-7d4cc89fcb-452pc_299a48a0-5b8a-48b9-a956-01f9ed90b45b/cert-manager-controller/0.log 2025-10-13 20:48:42.965481 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-cainjector-7d9f95dbf-866gz_6f6f025e-3897-4580-b346-311cfaf75013/ 2025-10-13 20:48:42.965497 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-cainjector-7d9f95dbf-866gz_6f6f025e-3897-4580-b346-311cfaf75013/cert-manager-cainjector/ 2025-10-13 20:48:42.965513 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-cainjector-7d9f95dbf-866gz_6f6f025e-3897-4580-b346-311cfaf75013/cert-manager-cainjector/0.log 2025-10-13 20:48:42.965529 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-webhook-d969966f-qjpx9_a6177722-0b89-4a31-add5-8c1442b93a08/ 2025-10-13 20:48:42.965546 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-webhook-d969966f-qjpx9_a6177722-0b89-4a31-add5-8c1442b93a08/cert-manager-webhook/ 2025-10-13 20:48:42.965566 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/cert-manager_cert-manager-webhook-d969966f-qjpx9_a6177722-0b89-4a31-add5-8c1442b93a08/cert-manager-webhook/0.log 2025-10-13 20:48:42.965583 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/crc-storage_crc-storage-crc-g4bk2_9e8131b2-d120-46dc-9bbd-348f0d88b934/ 2025-10-13 20:48:42.965598 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/crc-storage_crc-storage-crc-g4bk2_9e8131b2-d120-46dc-9bbd-348f0d88b934/storage/ 2025-10-13 20:48:42.965614 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/crc-storage_crc-storage-crc-g4bk2_9e8131b2-d120-46dc-9bbd-348f0d88b934/storage/0.log 2025-10-13 20:48:42.965630 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/ 2025-10-13 20:48:42.965646 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/csi-provisioner/ 2025-10-13 20:48:42.965662 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/csi-provisioner/0.log 2025-10-13 20:48:42.965678 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/hostpath-provisioner/ 2025-10-13 20:48:42.965694 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/hostpath-provisioner/0.log 2025-10-13 20:48:42.965709 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/liveness-probe/ 2025-10-13 20:48:42.965740 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/liveness-probe/0.log 2025-10-13 20:48:42.965762 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/node-driver-registrar/ 2025-10-13 20:48:42.965778 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/hostpath-provisioner_csi-hostpathplugin-mzwj7_23bf5a08-c071-4ce9-8f60-315860fede65/node-driver-registrar/0.log 2025-10-13 20:48:42.965793 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_controller-68d546b9d8-bgd9l_4607fa15-7d60-49e9-86f4-89184404a135/ 2025-10-13 20:48:42.965809 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_controller-68d546b9d8-bgd9l_4607fa15-7d60-49e9-86f4-89184404a135/controller/ 2025-10-13 20:48:42.965824 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_controller-68d546b9d8-bgd9l_4607fa15-7d60-49e9-86f4-89184404a135/controller/0.log.gz 2025-10-13 20:48:42.965840 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_controller-68d546b9d8-bgd9l_4607fa15-7d60-49e9-86f4-89184404a135/kube-rbac-proxy/ 2025-10-13 20:48:42.965855 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_controller-68d546b9d8-bgd9l_4607fa15-7d60-49e9-86f4-89184404a135/kube-rbac-proxy/0.log 2025-10-13 20:48:42.965871 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/ 2025-10-13 20:48:42.965887 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/eface4cd6d9b3e4843052dc8f96fac53c4fde3fa8f85d7e8481000f909c33270.log 2025-10-13 20:48:42.965902 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/controller/ 2025-10-13 20:48:42.965921 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/controller/0.log 2025-10-13 20:48:42.965937 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/cp-frr-files/ 2025-10-13 20:48:42.965953 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/cp-frr-files/0.log 2025-10-13 20:48:42.965968 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/cp-metrics/ 2025-10-13 20:48:42.965983 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/cp-metrics/0.log 2025-10-13 20:48:42.965999 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/cp-reloader/ 2025-10-13 20:48:42.966015 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/cp-reloader/0.log 2025-10-13 20:48:42.966030 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/frr-metrics/ 2025-10-13 20:48:42.966046 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/frr-metrics/0.log 2025-10-13 20:48:42.966061 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/frr/ 2025-10-13 20:48:42.966077 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/frr/0.log.gz 2025-10-13 20:48:42.966092 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/kube-rbac-proxy-frr/ 2025-10-13 20:48:42.966108 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/kube-rbac-proxy-frr/0.log 2025-10-13 20:48:42.966123 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/kube-rbac-proxy/ 2025-10-13 20:48:42.966139 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/kube-rbac-proxy/0.log 2025-10-13 20:48:42.966154 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/reloader/ 2025-10-13 20:48:42.966169 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-mdf8c_818f47d5-2e81-47bf-b6ac-0c348f3c9946/reloader/0.log 2025-10-13 20:48:42.966184 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-webhook-server-64bf5d555-f68l7_1f6e5a79-b1b3-4a96-8988-64d736d374b8/ 2025-10-13 20:48:42.966200 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-webhook-server-64bf5d555-f68l7_1f6e5a79-b1b3-4a96-8988-64d736d374b8/frr-k8s-webhook-server/ 2025-10-13 20:48:42.966216 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_frr-k8s-webhook-server-64bf5d555-f68l7_1f6e5a79-b1b3-4a96-8988-64d736d374b8/frr-k8s-webhook-server/0.log 2025-10-13 20:48:42.966233 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_metallb-operator-controller-manager-b7789ff7f-4dz47_6eaabd9a-5b5c-4e5a-91fe-bad48b31c216/ 2025-10-13 20:48:42.966252 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_metallb-operator-controller-manager-b7789ff7f-4dz47_6eaabd9a-5b5c-4e5a-91fe-bad48b31c216/manager/ 2025-10-13 20:48:42.966268 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_metallb-operator-controller-manager-b7789ff7f-4dz47_6eaabd9a-5b5c-4e5a-91fe-bad48b31c216/manager/0.log 2025-10-13 20:48:42.966284 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_metallb-operator-webhook-server-86869d57c5-28vf7_bfb0f926-3491-45e7-9606-03d50d9c49a4/ 2025-10-13 20:48:42.966299 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_metallb-operator-webhook-server-86869d57c5-28vf7_bfb0f926-3491-45e7-9606-03d50d9c49a4/webhook-server/ 2025-10-13 20:48:42.966315 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_metallb-operator-webhook-server-86869d57c5-28vf7_bfb0f926-3491-45e7-9606-03d50d9c49a4/webhook-server/0.log 2025-10-13 20:48:42.966331 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_speaker-lqgwl_1e303745-71a6-4be3-80bf-80e6d92b5685/ 2025-10-13 20:48:42.966347 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_speaker-lqgwl_1e303745-71a6-4be3-80bf-80e6d92b5685/kube-rbac-proxy/ 2025-10-13 20:48:42.966363 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_speaker-lqgwl_1e303745-71a6-4be3-80bf-80e6d92b5685/kube-rbac-proxy/0.log 2025-10-13 20:48:42.966378 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_speaker-lqgwl_1e303745-71a6-4be3-80bf-80e6d92b5685/speaker/ 2025-10-13 20:48:42.966394 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/metallb-system_speaker-lqgwl_1e303745-71a6-4be3-80bf-80e6d92b5685/speaker/0.log.gz 2025-10-13 20:48:42.966410 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver-operator_openshift-apiserver-operator-796bbdcf4f-wrm6s_549f81e1-d49f-472c-8422-be08ae158c08/ 2025-10-13 20:48:42.966425 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver-operator_openshift-apiserver-operator-796bbdcf4f-wrm6s_549f81e1-d49f-472c-8422-be08ae158c08/openshift-apiserver-operator/ 2025-10-13 20:48:42.966441 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver-operator_openshift-apiserver-operator-796bbdcf4f-wrm6s_549f81e1-d49f-472c-8422-be08ae158c08/openshift-apiserver-operator/0.log 2025-10-13 20:48:42.966456 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver_apiserver-76f77b778f-h75w4_c75022dd-f189-4787-8fec-66a0aa5892c3/ 2025-10-13 20:48:42.966472 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver_apiserver-76f77b778f-h75w4_c75022dd-f189-4787-8fec-66a0aa5892c3/fix-audit-permissions/ 2025-10-13 20:48:42.966488 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver_apiserver-76f77b778f-h75w4_c75022dd-f189-4787-8fec-66a0aa5892c3/fix-audit-permissions/0.log 2025-10-13 20:48:42.966503 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver_apiserver-76f77b778f-h75w4_c75022dd-f189-4787-8fec-66a0aa5892c3/openshift-apiserver-check-endpoints/ 2025-10-13 20:48:42.966519 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver_apiserver-76f77b778f-h75w4_c75022dd-f189-4787-8fec-66a0aa5892c3/openshift-apiserver-check-endpoints/0.log 2025-10-13 20:48:42.966534 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver_apiserver-76f77b778f-h75w4_c75022dd-f189-4787-8fec-66a0aa5892c3/openshift-apiserver/ 2025-10-13 20:48:42.966556 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-apiserver_apiserver-76f77b778f-h75w4_c75022dd-f189-4787-8fec-66a0aa5892c3/openshift-apiserver/0.log 2025-10-13 20:48:42.966572 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-authentication-operator_authentication-operator-69f744f599-wbldg_288edb09-33f1-4b80-87f5-8fddaa52238e/ 2025-10-13 20:48:42.966588 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-authentication-operator_authentication-operator-69f744f599-wbldg_288edb09-33f1-4b80-87f5-8fddaa52238e/authentication-operator/ 2025-10-13 20:48:42.966604 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-authentication-operator_authentication-operator-69f744f599-wbldg_288edb09-33f1-4b80-87f5-8fddaa52238e/authentication-operator/0.log 2025-10-13 20:48:42.966620 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-authentication_oauth-openshift-86bc4856f8-vz9db_bd357c76-ef51-45f2-a567-649f60eb3094/ 2025-10-13 20:48:42.966635 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-authentication_oauth-openshift-86bc4856f8-vz9db_bd357c76-ef51-45f2-a567-649f60eb3094/oauth-openshift/ 2025-10-13 20:48:42.966651 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-authentication_oauth-openshift-86bc4856f8-vz9db_bd357c76-ef51-45f2-a567-649f60eb3094/oauth-openshift/0.log 2025-10-13 20:48:42.966667 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-machine-approver_machine-approver-56656f9798-tlf8c_acdcea2e-96d2-4451-8bc7-767e1e5bdbb7/ 2025-10-13 20:48:42.966683 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-machine-approver_machine-approver-56656f9798-tlf8c_acdcea2e-96d2-4451-8bc7-767e1e5bdbb7/kube-rbac-proxy/ 2025-10-13 20:48:42.966699 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-machine-approver_machine-approver-56656f9798-tlf8c_acdcea2e-96d2-4451-8bc7-767e1e5bdbb7/kube-rbac-proxy/0.log 2025-10-13 20:48:42.966714 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-machine-approver_machine-approver-56656f9798-tlf8c_acdcea2e-96d2-4451-8bc7-767e1e5bdbb7/machine-approver-controller/ 2025-10-13 20:48:42.966747 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-machine-approver_machine-approver-56656f9798-tlf8c_acdcea2e-96d2-4451-8bc7-767e1e5bdbb7/machine-approver-controller/0.log 2025-10-13 20:48:42.966765 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-samples-operator_cluster-samples-operator-665b6dd947-jq5bg_70b6e9b4-1bff-4c0d-be60-d741efbf68d0/ 2025-10-13 20:48:42.966781 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-samples-operator_cluster-samples-operator-665b6dd947-jq5bg_70b6e9b4-1bff-4c0d-be60-d741efbf68d0/1eeb773824db351ccd521cb0cbb7afbb60495b1d8bd694b41364c0bbccc409b5.log 2025-10-13 20:48:42.966797 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-samples-operator_cluster-samples-operator-665b6dd947-jq5bg_70b6e9b4-1bff-4c0d-be60-d741efbf68d0/cluster-samples-operator-watch/ 2025-10-13 20:48:42.966813 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-samples-operator_cluster-samples-operator-665b6dd947-jq5bg_70b6e9b4-1bff-4c0d-be60-d741efbf68d0/cluster-samples-operator-watch/0.log 2025-10-13 20:48:42.966829 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-samples-operator_cluster-samples-operator-665b6dd947-jq5bg_70b6e9b4-1bff-4c0d-be60-d741efbf68d0/cluster-samples-operator/ 2025-10-13 20:48:42.966845 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-samples-operator_cluster-samples-operator-665b6dd947-jq5bg_70b6e9b4-1bff-4c0d-be60-d741efbf68d0/cluster-samples-operator/0.log 2025-10-13 20:48:42.966864 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-version_cluster-version-operator-5c965bbfc6-6lkhl_cfc9800d-9b12-4761-8c08-bca745611010/ 2025-10-13 20:48:42.966879 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-version_cluster-version-operator-5c965bbfc6-6lkhl_cfc9800d-9b12-4761-8c08-bca745611010/cluster-version-operator/ 2025-10-13 20:48:42.966895 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-cluster-version_cluster-version-operator-5c965bbfc6-6lkhl_cfc9800d-9b12-4761-8c08-bca745611010/cluster-version-operator/0.log.gz 2025-10-13 20:48:42.966910 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-config-operator_openshift-config-operator-7777fb866f-xjnmn_575a6f35-b0d2-4da1-9e30-4768b453198f/ 2025-10-13 20:48:42.966926 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-config-operator_openshift-config-operator-7777fb866f-xjnmn_575a6f35-b0d2-4da1-9e30-4768b453198f/openshift-api/ 2025-10-13 20:48:42.966942 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-config-operator_openshift-config-operator-7777fb866f-xjnmn_575a6f35-b0d2-4da1-9e30-4768b453198f/openshift-api/0.log 2025-10-13 20:48:42.966957 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-config-operator_openshift-config-operator-7777fb866f-xjnmn_575a6f35-b0d2-4da1-9e30-4768b453198f/openshift-config-operator/ 2025-10-13 20:48:42.966973 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-config-operator_openshift-config-operator-7777fb866f-xjnmn_575a6f35-b0d2-4da1-9e30-4768b453198f/openshift-config-operator/0.log 2025-10-13 20:48:42.966988 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console-operator_console-operator-58897d9998-44frm_158d7960-1e0f-455e-9cf4-f05a2fb8df87/ 2025-10-13 20:48:42.967004 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console-operator_console-operator-58897d9998-44frm_158d7960-1e0f-455e-9cf4-f05a2fb8df87/console-operator/ 2025-10-13 20:48:42.967019 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console-operator_console-operator-58897d9998-44frm_158d7960-1e0f-455e-9cf4-f05a2fb8df87/console-operator/0.log 2025-10-13 20:48:42.967035 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console_console-5b97df77c-9k5s8_5a103039-81d1-4f09-ba09-89702ab5c607/ 2025-10-13 20:48:42.967050 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console_console-5b97df77c-9k5s8_5a103039-81d1-4f09-ba09-89702ab5c607/console/ 2025-10-13 20:48:42.967066 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console_console-5b97df77c-9k5s8_5a103039-81d1-4f09-ba09-89702ab5c607/console/0.log 2025-10-13 20:48:42.967082 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console_downloads-7954f5f757-7cvtv_b78df0c7-6a25-4563-a369-a308c8501b2e/ 2025-10-13 20:48:42.967097 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console_downloads-7954f5f757-7cvtv_b78df0c7-6a25-4563-a369-a308c8501b2e/download-server/ 2025-10-13 20:48:42.967113 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-console_downloads-7954f5f757-7cvtv_b78df0c7-6a25-4563-a369-a308c8501b2e/download-server/0.log 2025-10-13 20:48:42.967128 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-756b6f6bc6-c4k8m_c313ce94-33ce-4633-b02b-1e0734198826/ 2025-10-13 20:48:42.967144 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-756b6f6bc6-c4k8m_c313ce94-33ce-4633-b02b-1e0734198826/openshift-controller-manager-operator/ 2025-10-13 20:48:42.967163 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-controller-manager-operator_openshift-controller-manager-operator-756b6f6bc6-c4k8m_c313ce94-33ce-4633-b02b-1e0734198826/openshift-controller-manager-operator/0.log 2025-10-13 20:48:42.967179 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-controller-manager_controller-manager-74f9b4f995-cpbkz_1470e471-24e6-45be-bf66-e05abbd2a7c8/ 2025-10-13 20:48:42.967195 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-controller-manager_controller-manager-74f9b4f995-cpbkz_1470e471-24e6-45be-bf66-e05abbd2a7c8/controller-manager/ 2025-10-13 20:48:42.967210 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-controller-manager_controller-manager-74f9b4f995-cpbkz_1470e471-24e6-45be-bf66-e05abbd2a7c8/controller-manager/0.log 2025-10-13 20:48:42.967226 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns-operator_dns-operator-744455d44c-txxmq_1d4df4c3-f903-4511-86b0-cf81c50df23b/ 2025-10-13 20:48:42.967241 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns-operator_dns-operator-744455d44c-txxmq_1d4df4c3-f903-4511-86b0-cf81c50df23b/dns-operator/ 2025-10-13 20:48:42.967256 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns-operator_dns-operator-744455d44c-txxmq_1d4df4c3-f903-4511-86b0-cf81c50df23b/dns-operator/0.log 2025-10-13 20:48:42.967271 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns-operator_dns-operator-744455d44c-txxmq_1d4df4c3-f903-4511-86b0-cf81c50df23b/kube-rbac-proxy/ 2025-10-13 20:48:42.967287 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns-operator_dns-operator-744455d44c-txxmq_1d4df4c3-f903-4511-86b0-cf81c50df23b/kube-rbac-proxy/0.log 2025-10-13 20:48:42.967302 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_dns-default-sbpgh_17ed86c6-653d-4d63-b71a-497eea81b50e/ 2025-10-13 20:48:42.967317 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_dns-default-sbpgh_17ed86c6-653d-4d63-b71a-497eea81b50e/dns/ 2025-10-13 20:48:42.967332 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_dns-default-sbpgh_17ed86c6-653d-4d63-b71a-497eea81b50e/dns/0.log 2025-10-13 20:48:42.967347 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_dns-default-sbpgh_17ed86c6-653d-4d63-b71a-497eea81b50e/kube-rbac-proxy/ 2025-10-13 20:48:42.967362 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_dns-default-sbpgh_17ed86c6-653d-4d63-b71a-497eea81b50e/kube-rbac-proxy/0.log 2025-10-13 20:48:42.967378 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_node-resolver-2gpk7_5406ae0b-f144-4f59-8434-528d03939d07/ 2025-10-13 20:48:42.967393 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_node-resolver-2gpk7_5406ae0b-f144-4f59-8434-528d03939d07/dns-node-resolver/ 2025-10-13 20:48:42.967408 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-dns_node-resolver-2gpk7_5406ae0b-f144-4f59-8434-528d03939d07/dns-node-resolver/0.log 2025-10-13 20:48:42.967423 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd-operator_etcd-operator-b45778765-2rb6d_980aada2-95cd-4e9d-aa08-9132b440cb82/ 2025-10-13 20:48:42.967439 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd-operator_etcd-operator-b45778765-2rb6d_980aada2-95cd-4e9d-aa08-9132b440cb82/etcd-operator/ 2025-10-13 20:48:42.967458 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd-operator_etcd-operator-b45778765-2rb6d_980aada2-95cd-4e9d-aa08-9132b440cb82/etcd-operator/0.log 2025-10-13 20:48:42.967474 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/ 2025-10-13 20:48:42.967492 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-ensure-env-vars/ 2025-10-13 20:48:42.967510 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-ensure-env-vars/0.log 2025-10-13 20:48:42.967526 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-metrics/ 2025-10-13 20:48:42.967542 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-metrics/0.log 2025-10-13 20:48:42.967586 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-readyz/ 2025-10-13 20:48:42.967605 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-readyz/0.log 2025-10-13 20:48:42.967621 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-resources-copy/ 2025-10-13 20:48:42.967637 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-resources-copy/0.log 2025-10-13 20:48:42.967652 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-rev/ 2025-10-13 20:48:42.967668 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd-rev/0.log 2025-10-13 20:48:42.967684 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd/ 2025-10-13 20:48:42.967699 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcd/0.log 2025-10-13 20:48:42.967716 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcdctl/ 2025-10-13 20:48:42.967746 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/etcdctl/0.log 2025-10-13 20:48:42.967764 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/setup/ 2025-10-13 20:48:42.967780 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-etcd_etcd-crc_2139d3e2895fc6797b9c76a1b4c9886d/setup/0.log 2025-10-13 20:48:42.967796 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_cluster-image-registry-operator-dc59b4c8b-tlhzg_660e9ddc-5073-4444-b2c8-55d05cbd6298/ 2025-10-13 20:48:42.967812 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_cluster-image-registry-operator-dc59b4c8b-tlhzg_660e9ddc-5073-4444-b2c8-55d05cbd6298/cluster-image-registry-operator/ 2025-10-13 20:48:42.967828 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_cluster-image-registry-operator-dc59b4c8b-tlhzg_660e9ddc-5073-4444-b2c8-55d05cbd6298/cluster-image-registry-operator/0.log 2025-10-13 20:48:42.967844 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_image-registry-66df7c8f76-2rdsh_e3d9c986-3576-417c-b525-557f85933752/ 2025-10-13 20:48:42.967863 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_image-registry-66df7c8f76-2rdsh_e3d9c986-3576-417c-b525-557f85933752/registry/ 2025-10-13 20:48:42.967879 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_image-registry-66df7c8f76-2rdsh_e3d9c986-3576-417c-b525-557f85933752/registry/0.log 2025-10-13 20:48:42.967895 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_node-ca-7k44s_8f478ec9-5afe-4dea-a6d7-926d0d50885b/ 2025-10-13 20:48:42.967912 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_node-ca-7k44s_8f478ec9-5afe-4dea-a6d7-926d0d50885b/node-ca/ 2025-10-13 20:48:42.967928 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-image-registry_node-ca-7k44s_8f478ec9-5afe-4dea-a6d7-926d0d50885b/node-ca/0.log 2025-10-13 20:48:42.967945 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-canary_ingress-canary-wzpgp_59d22b7f-e046-4df6-bf30-342ec1717b04/ 2025-10-13 20:48:42.967961 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-canary_ingress-canary-wzpgp_59d22b7f-e046-4df6-bf30-342ec1717b04/serve-healthcheck-canary/ 2025-10-13 20:48:42.967977 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-canary_ingress-canary-wzpgp_59d22b7f-e046-4df6-bf30-342ec1717b04/serve-healthcheck-canary/0.log 2025-10-13 20:48:42.967993 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-operator_ingress-operator-5b745b69d9-l7kq4_d6698fbf-40c8-4e4f-917f-d3b4f8c69a62/ 2025-10-13 20:48:42.968009 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-operator_ingress-operator-5b745b69d9-l7kq4_d6698fbf-40c8-4e4f-917f-d3b4f8c69a62/ingress-operator/ 2025-10-13 20:48:42.968025 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-operator_ingress-operator-5b745b69d9-l7kq4_d6698fbf-40c8-4e4f-917f-d3b4f8c69a62/ingress-operator/0.log 2025-10-13 20:48:42.968042 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-operator_ingress-operator-5b745b69d9-l7kq4_d6698fbf-40c8-4e4f-917f-d3b4f8c69a62/kube-rbac-proxy/ 2025-10-13 20:48:42.968058 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress-operator_ingress-operator-5b745b69d9-l7kq4_d6698fbf-40c8-4e4f-917f-d3b4f8c69a62/kube-rbac-proxy/0.log 2025-10-13 20:48:42.968075 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress_router-default-5444994796-8zqqx_9653422e-7388-4c96-af66-8cacce857e9c/ 2025-10-13 20:48:42.968091 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress_router-default-5444994796-8zqqx_9653422e-7388-4c96-af66-8cacce857e9c/router/ 2025-10-13 20:48:42.968107 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ingress_router-default-5444994796-8zqqx_9653422e-7388-4c96-af66-8cacce857e9c/router/0.log 2025-10-13 20:48:42.968123 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-766d6c64bb-bshp5_c41f455f-ca5f-4275-bf19-7724ae2f7d46/ 2025-10-13 20:48:42.968139 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-766d6c64bb-bshp5_c41f455f-ca5f-4275-bf19-7724ae2f7d46/kube-apiserver-operator/ 2025-10-13 20:48:42.968156 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver-operator_kube-apiserver-operator-766d6c64bb-bshp5_c41f455f-ca5f-4275-bf19-7724ae2f7d46/kube-apiserver-operator/0.log 2025-10-13 20:48:42.968172 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/ 2025-10-13 20:48:42.968191 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-cert-regeneration-controller/ 2025-10-13 20:48:42.968208 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-cert-regeneration-controller/0.log 2025-10-13 20:48:42.968224 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-cert-syncer/ 2025-10-13 20:48:42.968241 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-cert-syncer/0.log 2025-10-13 20:48:42.968257 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/ 2025-10-13 20:48:42.968273 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/0.log 2025-10-13 20:48:42.968289 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-check-endpoints/1.log 2025-10-13 20:48:42.968305 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-insecure-readyz/ 2025-10-13 20:48:42.968322 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver-insecure-readyz/0.log 2025-10-13 20:48:42.968337 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver/ 2025-10-13 20:48:42.968354 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/kube-apiserver/0.log.gz 2025-10-13 20:48:42.968370 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/setup/ 2025-10-13 20:48:42.968386 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_kube-apiserver-crc_f4b27818a5e8e43d0dc095d08835c792/setup/0.log 2025-10-13 20:48:42.968402 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_revision-pruner-8-crc_582bb0b7-6d3b-4803-8288-14f987cb875e/ 2025-10-13 20:48:42.968418 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_revision-pruner-8-crc_582bb0b7-6d3b-4803-8288-14f987cb875e/pruner/ 2025-10-13 20:48:42.968434 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-apiserver_revision-pruner-8-crc_582bb0b7-6d3b-4803-8288-14f987cb875e/pruner/0.log 2025-10-13 20:48:42.968450 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-78b949d7b-99f6g_8d4dbbf3-eb97-47ac-b89a-9539caa47381/ 2025-10-13 20:48:42.968468 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-78b949d7b-99f6g_8d4dbbf3-eb97-47ac-b89a-9539caa47381/kube-controller-manager-operator/ 2025-10-13 20:48:42.968487 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager-operator_kube-controller-manager-operator-78b949d7b-99f6g_8d4dbbf3-eb97-47ac-b89a-9539caa47381/kube-controller-manager-operator/0.log 2025-10-13 20:48:42.968508 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/ 2025-10-13 20:48:42.968524 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/cluster-policy-controller/ 2025-10-13 20:48:42.968541 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/cluster-policy-controller/0.log 2025-10-13 20:48:42.968557 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/kube-controller-manager-cert-syncer/ 2025-10-13 20:48:42.968572 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/kube-controller-manager-cert-syncer/0.log 2025-10-13 20:48:42.968588 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/kube-controller-manager-recovery-controller/ 2025-10-13 20:48:42.968605 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/kube-controller-manager-recovery-controller/0.log 2025-10-13 20:48:42.968621 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/kube-controller-manager/ 2025-10-13 20:48:42.968637 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_kube-controller-manager-crc_f614b9022728cf315e60c057852e563e/kube-controller-manager/0.log.gz 2025-10-13 20:48:42.968654 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_revision-pruner-9-crc_cffaad74-ee35-472d-8749-55452b415034/ 2025-10-13 20:48:42.968671 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_revision-pruner-9-crc_cffaad74-ee35-472d-8749-55452b415034/pruner/ 2025-10-13 20:48:42.968688 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-controller-manager_revision-pruner-9-crc_cffaad74-ee35-472d-8749-55452b415034/pruner/0.log 2025-10-13 20:48:42.968704 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5fdd9b5758-bcjgg_4df248fb-3448-4237-8b0f-99fcca5cdb5e/ 2025-10-13 20:48:42.968721 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5fdd9b5758-bcjgg_4df248fb-3448-4237-8b0f-99fcca5cdb5e/kube-scheduler-operator-container/ 2025-10-13 20:48:42.968765 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler-operator_openshift-kube-scheduler-operator-5fdd9b5758-bcjgg_4df248fb-3448-4237-8b0f-99fcca5cdb5e/kube-scheduler-operator-container/0.log 2025-10-13 20:48:42.968783 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/ 2025-10-13 20:48:42.968799 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/kube-scheduler-cert-syncer/ 2025-10-13 20:48:42.968815 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/kube-scheduler-cert-syncer/0.log 2025-10-13 20:48:42.968836 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/kube-scheduler-recovery-controller/ 2025-10-13 20:48:42.968852 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/kube-scheduler-recovery-controller/0.log 2025-10-13 20:48:42.968868 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/kube-scheduler/ 2025-10-13 20:48:42.968885 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/kube-scheduler/0.log 2025-10-13 20:48:42.968902 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/wait-for-host-port/ 2025-10-13 20:48:42.968918 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-scheduler_openshift-kube-scheduler-crc_3dcd261975c3d6b9a6ad6367fd4facd3/wait-for-host-port/0.log 2025-10-13 20:48:42.968934 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b67b599dd-tmbgk_7653609a-4fb5-45ab-a83f-a1bdd4e83c5b/ 2025-10-13 20:48:42.968951 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b67b599dd-tmbgk_7653609a-4fb5-45ab-a83f-a1bdd4e83c5b/kube-storage-version-migrator-operator/ 2025-10-13 20:48:42.968968 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-b67b599dd-tmbgk_7653609a-4fb5-45ab-a83f-a1bdd4e83c5b/kube-storage-version-migrator-operator/0.log 2025-10-13 20:48:42.968985 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator_migrator-59844c95c7-bd9mk_6996e982-f58a-44fd-a69a-8bacd18264b4/ 2025-10-13 20:48:42.969001 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator_migrator-59844c95c7-bd9mk_6996e982-f58a-44fd-a69a-8bacd18264b4/graceful-termination/ 2025-10-13 20:48:42.969018 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator_migrator-59844c95c7-bd9mk_6996e982-f58a-44fd-a69a-8bacd18264b4/graceful-termination/0.log 2025-10-13 20:48:42.969049 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator_migrator-59844c95c7-bd9mk_6996e982-f58a-44fd-a69a-8bacd18264b4/migrator/ 2025-10-13 20:48:42.969072 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-kube-storage-version-migrator_migrator-59844c95c7-bd9mk_6996e982-f58a-44fd-a69a-8bacd18264b4/migrator/0.log 2025-10-13 20:48:42.969092 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_control-plane-machine-set-operator-78cbb6b69f-zqxbw_4454a33f-a128-4a7e-93f8-67e0fd2637d2/ 2025-10-13 20:48:42.969111 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_control-plane-machine-set-operator-78cbb6b69f-zqxbw_4454a33f-a128-4a7e-93f8-67e0fd2637d2/control-plane-machine-set-operator/ 2025-10-13 20:48:42.969130 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_control-plane-machine-set-operator-78cbb6b69f-zqxbw_4454a33f-a128-4a7e-93f8-67e0fd2637d2/control-plane-machine-set-operator/0.log 2025-10-13 20:48:42.969153 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_machine-api-operator-5694c8668f-zggdj_60409147-d822-4d03-8bab-3483750f37fe/ 2025-10-13 20:48:42.969172 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_machine-api-operator-5694c8668f-zggdj_60409147-d822-4d03-8bab-3483750f37fe/kube-rbac-proxy/ 2025-10-13 20:48:42.969191 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_machine-api-operator-5694c8668f-zggdj_60409147-d822-4d03-8bab-3483750f37fe/kube-rbac-proxy/0.log 2025-10-13 20:48:42.969210 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_machine-api-operator-5694c8668f-zggdj_60409147-d822-4d03-8bab-3483750f37fe/machine-api-operator/ 2025-10-13 20:48:42.969228 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-api_machine-api-operator-5694c8668f-zggdj_60409147-d822-4d03-8bab-3483750f37fe/machine-api-operator/0.log 2025-10-13 20:48:42.969247 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-crc_d1b160f5dda77d281dd8e69ec8d817f9/ 2025-10-13 20:48:42.969266 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-crc_d1b160f5dda77d281dd8e69ec8d817f9/kube-rbac-proxy-crio/ 2025-10-13 20:48:42.969285 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-crc_d1b160f5dda77d281dd8e69ec8d817f9/kube-rbac-proxy-crio/0.log 2025-10-13 20:48:42.969303 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-crc_d1b160f5dda77d281dd8e69ec8d817f9/setup/ 2025-10-13 20:48:42.969320 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-crc_d1b160f5dda77d281dd8e69ec8d817f9/setup/0.log 2025-10-13 20:48:42.969336 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-controller-84d6567774-qlblm_4c751e5a-c993-43f1-b41c-509b6dac0cef/ 2025-10-13 20:48:42.969353 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-controller-84d6567774-qlblm_4c751e5a-c993-43f1-b41c-509b6dac0cef/kube-rbac-proxy/ 2025-10-13 20:48:42.969372 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-controller-84d6567774-qlblm_4c751e5a-c993-43f1-b41c-509b6dac0cef/kube-rbac-proxy/0.log 2025-10-13 20:48:42.969396 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-controller-84d6567774-qlblm_4c751e5a-c993-43f1-b41c-509b6dac0cef/machine-config-controller/ 2025-10-13 20:48:42.969421 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-controller-84d6567774-qlblm_4c751e5a-c993-43f1-b41c-509b6dac0cef/machine-config-controller/0.log 2025-10-13 20:48:42.969440 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-daemon-jlhbw_649e112b-91aa-47f8-b5c4-ede8244a225e/ 2025-10-13 20:48:42.969457 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-daemon-jlhbw_649e112b-91aa-47f8-b5c4-ede8244a225e/kube-rbac-proxy/ 2025-10-13 20:48:42.969474 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-daemon-jlhbw_649e112b-91aa-47f8-b5c4-ede8244a225e/kube-rbac-proxy/0.log 2025-10-13 20:48:42.969490 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-daemon-jlhbw_649e112b-91aa-47f8-b5c4-ede8244a225e/machine-config-daemon/ 2025-10-13 20:48:42.969511 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-daemon-jlhbw_649e112b-91aa-47f8-b5c4-ede8244a225e/machine-config-daemon/16.log 2025-10-13 20:48:42.969527 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-daemon-jlhbw_649e112b-91aa-47f8-b5c4-ede8244a225e/machine-config-daemon/17.log 2025-10-13 20:48:42.969544 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-operator-74547568cd-ktq5j_f9af0297-5523-4b1d-9724-c3453cc60b8e/ 2025-10-13 20:48:42.969560 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-operator-74547568cd-ktq5j_f9af0297-5523-4b1d-9724-c3453cc60b8e/kube-rbac-proxy/ 2025-10-13 20:48:42.969576 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-operator-74547568cd-ktq5j_f9af0297-5523-4b1d-9724-c3453cc60b8e/kube-rbac-proxy/0.log 2025-10-13 20:48:42.969593 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-operator-74547568cd-ktq5j_f9af0297-5523-4b1d-9724-c3453cc60b8e/machine-config-operator/ 2025-10-13 20:48:42.969609 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-operator-74547568cd-ktq5j_f9af0297-5523-4b1d-9724-c3453cc60b8e/machine-config-operator/0.log 2025-10-13 20:48:42.969625 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-server-w8fc5_616529e7-4f65-46e7-857e-53d9e9123b11/ 2025-10-13 20:48:42.969641 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-server-w8fc5_616529e7-4f65-46e7-857e-53d9e9123b11/machine-config-server/ 2025-10-13 20:48:42.969657 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-machine-config-operator_machine-config-server-w8fc5_616529e7-4f65-46e7-857e-53d9e9123b11/machine-config-server/0.log 2025-10-13 20:48:42.969673 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8_e84c1823-4d84-490c-820d-63f3c02fff78/ 2025-10-13 20:48:42.969688 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8_e84c1823-4d84-490c-820d-63f3c02fff78/extract/ 2025-10-13 20:48:42.969704 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8_e84c1823-4d84-490c-820d-63f3c02fff78/extract/0.log 2025-10-13 20:48:42.969720 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8_e84c1823-4d84-490c-820d-63f3c02fff78/pull/ 2025-10-13 20:48:42.969756 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8_e84c1823-4d84-490c-820d-63f3c02fff78/pull/0.log 2025-10-13 20:48:42.969774 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8_e84c1823-4d84-490c-820d-63f3c02fff78/util/ 2025-10-13 20:48:42.969790 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8_e84c1823-4d84-490c-820d-63f3c02fff78/util/0.log 2025-10-13 20:48:42.969810 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf_0245a3a5-c4bb-4939-b8a6-cae09cbbc955/ 2025-10-13 20:48:42.969827 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf_0245a3a5-c4bb-4939-b8a6-cae09cbbc955/extract/ 2025-10-13 20:48:42.969843 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf_0245a3a5-c4bb-4939-b8a6-cae09cbbc955/extract/0.log 2025-10-13 20:48:42.969859 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf_0245a3a5-c4bb-4939-b8a6-cae09cbbc955/pull/ 2025-10-13 20:48:42.969876 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf_0245a3a5-c4bb-4939-b8a6-cae09cbbc955/pull/0.log 2025-10-13 20:48:42.969892 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf_0245a3a5-c4bb-4939-b8a6-cae09cbbc955/util/ 2025-10-13 20:48:42.969909 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf_0245a3a5-c4bb-4939-b8a6-cae09cbbc955/util/0.log 2025-10-13 20:48:42.969925 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh_5cb4d319-fa56-41ad-8aab-005ef81f8f2c/ 2025-10-13 20:48:42.969941 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh_5cb4d319-fa56-41ad-8aab-005ef81f8f2c/extract/ 2025-10-13 20:48:42.969957 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh_5cb4d319-fa56-41ad-8aab-005ef81f8f2c/extract/0.log 2025-10-13 20:48:42.969974 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh_5cb4d319-fa56-41ad-8aab-005ef81f8f2c/pull/ 2025-10-13 20:48:42.969990 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh_5cb4d319-fa56-41ad-8aab-005ef81f8f2c/pull/0.log 2025-10-13 20:48:42.970006 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh_5cb4d319-fa56-41ad-8aab-005ef81f8f2c/util/ 2025-10-13 20:48:42.970023 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh_5cb4d319-fa56-41ad-8aab-005ef81f8f2c/util/0.log 2025-10-13 20:48:42.970039 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_certified-operators-fs4s6_2e19c5d8-ae9f-4f84-ac58-3fe9d31f0abf/ 2025-10-13 20:48:42.970055 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_certified-operators-fs4s6_2e19c5d8-ae9f-4f84-ac58-3fe9d31f0abf/extract-content/ 2025-10-13 20:48:42.970072 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_certified-operators-fs4s6_2e19c5d8-ae9f-4f84-ac58-3fe9d31f0abf/extract-content/0.log 2025-10-13 20:48:42.970088 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_certified-operators-fs4s6_2e19c5d8-ae9f-4f84-ac58-3fe9d31f0abf/extract-utilities/ 2025-10-13 20:48:42.970108 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_certified-operators-fs4s6_2e19c5d8-ae9f-4f84-ac58-3fe9d31f0abf/extract-utilities/0.log 2025-10-13 20:48:42.970125 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_certified-operators-fs4s6_2e19c5d8-ae9f-4f84-ac58-3fe9d31f0abf/registry-server/ 2025-10-13 20:48:42.970141 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_certified-operators-fs4s6_2e19c5d8-ae9f-4f84-ac58-3fe9d31f0abf/registry-server/0.log 2025-10-13 20:48:42.970158 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_community-operators-ppgz7_30f7c5f9-9892-4ced-9a40-128c0fba5eca/ 2025-10-13 20:48:42.970175 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_community-operators-ppgz7_30f7c5f9-9892-4ced-9a40-128c0fba5eca/extract-content/ 2025-10-13 20:48:42.970191 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_community-operators-ppgz7_30f7c5f9-9892-4ced-9a40-128c0fba5eca/extract-content/0.log 2025-10-13 20:48:42.970207 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_community-operators-ppgz7_30f7c5f9-9892-4ced-9a40-128c0fba5eca/extract-utilities/ 2025-10-13 20:48:42.970223 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_community-operators-ppgz7_30f7c5f9-9892-4ced-9a40-128c0fba5eca/extract-utilities/0.log 2025-10-13 20:48:42.970239 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_community-operators-ppgz7_30f7c5f9-9892-4ced-9a40-128c0fba5eca/registry-server/ 2025-10-13 20:48:42.970255 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_community-operators-ppgz7_30f7c5f9-9892-4ced-9a40-128c0fba5eca/registry-server/0.log.gz 2025-10-13 20:48:42.970271 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4_81b8e3a7-5193-4c13-b800-41decef4696b/ 2025-10-13 20:48:42.970287 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4_81b8e3a7-5193-4c13-b800-41decef4696b/extract/ 2025-10-13 20:48:42.970303 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4_81b8e3a7-5193-4c13-b800-41decef4696b/extract/0.log 2025-10-13 20:48:42.970320 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4_81b8e3a7-5193-4c13-b800-41decef4696b/pull/ 2025-10-13 20:48:42.970336 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4_81b8e3a7-5193-4c13-b800-41decef4696b/pull/0.log 2025-10-13 20:48:42.970352 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4_81b8e3a7-5193-4c13-b800-41decef4696b/util/ 2025-10-13 20:48:42.970368 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4_81b8e3a7-5193-4c13-b800-41decef4696b/util/0.log 2025-10-13 20:48:42.970384 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_marketplace-operator-79b997595-mxlh6_aad228f5-22f9-41ee-9ff0-157fd28e3eba/ 2025-10-13 20:48:42.970401 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_marketplace-operator-79b997595-mxlh6_aad228f5-22f9-41ee-9ff0-157fd28e3eba/marketplace-operator/ 2025-10-13 20:48:42.970420 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_marketplace-operator-79b997595-mxlh6_aad228f5-22f9-41ee-9ff0-157fd28e3eba/marketplace-operator/0.log 2025-10-13 20:48:42.970437 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-marketplace-xr5dg_ada38ab2-39d4-422c-8c63-6523c03d6d71/ 2025-10-13 20:48:42.970453 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-marketplace-xr5dg_ada38ab2-39d4-422c-8c63-6523c03d6d71/extract-content/ 2025-10-13 20:48:42.970470 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-marketplace-xr5dg_ada38ab2-39d4-422c-8c63-6523c03d6d71/extract-content/0.log 2025-10-13 20:48:42.970487 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-marketplace-xr5dg_ada38ab2-39d4-422c-8c63-6523c03d6d71/extract-utilities/ 2025-10-13 20:48:42.970503 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-marketplace-xr5dg_ada38ab2-39d4-422c-8c63-6523c03d6d71/extract-utilities/0.log 2025-10-13 20:48:42.970519 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-marketplace-xr5dg_ada38ab2-39d4-422c-8c63-6523c03d6d71/registry-server/ 2025-10-13 20:48:42.970536 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-marketplace-xr5dg_ada38ab2-39d4-422c-8c63-6523c03d6d71/registry-server/0.log.gz 2025-10-13 20:48:42.970552 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-operators-pdzb2_e905b4ac-1710-44b4-abdd-a3e8a858f3e5/ 2025-10-13 20:48:42.970569 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-operators-pdzb2_e905b4ac-1710-44b4-abdd-a3e8a858f3e5/extract-content/ 2025-10-13 20:48:42.970585 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-operators-pdzb2_e905b4ac-1710-44b4-abdd-a3e8a858f3e5/extract-content/0.log 2025-10-13 20:48:42.970601 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-operators-pdzb2_e905b4ac-1710-44b4-abdd-a3e8a858f3e5/extract-utilities/ 2025-10-13 20:48:42.970618 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-operators-pdzb2_e905b4ac-1710-44b4-abdd-a3e8a858f3e5/extract-utilities/0.log 2025-10-13 20:48:42.970634 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-operators-pdzb2_e905b4ac-1710-44b4-abdd-a3e8a858f3e5/registry-server/ 2025-10-13 20:48:42.970650 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-marketplace_redhat-operators-pdzb2_e905b4ac-1710-44b4-abdd-a3e8a858f3e5/registry-server/0.log.gz 2025-10-13 20:48:42.970666 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/ 2025-10-13 20:48:42.970683 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/bond-cni-plugin/ 2025-10-13 20:48:42.970699 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/bond-cni-plugin/0.log 2025-10-13 20:48:42.970715 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/cni-plugins/ 2025-10-13 20:48:42.970751 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/cni-plugins/0.log 2025-10-13 20:48:42.970798 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/egress-router-binary-copy/ 2025-10-13 20:48:42.970816 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/egress-router-binary-copy/0.log 2025-10-13 20:48:42.970833 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/kube-multus-additional-cni-plugins/ 2025-10-13 20:48:42.970849 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/kube-multus-additional-cni-plugins/0.log 2025-10-13 20:48:42.970866 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/routeoverride-cni/ 2025-10-13 20:48:42.970882 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/routeoverride-cni/0.log 2025-10-13 20:48:42.970898 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/whereabouts-cni-bincopy/ 2025-10-13 20:48:42.970914 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/whereabouts-cni-bincopy/0.log 2025-10-13 20:48:42.970930 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/whereabouts-cni/ 2025-10-13 20:48:42.970946 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-additional-cni-plugins-cwxl8_777d80ba-0831-4a22-b172-25907f40ef3a/whereabouts-cni/0.log 2025-10-13 20:48:42.970962 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-admission-controller-857f4d67dd-7hjd4_f083919e-ab55-4f7f-8a26-47a4e6ac825d/ 2025-10-13 20:48:42.970978 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-admission-controller-857f4d67dd-7hjd4_f083919e-ab55-4f7f-8a26-47a4e6ac825d/kube-rbac-proxy/ 2025-10-13 20:48:42.970994 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-admission-controller-857f4d67dd-7hjd4_f083919e-ab55-4f7f-8a26-47a4e6ac825d/kube-rbac-proxy/0.log 2025-10-13 20:48:42.971010 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-admission-controller-857f4d67dd-7hjd4_f083919e-ab55-4f7f-8a26-47a4e6ac825d/multus-admission-controller/ 2025-10-13 20:48:42.971026 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-admission-controller-857f4d67dd-7hjd4_f083919e-ab55-4f7f-8a26-47a4e6ac825d/multus-admission-controller/0.log 2025-10-13 20:48:42.971042 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-g6bs4_fc69a833-5433-49b2-8268-84840b3a1522/ 2025-10-13 20:48:42.971059 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-g6bs4_fc69a833-5433-49b2-8268-84840b3a1522/kube-multus/ 2025-10-13 20:48:42.971076 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-g6bs4_fc69a833-5433-49b2-8268-84840b3a1522/kube-multus/2.log 2025-10-13 20:48:42.971096 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_multus-g6bs4_fc69a833-5433-49b2-8268-84840b3a1522/kube-multus/3.log.gz 2025-10-13 20:48:42.971113 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_network-metrics-daemon-mvzcq_78e133d5-a382-4321-b3b9-50fefb264636/ 2025-10-13 20:48:42.971129 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_network-metrics-daemon-mvzcq_78e133d5-a382-4321-b3b9-50fefb264636/kube-rbac-proxy/ 2025-10-13 20:48:42.971146 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_network-metrics-daemon-mvzcq_78e133d5-a382-4321-b3b9-50fefb264636/kube-rbac-proxy/0.log 2025-10-13 20:48:42.971162 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_network-metrics-daemon-mvzcq_78e133d5-a382-4321-b3b9-50fefb264636/network-metrics-daemon/ 2025-10-13 20:48:42.971179 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-multus_network-metrics-daemon-mvzcq_78e133d5-a382-4321-b3b9-50fefb264636/network-metrics-daemon/0.log 2025-10-13 20:48:42.971195 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-console_networking-console-plugin-85b44fc459-gdk6g_5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/ 2025-10-13 20:48:42.971211 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-console_networking-console-plugin-85b44fc459-gdk6g_5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/networking-console-plugin/ 2025-10-13 20:48:42.971545 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-console_networking-console-plugin-85b44fc459-gdk6g_5fe485a1-e14f-4c09-b5b9-f252bc42b7e8/networking-console-plugin/0.log 2025-10-13 20:48:42.971565 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-diagnostics_network-check-source-55646444c4-trplf_9d751cbb-f2e2-430d-9754-c882a5e924a5/ 2025-10-13 20:48:42.971583 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-diagnostics_network-check-source-55646444c4-trplf_9d751cbb-f2e2-430d-9754-c882a5e924a5/check-endpoints/ 2025-10-13 20:48:42.971599 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-diagnostics_network-check-source-55646444c4-trplf_9d751cbb-f2e2-430d-9754-c882a5e924a5/check-endpoints/0.log 2025-10-13 20:48:42.971615 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-diagnostics_network-check-target-xd92c_3b6479f0-333b-4a96-9adf-2099afdc2447/ 2025-10-13 20:48:42.971632 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-diagnostics_network-check-target-xd92c_3b6479f0-333b-4a96-9adf-2099afdc2447/network-check-target-container/ 2025-10-13 20:48:42.971648 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-diagnostics_network-check-target-xd92c_3b6479f0-333b-4a96-9adf-2099afdc2447/network-check-target-container/0.log 2025-10-13 20:48:42.971664 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-node-identity_network-node-identity-vrzqb_ef543e1b-8068-4ea3-b32a-61027b32e95d/ 2025-10-13 20:48:42.971680 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-node-identity_network-node-identity-vrzqb_ef543e1b-8068-4ea3-b32a-61027b32e95d/approver/ 2025-10-13 20:48:42.971697 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-node-identity_network-node-identity-vrzqb_ef543e1b-8068-4ea3-b32a-61027b32e95d/approver/0.log 2025-10-13 20:48:42.971713 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-node-identity_network-node-identity-vrzqb_ef543e1b-8068-4ea3-b32a-61027b32e95d/webhook/ 2025-10-13 20:48:42.971755 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-node-identity_network-node-identity-vrzqb_ef543e1b-8068-4ea3-b32a-61027b32e95d/webhook/0.log 2025-10-13 20:48:42.971773 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-operator_iptables-alerter-4ln5h_d75a4c96-2883-4a0b-bab2-0fab2b6c0b49/ 2025-10-13 20:48:42.971790 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-operator_iptables-alerter-4ln5h_d75a4c96-2883-4a0b-bab2-0fab2b6c0b49/iptables-alerter/ 2025-10-13 20:48:42.971805 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-operator_iptables-alerter-4ln5h_d75a4c96-2883-4a0b-bab2-0fab2b6c0b49/iptables-alerter/0.log 2025-10-13 20:48:42.971821 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-operator_network-operator-58b4c7f79c-55gtf_37a5e44f-9a88-4405-be8a-b645485e7312/ 2025-10-13 20:48:42.971837 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-operator_network-operator-58b4c7f79c-55gtf_37a5e44f-9a88-4405-be8a-b645485e7312/network-operator/ 2025-10-13 20:48:42.971853 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-network-operator_network-operator-58b4c7f79c-55gtf_37a5e44f-9a88-4405-be8a-b645485e7312/network-operator/0.log 2025-10-13 20:48:42.971868 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-console-plugin-6b874cbd85-mxxgp_0ba282a0-1dc7-4a04-ac9e-82418d430c2c/ 2025-10-13 20:48:42.971884 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-console-plugin-6b874cbd85-mxxgp_0ba282a0-1dc7-4a04-ac9e-82418d430c2c/nmstate-console-plugin/ 2025-10-13 20:48:42.971900 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-console-plugin-6b874cbd85-mxxgp_0ba282a0-1dc7-4a04-ac9e-82418d430c2c/nmstate-console-plugin/0.log 2025-10-13 20:48:42.971915 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-handler-bdw24_6c078e85-bd26-4611-ad2a-62485ca3c826/ 2025-10-13 20:48:42.971931 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-handler-bdw24_6c078e85-bd26-4611-ad2a-62485ca3c826/nmstate-handler/ 2025-10-13 20:48:42.971946 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-handler-bdw24_6c078e85-bd26-4611-ad2a-62485ca3c826/nmstate-handler/0.log 2025-10-13 20:48:42.971961 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-metrics-fdff9cb8d-2dk9z_9af4fbdb-1b5d-44f0-9404-2ecd09c82e21/ 2025-10-13 20:48:42.971977 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-metrics-fdff9cb8d-2dk9z_9af4fbdb-1b5d-44f0-9404-2ecd09c82e21/kube-rbac-proxy/ 2025-10-13 20:48:42.971993 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-metrics-fdff9cb8d-2dk9z_9af4fbdb-1b5d-44f0-9404-2ecd09c82e21/kube-rbac-proxy/0.log 2025-10-13 20:48:42.972008 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-metrics-fdff9cb8d-2dk9z_9af4fbdb-1b5d-44f0-9404-2ecd09c82e21/nmstate-metrics/ 2025-10-13 20:48:42.972024 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-metrics-fdff9cb8d-2dk9z_9af4fbdb-1b5d-44f0-9404-2ecd09c82e21/nmstate-metrics/0.log 2025-10-13 20:48:42.972039 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-operator-858ddd8f98-px675_74ecf4e8-ad1e-4a68-9289-7a1eeba711bb/ 2025-10-13 20:48:42.972055 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-operator-858ddd8f98-px675_74ecf4e8-ad1e-4a68-9289-7a1eeba711bb/nmstate-operator/ 2025-10-13 20:48:42.972073 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-operator-858ddd8f98-px675_74ecf4e8-ad1e-4a68-9289-7a1eeba711bb/nmstate-operator/0.log 2025-10-13 20:48:42.972089 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-webhook-6cdbc54649-vlxwz_2739440e-660e-443b-b7a9-f523145b5c86/ 2025-10-13 20:48:42.972104 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-webhook-6cdbc54649-vlxwz_2739440e-660e-443b-b7a9-f523145b5c86/nmstate-webhook/ 2025-10-13 20:48:42.972119 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-nmstate_nmstate-webhook-6cdbc54649-vlxwz_2739440e-660e-443b-b7a9-f523145b5c86/nmstate-webhook/0.log 2025-10-13 20:48:42.972134 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-oauth-apiserver_apiserver-7bbb656c7d-svdbt_57f145b9-cec5-4344-8163-6f9289e40307/ 2025-10-13 20:48:42.972149 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-oauth-apiserver_apiserver-7bbb656c7d-svdbt_57f145b9-cec5-4344-8163-6f9289e40307/fix-audit-permissions/ 2025-10-13 20:48:42.972164 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-oauth-apiserver_apiserver-7bbb656c7d-svdbt_57f145b9-cec5-4344-8163-6f9289e40307/fix-audit-permissions/0.log 2025-10-13 20:48:42.972179 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-oauth-apiserver_apiserver-7bbb656c7d-svdbt_57f145b9-cec5-4344-8163-6f9289e40307/oauth-apiserver/ 2025-10-13 20:48:42.972195 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-oauth-apiserver_apiserver-7bbb656c7d-svdbt_57f145b9-cec5-4344-8163-6f9289e40307/oauth-apiserver/0.log 2025-10-13 20:48:42.972210 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_catalog-operator-68c6474976-gnhqs_a90a8008-13aa-489c-a60d-70c5ed9d2b1f/ 2025-10-13 20:48:42.972225 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_catalog-operator-68c6474976-gnhqs_a90a8008-13aa-489c-a60d-70c5ed9d2b1f/catalog-operator/ 2025-10-13 20:48:42.972241 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_catalog-operator-68c6474976-gnhqs_a90a8008-13aa-489c-a60d-70c5ed9d2b1f/catalog-operator/0.log.gz 2025-10-13 20:48:42.972256 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339775-qsm5v_0f68a2c8-7204-4e15-a0ff-319d2b050af8/ 2025-10-13 20:48:42.972272 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339775-qsm5v_0f68a2c8-7204-4e15-a0ff-319d2b050af8/collect-profiles/ 2025-10-13 20:48:42.972288 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339775-qsm5v_0f68a2c8-7204-4e15-a0ff-319d2b050af8/collect-profiles/0.log 2025-10-13 20:48:42.972303 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339790-czq8z_ac1c70cc-d692-4b40-a2b6-362bf526afa7/ 2025-10-13 20:48:42.972319 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339790-czq8z_ac1c70cc-d692-4b40-a2b6-362bf526afa7/collect-profiles/ 2025-10-13 20:48:42.972334 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339790-czq8z_ac1c70cc-d692-4b40-a2b6-362bf526afa7/collect-profiles/0.log 2025-10-13 20:48:42.972350 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339805-w5dbg_6c932cfb-a481-4d23-98d2-98f42c4a49da/ 2025-10-13 20:48:42.972371 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339805-w5dbg_6c932cfb-a481-4d23-98d2-98f42c4a49da/collect-profiles/ 2025-10-13 20:48:42.972387 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_collect-profiles-29339805-w5dbg_6c932cfb-a481-4d23-98d2-98f42c4a49da/collect-profiles/0.log 2025-10-13 20:48:42.972403 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_olm-operator-6b444d44fb-mb5b9_5913a68d-4e86-4c20-b87b-685cb1f91641/ 2025-10-13 20:48:42.972418 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_olm-operator-6b444d44fb-mb5b9_5913a68d-4e86-4c20-b87b-685cb1f91641/olm-operator/ 2025-10-13 20:48:42.972434 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_olm-operator-6b444d44fb-mb5b9_5913a68d-4e86-4c20-b87b-685cb1f91641/olm-operator/0.log 2025-10-13 20:48:42.972449 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_package-server-manager-789f6589d5-9nn5x_53797c3f-6af4-476d-a01b-afe66bf7cc2d/ 2025-10-13 20:48:42.972464 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_package-server-manager-789f6589d5-9nn5x_53797c3f-6af4-476d-a01b-afe66bf7cc2d/kube-rbac-proxy/ 2025-10-13 20:48:42.972480 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_package-server-manager-789f6589d5-9nn5x_53797c3f-6af4-476d-a01b-afe66bf7cc2d/kube-rbac-proxy/0.log 2025-10-13 20:48:42.972496 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_package-server-manager-789f6589d5-9nn5x_53797c3f-6af4-476d-a01b-afe66bf7cc2d/package-server-manager/ 2025-10-13 20:48:42.972512 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_package-server-manager-789f6589d5-9nn5x_53797c3f-6af4-476d-a01b-afe66bf7cc2d/package-server-manager/0.log 2025-10-13 20:48:42.972528 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_packageserver-d55dfcdfc-6jmbc_e74df37a-9e94-47bb-a468-ac9f13077f1c/ 2025-10-13 20:48:42.972543 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_packageserver-d55dfcdfc-6jmbc_e74df37a-9e94-47bb-a468-ac9f13077f1c/packageserver/ 2025-10-13 20:48:42.972559 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operator-lifecycle-manager_packageserver-d55dfcdfc-6jmbc_e74df37a-9e94-47bb-a468-ac9f13077f1c/packageserver/0.log 2025-10-13 20:48:42.972575 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-7c8cf85677-4k7vt_3b7c7bed-778c-4fe4-a78f-d816047f2e87/ 2025-10-13 20:48:42.972591 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-7c8cf85677-4k7vt_3b7c7bed-778c-4fe4-a78f-d816047f2e87/prometheus-operator/ 2025-10-13 20:48:42.972607 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-7c8cf85677-4k7vt_3b7c7bed-778c-4fe4-a78f-d816047f2e87/prometheus-operator/0.log 2025-10-13 20:48:42.972649 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-admission-webhook-8566c88866-8jjmk_46efbeb6-2e66-49c0-afc3-5390abf120e4/ 2025-10-13 20:48:42.972668 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-admission-webhook-8566c88866-8jjmk_46efbeb6-2e66-49c0-afc3-5390abf120e4/prometheus-operator-admission-webhook/ 2025-10-13 20:48:42.972688 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-admission-webhook-8566c88866-8jjmk_46efbeb6-2e66-49c0-afc3-5390abf120e4/prometheus-operator-admission-webhook/0.log 2025-10-13 20:48:42.972704 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-admission-webhook-8566c88866-c5nlk_f5b69ed5-71d2-4bd2-8799-70dfb76b8f2d/ 2025-10-13 20:48:42.972720 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-admission-webhook-8566c88866-c5nlk_f5b69ed5-71d2-4bd2-8799-70dfb76b8f2d/prometheus-operator-admission-webhook/ 2025-10-13 20:48:42.972761 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_obo-prometheus-operator-admission-webhook-8566c88866-c5nlk_f5b69ed5-71d2-4bd2-8799-70dfb76b8f2d/prometheus-operator-admission-webhook/0.log 2025-10-13 20:48:42.972778 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_observability-operator-cc5f78dfc-jdbm4_0c360ba2-0696-4610-b01d-dc029d6754d4/ 2025-10-13 20:48:42.972794 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_observability-operator-cc5f78dfc-jdbm4_0c360ba2-0696-4610-b01d-dc029d6754d4/operator/ 2025-10-13 20:48:42.972810 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_observability-operator-cc5f78dfc-jdbm4_0c360ba2-0696-4610-b01d-dc029d6754d4/operator/0.log 2025-10-13 20:48:42.972826 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_perses-operator-54bc95c9fb-wxw8s_7dc1ead4-4200-4ddf-9beb-51d88a4e6caa/ 2025-10-13 20:48:42.972843 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_perses-operator-54bc95c9fb-wxw8s_7dc1ead4-4200-4ddf-9beb-51d88a4e6caa/perses-operator/ 2025-10-13 20:48:42.972859 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-operators_perses-operator-54bc95c9fb-wxw8s_7dc1ead4-4200-4ddf-9beb-51d88a4e6caa/perses-operator/0.log 2025-10-13 20:48:42.972874 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-control-plane-749d76644c-lhjss_994f27e1-cd64-411a-ab54-6b4c4bbb9d81/ 2025-10-13 20:48:42.972891 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-control-plane-749d76644c-lhjss_994f27e1-cd64-411a-ab54-6b4c4bbb9d81/kube-rbac-proxy/ 2025-10-13 20:48:42.972907 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-control-plane-749d76644c-lhjss_994f27e1-cd64-411a-ab54-6b4c4bbb9d81/kube-rbac-proxy/0.log 2025-10-13 20:48:42.972923 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-control-plane-749d76644c-lhjss_994f27e1-cd64-411a-ab54-6b4c4bbb9d81/ovnkube-cluster-manager/ 2025-10-13 20:48:42.972938 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-control-plane-749d76644c-lhjss_994f27e1-cd64-411a-ab54-6b4c4bbb9d81/ovnkube-cluster-manager/0.log 2025-10-13 20:48:42.972955 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/ 2025-10-13 20:48:42.972970 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/kube-rbac-proxy-node/ 2025-10-13 20:48:42.972985 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/kube-rbac-proxy-node/0.log 2025-10-13 20:48:42.973005 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/kube-rbac-proxy-ovn-metrics/ 2025-10-13 20:48:42.973021 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/kube-rbac-proxy-ovn-metrics/0.log 2025-10-13 20:48:42.973036 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/kubecfg-setup/ 2025-10-13 20:48:42.973080 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/kubecfg-setup/0.log 2025-10-13 20:48:42.973100 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/nbdb/ 2025-10-13 20:48:42.973118 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/nbdb/0.log 2025-10-13 20:48:42.973136 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/northd/ 2025-10-13 20:48:42.973153 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/northd/0.log 2025-10-13 20:48:42.973171 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/ovn-acl-logging/ 2025-10-13 20:48:42.973189 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/ovn-acl-logging/0.log 2025-10-13 20:48:42.973206 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/ovn-controller/ 2025-10-13 20:48:42.973224 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/ovn-controller/0.log 2025-10-13 20:48:42.973242 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/ovnkube-controller/ 2025-10-13 20:48:42.973259 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/ovnkube-controller/0.log.gz 2025-10-13 20:48:42.973277 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/sbdb/ 2025-10-13 20:48:42.973295 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-ovn-kubernetes_ovnkube-node-hbhzd_77465163-3588-4a1a-8b9a-03bb74fd58a6/sbdb/0.log 2025-10-13 20:48:42.973312 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-route-controller-manager_route-controller-manager-5d94c5cd54-ttslp_14c106f8-4812-4f17-ab4e-5bdec6d0492d/ 2025-10-13 20:48:42.973328 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-route-controller-manager_route-controller-manager-5d94c5cd54-ttslp_14c106f8-4812-4f17-ab4e-5bdec6d0492d/route-controller-manager/ 2025-10-13 20:48:42.973343 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-route-controller-manager_route-controller-manager-5d94c5cd54-ttslp_14c106f8-4812-4f17-ab4e-5bdec6d0492d/route-controller-manager/0.log 2025-10-13 20:48:42.973359 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-service-ca-operator_service-ca-operator-777779d784-25l8h_56b06211-0341-453f-b106-3ff95538b223/ 2025-10-13 20:48:42.973383 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-service-ca-operator_service-ca-operator-777779d784-25l8h_56b06211-0341-453f-b106-3ff95538b223/service-ca-operator/ 2025-10-13 20:48:42.973408 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-service-ca-operator_service-ca-operator-777779d784-25l8h_56b06211-0341-453f-b106-3ff95538b223/service-ca-operator/0.log 2025-10-13 20:48:42.973431 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-service-ca_service-ca-9c57cc56f-5rhd8_373fbfa7-7915-48ab-9cee-387f937276de/ 2025-10-13 20:48:42.973448 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-service-ca_service-ca-9c57cc56f-5rhd8_373fbfa7-7915-48ab-9cee-387f937276de/service-ca-controller/ 2025-10-13 20:48:42.973464 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openshift-service-ca_service-ca-9c57cc56f-5rhd8_373fbfa7-7915-48ab-9cee-387f937276de/service-ca-controller/0.log 2025-10-13 20:48:42.973480 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-api-54cfd786d-vwmcd_b425d8ae-bd41-4030-b96f-720ce11d98dd/ 2025-10-13 20:48:42.973496 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-api-54cfd786d-vwmcd_b425d8ae-bd41-4030-b96f-720ce11d98dd/barbican-api-log/ 2025-10-13 20:48:42.973512 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-api-54cfd786d-vwmcd_b425d8ae-bd41-4030-b96f-720ce11d98dd/barbican-api-log/0.log 2025-10-13 20:48:42.973528 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-api-54cfd786d-vwmcd_b425d8ae-bd41-4030-b96f-720ce11d98dd/barbican-api/ 2025-10-13 20:48:42.973611 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-api-54cfd786d-vwmcd_b425d8ae-bd41-4030-b96f-720ce11d98dd/barbican-api/0.log 2025-10-13 20:48:42.973632 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-keystone-listener-576c97949d-5g2hx_21138a9f-82a2-4880-a9b0-f0d922d85b8c/ 2025-10-13 20:48:42.973649 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-keystone-listener-576c97949d-5g2hx_21138a9f-82a2-4880-a9b0-f0d922d85b8c/barbican-keystone-listener-log/ 2025-10-13 20:48:42.973666 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-keystone-listener-576c97949d-5g2hx_21138a9f-82a2-4880-a9b0-f0d922d85b8c/barbican-keystone-listener-log/0.log 2025-10-13 20:48:42.973682 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-keystone-listener-576c97949d-5g2hx_21138a9f-82a2-4880-a9b0-f0d922d85b8c/barbican-keystone-listener/ 2025-10-13 20:48:42.973698 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-keystone-listener-576c97949d-5g2hx_21138a9f-82a2-4880-a9b0-f0d922d85b8c/barbican-keystone-listener/0.log 2025-10-13 20:48:42.973715 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-worker-c8f4d948c-lxfhn_1ca46f13-4466-4923-9826-5d5a03c518a2/ 2025-10-13 20:48:42.973751 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-worker-c8f4d948c-lxfhn_1ca46f13-4466-4923-9826-5d5a03c518a2/barbican-worker-log/ 2025-10-13 20:48:42.973769 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-worker-c8f4d948c-lxfhn_1ca46f13-4466-4923-9826-5d5a03c518a2/barbican-worker-log/0.log 2025-10-13 20:48:42.973789 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-worker-c8f4d948c-lxfhn_1ca46f13-4466-4923-9826-5d5a03c518a2/barbican-worker/ 2025-10-13 20:48:42.973805 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_barbican-worker-c8f4d948c-lxfhn_1ca46f13-4466-4923-9826-5d5a03c518a2/barbican-worker/0.log 2025-10-13 20:48:42.973822 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/ 2025-10-13 20:48:42.973838 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/ceilometer-central-agent/ 2025-10-13 20:48:42.973854 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/ceilometer-central-agent/0.log 2025-10-13 20:48:42.973871 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/ceilometer-notification-agent/ 2025-10-13 20:48:42.973887 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/ceilometer-notification-agent/0.log 2025-10-13 20:48:42.973911 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/proxy-httpd/ 2025-10-13 20:48:42.973933 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/proxy-httpd/0.log 2025-10-13 20:48:42.973954 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/sg-core/ 2025-10-13 20:48:42.973974 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ceilometer-0_0c6bac95-1a0a-43ff-b716-ca1ed2fdff45/sg-core/0.log 2025-10-13 20:48:42.973995 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-api-0_3522d06d-62de-4806-aecf-134a26b2e537/ 2025-10-13 20:48:42.974016 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-api-0_3522d06d-62de-4806-aecf-134a26b2e537/cinder-api-log/ 2025-10-13 20:48:42.974035 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-api-0_3522d06d-62de-4806-aecf-134a26b2e537/cinder-api-log/0.log 2025-10-13 20:48:42.974051 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-api-0_3522d06d-62de-4806-aecf-134a26b2e537/cinder-api/ 2025-10-13 20:48:42.974069 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-api-0_3522d06d-62de-4806-aecf-134a26b2e537/cinder-api/0.log 2025-10-13 20:48:42.974180 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-scheduler-0_5f80c0f3-e132-4945-bc59-56f80ecf9014/ 2025-10-13 20:48:42.974205 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-scheduler-0_5f80c0f3-e132-4945-bc59-56f80ecf9014/cinder-scheduler/ 2025-10-13 20:48:42.974222 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-scheduler-0_5f80c0f3-e132-4945-bc59-56f80ecf9014/cinder-scheduler/0.log 2025-10-13 20:48:42.974238 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-scheduler-0_5f80c0f3-e132-4945-bc59-56f80ecf9014/probe/ 2025-10-13 20:48:42.974255 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_cinder-scheduler-0_5f80c0f3-e132-4945-bc59-56f80ecf9014/probe/0.log 2025-10-13 20:48:42.974274 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-7897767fb7-62vl2_20140e6f-f5a1-4d95-8ae3-36810baff8f5/ 2025-10-13 20:48:42.974291 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-7897767fb7-62vl2_20140e6f-f5a1-4d95-8ae3-36810baff8f5/dnsmasq-dns/ 2025-10-13 20:48:42.974307 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-7897767fb7-62vl2_20140e6f-f5a1-4d95-8ae3-36810baff8f5/dnsmasq-dns/0.log 2025-10-13 20:48:42.974323 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-7897767fb7-62vl2_20140e6f-f5a1-4d95-8ae3-36810baff8f5/init/ 2025-10-13 20:48:42.974339 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_dnsmasq-dnsmasq-7897767fb7-62vl2_20140e6f-f5a1-4d95-8ae3-36810baff8f5/init/0.log 2025-10-13 20:48:42.974354 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-external-api-0_3368fa83-7787-4e7e-861d-fb9d3e06f7b8/ 2025-10-13 20:48:42.974370 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-external-api-0_3368fa83-7787-4e7e-861d-fb9d3e06f7b8/glance-httpd/ 2025-10-13 20:48:42.974385 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-external-api-0_3368fa83-7787-4e7e-861d-fb9d3e06f7b8/glance-httpd/0.log 2025-10-13 20:48:42.974401 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-external-api-0_3368fa83-7787-4e7e-861d-fb9d3e06f7b8/glance-log/ 2025-10-13 20:48:42.974416 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-external-api-0_3368fa83-7787-4e7e-861d-fb9d3e06f7b8/glance-log/0.log 2025-10-13 20:48:42.974432 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-internal-api-0_2ebcc674-02e8-42ec-93d9-d86284621d11/ 2025-10-13 20:48:42.974448 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-internal-api-0_2ebcc674-02e8-42ec-93d9-d86284621d11/glance-httpd/ 2025-10-13 20:48:42.974463 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-internal-api-0_2ebcc674-02e8-42ec-93d9-d86284621d11/glance-httpd/0.log 2025-10-13 20:48:42.974479 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-internal-api-0_2ebcc674-02e8-42ec-93d9-d86284621d11/glance-log/ 2025-10-13 20:48:42.974495 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_glance-default-internal-api-0_2ebcc674-02e8-42ec-93d9-d86284621d11/glance-log/0.log 2025-10-13 20:48:42.974511 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_keystone-6f98bbf5c8-qqqjd_57a3475c-71dd-4f57-8a4e-4261e432d2a2/ 2025-10-13 20:48:42.974526 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_keystone-6f98bbf5c8-qqqjd_57a3475c-71dd-4f57-8a4e-4261e432d2a2/keystone-api/ 2025-10-13 20:48:42.974541 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_keystone-6f98bbf5c8-qqqjd_57a3475c-71dd-4f57-8a4e-4261e432d2a2/keystone-api/0.log 2025-10-13 20:48:42.974557 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_kube-state-metrics-0_2c986bdf-beb4-465b-864c-419bca645411/ 2025-10-13 20:48:42.974572 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_kube-state-metrics-0_2c986bdf-beb4-465b-864c-419bca645411/kube-state-metrics/ 2025-10-13 20:48:42.974591 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_kube-state-metrics-0_2c986bdf-beb4-465b-864c-419bca645411/kube-state-metrics/0.log 2025-10-13 20:48:42.974606 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_memcached-0_97b2b43d-e136-42bb-aa86-3defff38a84b/ 2025-10-13 20:48:42.974622 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_memcached-0_97b2b43d-e136-42bb-aa86-3defff38a84b/memcached/ 2025-10-13 20:48:42.974637 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_memcached-0_97b2b43d-e136-42bb-aa86-3defff38a84b/memcached/0.log.gz 2025-10-13 20:48:42.974653 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_neutron-579859f9f8-t8czw_d5779652-df3d-4134-a799-9bda68b1ede4/ 2025-10-13 20:48:42.974668 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_neutron-579859f9f8-t8czw_d5779652-df3d-4134-a799-9bda68b1ede4/neutron-api/ 2025-10-13 20:48:42.974684 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_neutron-579859f9f8-t8czw_d5779652-df3d-4134-a799-9bda68b1ede4/neutron-api/0.log 2025-10-13 20:48:42.974699 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_neutron-579859f9f8-t8czw_d5779652-df3d-4134-a799-9bda68b1ede4/neutron-httpd/ 2025-10-13 20:48:42.974714 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_neutron-579859f9f8-t8czw_d5779652-df3d-4134-a799-9bda68b1ede4/neutron-httpd/0.log 2025-10-13 20:48:42.974749 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-api-0_a3f38755-7d1d-41f8-9ecd-b580086dbd6b/ 2025-10-13 20:48:42.974766 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-api-0_a3f38755-7d1d-41f8-9ecd-b580086dbd6b/nova-api-api/ 2025-10-13 20:48:42.974782 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-api-0_a3f38755-7d1d-41f8-9ecd-b580086dbd6b/nova-api-api/0.log 2025-10-13 20:48:42.974798 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-api-0_a3f38755-7d1d-41f8-9ecd-b580086dbd6b/nova-api-log/ 2025-10-13 20:48:42.974813 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-api-0_a3f38755-7d1d-41f8-9ecd-b580086dbd6b/nova-api-log/0.log 2025-10-13 20:48:42.974829 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell0-conductor-0_7714750a-421a-4e05-aa5c-e084be897e5b/ 2025-10-13 20:48:42.974845 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell0-conductor-0_7714750a-421a-4e05-aa5c-e084be897e5b/nova-cell0-conductor-conductor/ 2025-10-13 20:48:42.974861 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell0-conductor-0_7714750a-421a-4e05-aa5c-e084be897e5b/nova-cell0-conductor-conductor/1.log 2025-10-13 20:48:42.974877 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell0-conductor-0_7714750a-421a-4e05-aa5c-e084be897e5b/nova-cell0-conductor-conductor/2.log 2025-10-13 20:48:42.974893 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell1-conductor-0_bc6223a4-8aa5-4a76-b354-844b400ca832/ 2025-10-13 20:48:42.974908 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell1-conductor-0_bc6223a4-8aa5-4a76-b354-844b400ca832/nova-cell1-conductor-conductor/ 2025-10-13 20:48:42.974924 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell1-conductor-0_bc6223a4-8aa5-4a76-b354-844b400ca832/nova-cell1-conductor-conductor/1.log 2025-10-13 20:48:42.974943 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell1-conductor-0_bc6223a4-8aa5-4a76-b354-844b400ca832/nova-cell1-conductor-conductor/2.log 2025-10-13 20:48:42.974958 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell1-novncproxy-0_5ffb1d96-9d32-4f45-a1a2-46cd215b3bd2/ 2025-10-13 20:48:42.974973 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell1-novncproxy-0_5ffb1d96-9d32-4f45-a1a2-46cd215b3bd2/nova-cell1-novncproxy-novncproxy/ 2025-10-13 20:48:42.974989 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-cell1-novncproxy-0_5ffb1d96-9d32-4f45-a1a2-46cd215b3bd2/nova-cell1-novncproxy-novncproxy/0.log 2025-10-13 20:48:42.975004 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-metadata-0_07aed376-7459-4f71-a365-a7ecd76162c4/ 2025-10-13 20:48:42.975020 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-metadata-0_07aed376-7459-4f71-a365-a7ecd76162c4/nova-metadata-log/ 2025-10-13 20:48:42.975035 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-metadata-0_07aed376-7459-4f71-a365-a7ecd76162c4/nova-metadata-log/0.log 2025-10-13 20:48:42.975050 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-metadata-0_07aed376-7459-4f71-a365-a7ecd76162c4/nova-metadata-metadata/ 2025-10-13 20:48:42.975065 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-metadata-0_07aed376-7459-4f71-a365-a7ecd76162c4/nova-metadata-metadata/0.log 2025-10-13 20:48:42.975081 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-scheduler-0_6ce1866b-1e6f-4c12-9b2c-34b8f14ea84c/ 2025-10-13 20:48:42.975096 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-scheduler-0_6ce1866b-1e6f-4c12-9b2c-34b8f14ea84c/nova-scheduler-scheduler/ 2025-10-13 20:48:42.975112 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_nova-scheduler-0_6ce1866b-1e6f-4c12-9b2c-34b8f14ea84c/nova-scheduler-scheduler/0.log 2025-10-13 20:48:42.975128 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-cell1-galera-0_8aa80a5c-b317-4f05-a984-d80cbddf7140/ 2025-10-13 20:48:42.975143 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-cell1-galera-0_8aa80a5c-b317-4f05-a984-d80cbddf7140/galera/ 2025-10-13 20:48:42.975159 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-cell1-galera-0_8aa80a5c-b317-4f05-a984-d80cbddf7140/galera/0.log 2025-10-13 20:48:42.975174 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-cell1-galera-0_8aa80a5c-b317-4f05-a984-d80cbddf7140/mysql-bootstrap/ 2025-10-13 20:48:42.975189 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-cell1-galera-0_8aa80a5c-b317-4f05-a984-d80cbddf7140/mysql-bootstrap/0.log 2025-10-13 20:48:42.975205 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-galera-0_e059d47b-0503-469e-99d7-2d6100e08498/ 2025-10-13 20:48:42.975220 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-galera-0_e059d47b-0503-469e-99d7-2d6100e08498/galera/ 2025-10-13 20:48:42.975235 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-galera-0_e059d47b-0503-469e-99d7-2d6100e08498/galera/0.log 2025-10-13 20:48:42.975254 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-galera-0_e059d47b-0503-469e-99d7-2d6100e08498/mysql-bootstrap/ 2025-10-13 20:48:42.975270 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstack-galera-0_e059d47b-0503-469e-99d7-2d6100e08498/mysql-bootstrap/0.log 2025-10-13 20:48:42.975285 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstackclient_c208452e-cbfe-4a65-a09c-e3ff9ec93237/ 2025-10-13 20:48:42.975300 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstackclient_c208452e-cbfe-4a65-a09c-e3ff9ec93237/openstackclient/ 2025-10-13 20:48:42.975316 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_openstackclient_c208452e-cbfe-4a65-a09c-e3ff9ec93237/openstackclient/0.log 2025-10-13 20:48:42.975333 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovn-northd-0_502345bc-3fb0-4d25-8a4b-7cae82c8056d/ 2025-10-13 20:48:42.975349 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovn-northd-0_502345bc-3fb0-4d25-8a4b-7cae82c8056d/openstack-network-exporter/ 2025-10-13 20:48:42.975365 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovn-northd-0_502345bc-3fb0-4d25-8a4b-7cae82c8056d/openstack-network-exporter/0.log 2025-10-13 20:48:42.975382 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovn-northd-0_502345bc-3fb0-4d25-8a4b-7cae82c8056d/ovn-northd/ 2025-10-13 20:48:42.975398 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovn-northd-0_502345bc-3fb0-4d25-8a4b-7cae82c8056d/ovn-northd/0.log 2025-10-13 20:48:42.975414 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0b7e010-3e60-4281-93c4-2c58d29f8cbf/ 2025-10-13 20:48:42.975430 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0b7e010-3e60-4281-93c4-2c58d29f8cbf/openstack-network-exporter/ 2025-10-13 20:48:42.975445 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0b7e010-3e60-4281-93c4-2c58d29f8cbf/openstack-network-exporter/0.log 2025-10-13 20:48:42.975461 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0b7e010-3e60-4281-93c4-2c58d29f8cbf/ovsdbserver-nb/ 2025-10-13 20:48:42.975477 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-nb-0_b0b7e010-3e60-4281-93c4-2c58d29f8cbf/ovsdbserver-nb/0.log 2025-10-13 20:48:42.975493 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-sb-0_75f5ae0d-bfcf-4c0b-93c8-7e912a5b471b/ 2025-10-13 20:48:42.975509 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-sb-0_75f5ae0d-bfcf-4c0b-93c8-7e912a5b471b/openstack-network-exporter/ 2025-10-13 20:48:42.975524 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-sb-0_75f5ae0d-bfcf-4c0b-93c8-7e912a5b471b/openstack-network-exporter/0.log 2025-10-13 20:48:42.975540 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-sb-0_75f5ae0d-bfcf-4c0b-93c8-7e912a5b471b/ovsdbserver-sb/ 2025-10-13 20:48:42.975555 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_ovsdbserver-sb-0_75f5ae0d-bfcf-4c0b-93c8-7e912a5b471b/ovsdbserver-sb/0.log 2025-10-13 20:48:42.975571 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_placement-64d84d847d-vft6g_3dc48c0e-8206-436d-9f76-22c4e0889baa/ 2025-10-13 20:48:42.975590 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_placement-64d84d847d-vft6g_3dc48c0e-8206-436d-9f76-22c4e0889baa/placement-api/ 2025-10-13 20:48:42.975606 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_placement-64d84d847d-vft6g_3dc48c0e-8206-436d-9f76-22c4e0889baa/placement-api/0.log 2025-10-13 20:48:42.975622 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_placement-64d84d847d-vft6g_3dc48c0e-8206-436d-9f76-22c4e0889baa/placement-log/ 2025-10-13 20:48:42.975638 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_placement-64d84d847d-vft6g_3dc48c0e-8206-436d-9f76-22c4e0889baa/placement-log/0.log 2025-10-13 20:48:42.975654 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-cell1-server-0_e9dd90a1-922c-45ba-bf7c-5734df7139ef/ 2025-10-13 20:48:42.975670 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-cell1-server-0_e9dd90a1-922c-45ba-bf7c-5734df7139ef/rabbitmq/ 2025-10-13 20:48:42.975687 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-cell1-server-0_e9dd90a1-922c-45ba-bf7c-5734df7139ef/rabbitmq/0.log 2025-10-13 20:48:42.975703 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-cell1-server-0_e9dd90a1-922c-45ba-bf7c-5734df7139ef/setup-container/ 2025-10-13 20:48:42.975718 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-cell1-server-0_e9dd90a1-922c-45ba-bf7c-5734df7139ef/setup-container/0.log 2025-10-13 20:48:42.975752 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-server-0_7ffa01f6-b393-4ac4-83de-250b16260df9/ 2025-10-13 20:48:42.975769 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-server-0_7ffa01f6-b393-4ac4-83de-250b16260df9/rabbitmq/ 2025-10-13 20:48:42.975785 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-server-0_7ffa01f6-b393-4ac4-83de-250b16260df9/rabbitmq/0.log 2025-10-13 20:48:42.975801 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-server-0_7ffa01f6-b393-4ac4-83de-250b16260df9/setup-container/ 2025-10-13 20:48:42.975816 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_rabbitmq-server-0_7ffa01f6-b393-4ac4-83de-250b16260df9/setup-container/0.log 2025-10-13 20:48:42.975832 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-proxy-7b49dbb6d4-chqn8_d25afa5c-89ac-42b9-9ae8-0ee2664063ca/ 2025-10-13 20:48:42.975847 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-proxy-7b49dbb6d4-chqn8_d25afa5c-89ac-42b9-9ae8-0ee2664063ca/proxy-httpd/ 2025-10-13 20:48:42.975862 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-proxy-7b49dbb6d4-chqn8_d25afa5c-89ac-42b9-9ae8-0ee2664063ca/proxy-httpd/0.log 2025-10-13 20:48:42.975878 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-proxy-7b49dbb6d4-chqn8_d25afa5c-89ac-42b9-9ae8-0ee2664063ca/proxy-server/ 2025-10-13 20:48:42.975893 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-proxy-7b49dbb6d4-chqn8_d25afa5c-89ac-42b9-9ae8-0ee2664063ca/proxy-server/0.log 2025-10-13 20:48:42.975909 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-ring-rebalance-gx4v6_aeea1d59-2766-4f0c-8b7e-370c07a8501a/ 2025-10-13 20:48:42.975928 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-ring-rebalance-gx4v6_aeea1d59-2766-4f0c-8b7e-370c07a8501a/swift-ring-rebalance/ 2025-10-13 20:48:42.975944 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-ring-rebalance-gx4v6_aeea1d59-2766-4f0c-8b7e-370c07a8501a/swift-ring-rebalance/0.log 2025-10-13 20:48:42.975959 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/ 2025-10-13 20:48:42.975975 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-auditor/ 2025-10-13 20:48:42.975991 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-auditor/0.log 2025-10-13 20:48:42.976007 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-reaper/ 2025-10-13 20:48:42.976022 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-reaper/0.log 2025-10-13 20:48:42.976038 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-replicator/ 2025-10-13 20:48:42.976054 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-replicator/0.log 2025-10-13 20:48:42.976070 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-server/ 2025-10-13 20:48:42.976085 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/account-server/0.log 2025-10-13 20:48:42.976101 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-auditor/ 2025-10-13 20:48:42.976116 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-auditor/0.log 2025-10-13 20:48:42.976132 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-replicator/ 2025-10-13 20:48:42.976148 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-replicator/0.log 2025-10-13 20:48:42.976163 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-server/ 2025-10-13 20:48:42.976180 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-server/0.log 2025-10-13 20:48:42.976196 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-updater/ 2025-10-13 20:48:42.976212 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/container-updater/0.log 2025-10-13 20:48:42.976227 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-auditor/ 2025-10-13 20:48:42.976246 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-auditor/0.log 2025-10-13 20:48:42.976262 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-expirer/ 2025-10-13 20:48:42.976277 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-expirer/0.log 2025-10-13 20:48:42.976292 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-replicator/ 2025-10-13 20:48:42.976307 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-replicator/0.log 2025-10-13 20:48:42.976323 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-server/ 2025-10-13 20:48:42.976338 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-server/0.log 2025-10-13 20:48:42.976354 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-updater/ 2025-10-13 20:48:42.976369 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/object-updater/0.log 2025-10-13 20:48:42.976384 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/rsync/ 2025-10-13 20:48:42.976399 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/rsync/0.log 2025-10-13 20:48:42.976415 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/swift-recon-cron/ 2025-10-13 20:48:42.976431 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-kuttl-tests_swift-storage-0_0faa58cf-e207-49c2-a1ba-7d8290677bf4/swift-recon-cron/0.log 2025-10-13 20:48:42.976446 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl_6252dd85-f775-43a1-8853-309258c4b52a/ 2025-10-13 20:48:42.976462 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl_6252dd85-f775-43a1-8853-309258c4b52a/extract/ 2025-10-13 20:48:42.976477 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl_6252dd85-f775-43a1-8853-309258c4b52a/extract/0.log 2025-10-13 20:48:42.976493 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl_6252dd85-f775-43a1-8853-309258c4b52a/pull/ 2025-10-13 20:48:42.976509 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl_6252dd85-f775-43a1-8853-309258c4b52a/pull/0.log 2025-10-13 20:48:42.976524 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl_6252dd85-f775-43a1-8853-309258c4b52a/util/ 2025-10-13 20:48:42.976540 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl_6252dd85-f775-43a1-8853-309258c4b52a/util/0.log 2025-10-13 20:48:42.976559 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_barbican-operator-controller-manager-658bdf4b74-z9qnq_ae9093a1-d283-4d01-b3f8-6f51042f9f66/ 2025-10-13 20:48:42.976574 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_barbican-operator-controller-manager-658bdf4b74-z9qnq_ae9093a1-d283-4d01-b3f8-6f51042f9f66/kube-rbac-proxy/ 2025-10-13 20:48:42.976590 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_barbican-operator-controller-manager-658bdf4b74-z9qnq_ae9093a1-d283-4d01-b3f8-6f51042f9f66/kube-rbac-proxy/0.log 2025-10-13 20:48:42.976606 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_barbican-operator-controller-manager-658bdf4b74-z9qnq_ae9093a1-d283-4d01-b3f8-6f51042f9f66/manager/ 2025-10-13 20:48:42.976621 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_barbican-operator-controller-manager-658bdf4b74-z9qnq_ae9093a1-d283-4d01-b3f8-6f51042f9f66/manager/0.log.gz 2025-10-13 20:48:42.976637 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_cinder-operator-controller-manager-7b7fb68549-bsc2z_d0939f7d-da1c-435b-9dde-59abbfcd044d/ 2025-10-13 20:48:42.976652 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_cinder-operator-controller-manager-7b7fb68549-bsc2z_d0939f7d-da1c-435b-9dde-59abbfcd044d/kube-rbac-proxy/ 2025-10-13 20:48:42.976668 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_cinder-operator-controller-manager-7b7fb68549-bsc2z_d0939f7d-da1c-435b-9dde-59abbfcd044d/kube-rbac-proxy/0.log 2025-10-13 20:48:42.976684 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_cinder-operator-controller-manager-7b7fb68549-bsc2z_d0939f7d-da1c-435b-9dde-59abbfcd044d/manager/ 2025-10-13 20:48:42.976700 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_cinder-operator-controller-manager-7b7fb68549-bsc2z_d0939f7d-da1c-435b-9dde-59abbfcd044d/manager/0.log.gz 2025-10-13 20:48:42.976715 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_designate-operator-controller-manager-85d5d9dd78-tmbdh_829e0048-04f6-459c-90ed-9f7fddba3014/ 2025-10-13 20:48:42.976759 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_designate-operator-controller-manager-85d5d9dd78-tmbdh_829e0048-04f6-459c-90ed-9f7fddba3014/kube-rbac-proxy/ 2025-10-13 20:48:42.976777 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_designate-operator-controller-manager-85d5d9dd78-tmbdh_829e0048-04f6-459c-90ed-9f7fddba3014/kube-rbac-proxy/0.log 2025-10-13 20:48:42.976793 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_designate-operator-controller-manager-85d5d9dd78-tmbdh_829e0048-04f6-459c-90ed-9f7fddba3014/manager/ 2025-10-13 20:48:42.976809 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_designate-operator-controller-manager-85d5d9dd78-tmbdh_829e0048-04f6-459c-90ed-9f7fddba3014/manager/0.log 2025-10-13 20:48:42.976824 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_glance-operator-controller-manager-84b9b84486-874c5_520edacf-ee67-42e2-8f84-5d1a3ba74db3/ 2025-10-13 20:48:42.976840 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_glance-operator-controller-manager-84b9b84486-874c5_520edacf-ee67-42e2-8f84-5d1a3ba74db3/kube-rbac-proxy/ 2025-10-13 20:48:42.976856 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_glance-operator-controller-manager-84b9b84486-874c5_520edacf-ee67-42e2-8f84-5d1a3ba74db3/kube-rbac-proxy/0.log 2025-10-13 20:48:42.976877 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_glance-operator-controller-manager-84b9b84486-874c5_520edacf-ee67-42e2-8f84-5d1a3ba74db3/manager/ 2025-10-13 20:48:42.976894 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_glance-operator-controller-manager-84b9b84486-874c5_520edacf-ee67-42e2-8f84-5d1a3ba74db3/manager/0.log.gz 2025-10-13 20:48:42.976909 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_heat-operator-controller-manager-858f76bbdd-sbz6w_5bcfdb92-6d50-446d-8326-39f3f47f32f2/ 2025-10-13 20:48:42.976925 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_heat-operator-controller-manager-858f76bbdd-sbz6w_5bcfdb92-6d50-446d-8326-39f3f47f32f2/kube-rbac-proxy/ 2025-10-13 20:48:42.976941 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_heat-operator-controller-manager-858f76bbdd-sbz6w_5bcfdb92-6d50-446d-8326-39f3f47f32f2/kube-rbac-proxy/0.log 2025-10-13 20:48:42.976957 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_heat-operator-controller-manager-858f76bbdd-sbz6w_5bcfdb92-6d50-446d-8326-39f3f47f32f2/manager/ 2025-10-13 20:48:42.976972 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_heat-operator-controller-manager-858f76bbdd-sbz6w_5bcfdb92-6d50-446d-8326-39f3f47f32f2/manager/0.log 2025-10-13 20:48:42.976988 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_horizon-operator-controller-manager-7ffbcb7588-8zb7s_8877aec8-eb38-4135-a22c-a3cf9be16d62/ 2025-10-13 20:48:42.977004 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_horizon-operator-controller-manager-7ffbcb7588-8zb7s_8877aec8-eb38-4135-a22c-a3cf9be16d62/kube-rbac-proxy/ 2025-10-13 20:48:42.977019 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_horizon-operator-controller-manager-7ffbcb7588-8zb7s_8877aec8-eb38-4135-a22c-a3cf9be16d62/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977035 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_horizon-operator-controller-manager-7ffbcb7588-8zb7s_8877aec8-eb38-4135-a22c-a3cf9be16d62/manager/ 2025-10-13 20:48:42.977067 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_horizon-operator-controller-manager-7ffbcb7588-8zb7s_8877aec8-eb38-4135-a22c-a3cf9be16d62/manager/0.log 2025-10-13 20:48:42.977088 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_infra-operator-controller-manager-656bcbd775-pfsgv_47b9deaa-0788-4fc2-9e46-37f98a50b076/ 2025-10-13 20:48:42.977106 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_infra-operator-controller-manager-656bcbd775-pfsgv_47b9deaa-0788-4fc2-9e46-37f98a50b076/kube-rbac-proxy/ 2025-10-13 20:48:42.977123 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_infra-operator-controller-manager-656bcbd775-pfsgv_47b9deaa-0788-4fc2-9e46-37f98a50b076/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977141 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_infra-operator-controller-manager-656bcbd775-pfsgv_47b9deaa-0788-4fc2-9e46-37f98a50b076/manager/ 2025-10-13 20:48:42.977159 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_infra-operator-controller-manager-656bcbd775-pfsgv_47b9deaa-0788-4fc2-9e46-37f98a50b076/manager/0.log.gz 2025-10-13 20:48:42.977176 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ironic-operator-controller-manager-9c5c78d49-j6lnp_7fded2f2-855e-4360-844f-232312f74de0/ 2025-10-13 20:48:42.977198 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ironic-operator-controller-manager-9c5c78d49-j6lnp_7fded2f2-855e-4360-844f-232312f74de0/kube-rbac-proxy/ 2025-10-13 20:48:42.977216 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ironic-operator-controller-manager-9c5c78d49-j6lnp_7fded2f2-855e-4360-844f-232312f74de0/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977234 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ironic-operator-controller-manager-9c5c78d49-j6lnp_7fded2f2-855e-4360-844f-232312f74de0/manager/ 2025-10-13 20:48:42.977252 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ironic-operator-controller-manager-9c5c78d49-j6lnp_7fded2f2-855e-4360-844f-232312f74de0/manager/0.log 2025-10-13 20:48:42.977269 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_keystone-operator-controller-manager-55b6b7c7b8-vpmxg_3fb8e9e5-990b-4ee9-b805-1e8172ae1c35/ 2025-10-13 20:48:42.977287 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_keystone-operator-controller-manager-55b6b7c7b8-vpmxg_3fb8e9e5-990b-4ee9-b805-1e8172ae1c35/kube-rbac-proxy/ 2025-10-13 20:48:42.977305 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_keystone-operator-controller-manager-55b6b7c7b8-vpmxg_3fb8e9e5-990b-4ee9-b805-1e8172ae1c35/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977322 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_keystone-operator-controller-manager-55b6b7c7b8-vpmxg_3fb8e9e5-990b-4ee9-b805-1e8172ae1c35/manager/ 2025-10-13 20:48:42.977338 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_keystone-operator-controller-manager-55b6b7c7b8-vpmxg_3fb8e9e5-990b-4ee9-b805-1e8172ae1c35/manager/0.log.gz 2025-10-13 20:48:42.977354 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_manila-operator-controller-manager-5f67fbc655-4j2bx_7e29841e-6b82-46c1-8760-77123c3fa2b0/ 2025-10-13 20:48:42.977372 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_manila-operator-controller-manager-5f67fbc655-4j2bx_7e29841e-6b82-46c1-8760-77123c3fa2b0/kube-rbac-proxy/ 2025-10-13 20:48:42.977396 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_manila-operator-controller-manager-5f67fbc655-4j2bx_7e29841e-6b82-46c1-8760-77123c3fa2b0/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977420 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_manila-operator-controller-manager-5f67fbc655-4j2bx_7e29841e-6b82-46c1-8760-77123c3fa2b0/manager/ 2025-10-13 20:48:42.977438 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_manila-operator-controller-manager-5f67fbc655-4j2bx_7e29841e-6b82-46c1-8760-77123c3fa2b0/manager/0.log 2025-10-13 20:48:42.977454 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_mariadb-operator-controller-manager-f9fb45f8f-7kcc8_a614a6c1-d24b-45c5-bf7b-0b613e5d0985/ 2025-10-13 20:48:42.977470 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_mariadb-operator-controller-manager-f9fb45f8f-7kcc8_a614a6c1-d24b-45c5-bf7b-0b613e5d0985/kube-rbac-proxy/ 2025-10-13 20:48:42.977486 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_mariadb-operator-controller-manager-f9fb45f8f-7kcc8_a614a6c1-d24b-45c5-bf7b-0b613e5d0985/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977501 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_mariadb-operator-controller-manager-f9fb45f8f-7kcc8_a614a6c1-d24b-45c5-bf7b-0b613e5d0985/manager/ 2025-10-13 20:48:42.977521 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_mariadb-operator-controller-manager-f9fb45f8f-7kcc8_a614a6c1-d24b-45c5-bf7b-0b613e5d0985/manager/0.log 2025-10-13 20:48:42.977537 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_neutron-operator-controller-manager-79d585cb66-p294z_08e651a1-382b-49b3-ad90-939529fc0349/ 2025-10-13 20:48:42.977552 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_neutron-operator-controller-manager-79d585cb66-p294z_08e651a1-382b-49b3-ad90-939529fc0349/kube-rbac-proxy/ 2025-10-13 20:48:42.977567 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_neutron-operator-controller-manager-79d585cb66-p294z_08e651a1-382b-49b3-ad90-939529fc0349/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977583 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_neutron-operator-controller-manager-79d585cb66-p294z_08e651a1-382b-49b3-ad90-939529fc0349/manager/ 2025-10-13 20:48:42.977598 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_neutron-operator-controller-manager-79d585cb66-p294z_08e651a1-382b-49b3-ad90-939529fc0349/manager/0.log.gz 2025-10-13 20:48:42.977614 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_nova-operator-controller-manager-5df598886f-rc6sk_10b4af88-94b6-482b-82dc-5f43cce382c4/ 2025-10-13 20:48:42.977630 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_nova-operator-controller-manager-5df598886f-rc6sk_10b4af88-94b6-482b-82dc-5f43cce382c4/kube-rbac-proxy/ 2025-10-13 20:48:42.977646 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_nova-operator-controller-manager-5df598886f-rc6sk_10b4af88-94b6-482b-82dc-5f43cce382c4/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977662 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_nova-operator-controller-manager-5df598886f-rc6sk_10b4af88-94b6-482b-82dc-5f43cce382c4/manager/ 2025-10-13 20:48:42.977678 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_nova-operator-controller-manager-5df598886f-rc6sk_10b4af88-94b6-482b-82dc-5f43cce382c4/manager/0.log.gz 2025-10-13 20:48:42.977694 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_octavia-operator-controller-manager-69fdcfc5f5-mtsxj_8779c817-890b-47f4-ae88-77b438085ef0/ 2025-10-13 20:48:42.977710 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_octavia-operator-controller-manager-69fdcfc5f5-mtsxj_8779c817-890b-47f4-ae88-77b438085ef0/kube-rbac-proxy/ 2025-10-13 20:48:42.977741 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_octavia-operator-controller-manager-69fdcfc5f5-mtsxj_8779c817-890b-47f4-ae88-77b438085ef0/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977762 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_octavia-operator-controller-manager-69fdcfc5f5-mtsxj_8779c817-890b-47f4-ae88-77b438085ef0/manager/ 2025-10-13 20:48:42.977779 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_octavia-operator-controller-manager-69fdcfc5f5-mtsxj_8779c817-890b-47f4-ae88-77b438085ef0/manager/0.log 2025-10-13 20:48:42.977794 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-baremetal-operator-controller-manager-55b7d44848b86ln_a3764f56-9521-4fd1-a23f-b49c9ce62278/ 2025-10-13 20:48:42.977810 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-baremetal-operator-controller-manager-55b7d44848b86ln_a3764f56-9521-4fd1-a23f-b49c9ce62278/kube-rbac-proxy/ 2025-10-13 20:48:42.977830 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-baremetal-operator-controller-manager-55b7d44848b86ln_a3764f56-9521-4fd1-a23f-b49c9ce62278/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977845 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-baremetal-operator-controller-manager-55b7d44848b86ln_a3764f56-9521-4fd1-a23f-b49c9ce62278/manager/ 2025-10-13 20:48:42.977861 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-baremetal-operator-controller-manager-55b7d44848b86ln_a3764f56-9521-4fd1-a23f-b49c9ce62278/manager/0.log 2025-10-13 20:48:42.977876 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-manager-7fb8c88b76-7cnqn_e1cac542-100b-4c0b-b169-1fb85bb72990/ 2025-10-13 20:48:42.977892 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-manager-7fb8c88b76-7cnqn_e1cac542-100b-4c0b-b169-1fb85bb72990/kube-rbac-proxy/ 2025-10-13 20:48:42.977907 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-manager-7fb8c88b76-7cnqn_e1cac542-100b-4c0b-b169-1fb85bb72990/kube-rbac-proxy/0.log 2025-10-13 20:48:42.977923 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-manager-7fb8c88b76-7cnqn_e1cac542-100b-4c0b-b169-1fb85bb72990/manager/ 2025-10-13 20:48:42.977938 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-manager-7fb8c88b76-7cnqn_e1cac542-100b-4c0b-b169-1fb85bb72990/manager/0.log.20251013-202014.gz 2025-10-13 20:48:42.977953 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-manager-7fb8c88b76-7cnqn_e1cac542-100b-4c0b-b169-1fb85bb72990/manager/0.log.gz 2025-10-13 20:48:42.977968 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-operator-64895cd698-wnhtw_447ed981-e289-4026-b76b-b490a31d8cac/ 2025-10-13 20:48:42.977983 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-operator-64895cd698-wnhtw_447ed981-e289-4026-b76b-b490a31d8cac/kube-rbac-proxy/ 2025-10-13 20:48:42.977999 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-operator-64895cd698-wnhtw_447ed981-e289-4026-b76b-b490a31d8cac/kube-rbac-proxy/0.log 2025-10-13 20:48:42.978014 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-operator-64895cd698-wnhtw_447ed981-e289-4026-b76b-b490a31d8cac/operator/ 2025-10-13 20:48:42.978030 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-controller-operator-64895cd698-wnhtw_447ed981-e289-4026-b76b-b490a31d8cac/operator/0.log 2025-10-13 20:48:42.978045 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-index-lqcbc_aa269318-b9f8-4fd1-8a79-12022e8fab54/ 2025-10-13 20:48:42.978060 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-index-lqcbc_aa269318-b9f8-4fd1-8a79-12022e8fab54/registry-server/ 2025-10-13 20:48:42.978076 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_openstack-operator-index-lqcbc_aa269318-b9f8-4fd1-8a79-12022e8fab54/registry-server/0.log 2025-10-13 20:48:42.978091 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ovn-operator-controller-manager-79df5fb58c-rw9zt_e028388b-2bc5-4307-8db3-807c4c8c6dea/ 2025-10-13 20:48:42.978110 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ovn-operator-controller-manager-79df5fb58c-rw9zt_e028388b-2bc5-4307-8db3-807c4c8c6dea/kube-rbac-proxy/ 2025-10-13 20:48:42.978126 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ovn-operator-controller-manager-79df5fb58c-rw9zt_e028388b-2bc5-4307-8db3-807c4c8c6dea/kube-rbac-proxy/0.log 2025-10-13 20:48:42.978142 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ovn-operator-controller-manager-79df5fb58c-rw9zt_e028388b-2bc5-4307-8db3-807c4c8c6dea/manager/ 2025-10-13 20:48:42.978158 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_ovn-operator-controller-manager-79df5fb58c-rw9zt_e028388b-2bc5-4307-8db3-807c4c8c6dea/manager/0.log.gz 2025-10-13 20:48:42.978174 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_placement-operator-controller-manager-68b6c87b68-xnsxb_811d1962-8885-4d66-8f29-0d31aee881cc/ 2025-10-13 20:48:42.978190 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_placement-operator-controller-manager-68b6c87b68-xnsxb_811d1962-8885-4d66-8f29-0d31aee881cc/kube-rbac-proxy/ 2025-10-13 20:48:42.978205 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_placement-operator-controller-manager-68b6c87b68-xnsxb_811d1962-8885-4d66-8f29-0d31aee881cc/kube-rbac-proxy/0.log 2025-10-13 20:48:42.978221 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_placement-operator-controller-manager-68b6c87b68-xnsxb_811d1962-8885-4d66-8f29-0d31aee881cc/manager/ 2025-10-13 20:48:42.978236 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_placement-operator-controller-manager-68b6c87b68-xnsxb_811d1962-8885-4d66-8f29-0d31aee881cc/manager/0.log 2025-10-13 20:48:42.978251 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl_7dfa02b3-8b5f-452f-a292-cdad1856df18/ 2025-10-13 20:48:42.978267 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl_7dfa02b3-8b5f-452f-a292-cdad1856df18/operator/ 2025-10-13 20:48:42.978282 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl_7dfa02b3-8b5f-452f-a292-cdad1856df18/operator/0.log 2025-10-13 20:48:42.978298 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_swift-operator-controller-manager-db6d7f97b-vvrmm_6fdf57f7-ea02-415c-9d6b-9e4d5ab8b8cf/ 2025-10-13 20:48:42.978313 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_swift-operator-controller-manager-db6d7f97b-vvrmm_6fdf57f7-ea02-415c-9d6b-9e4d5ab8b8cf/kube-rbac-proxy/ 2025-10-13 20:48:42.978328 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_swift-operator-controller-manager-db6d7f97b-vvrmm_6fdf57f7-ea02-415c-9d6b-9e4d5ab8b8cf/kube-rbac-proxy/0.log 2025-10-13 20:48:42.978344 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_swift-operator-controller-manager-db6d7f97b-vvrmm_6fdf57f7-ea02-415c-9d6b-9e4d5ab8b8cf/manager/ 2025-10-13 20:48:42.978359 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_swift-operator-controller-manager-db6d7f97b-vvrmm_6fdf57f7-ea02-415c-9d6b-9e4d5ab8b8cf/manager/0.log 2025-10-13 20:48:42.978375 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_telemetry-operator-controller-manager-67cfc6749b-wjlfw_79d74066-3a39-400c-99f1-6d6592402337/ 2025-10-13 20:48:42.978394 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_telemetry-operator-controller-manager-67cfc6749b-wjlfw_79d74066-3a39-400c-99f1-6d6592402337/kube-rbac-proxy/ 2025-10-13 20:48:42.978410 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_telemetry-operator-controller-manager-67cfc6749b-wjlfw_79d74066-3a39-400c-99f1-6d6592402337/kube-rbac-proxy/0.log 2025-10-13 20:48:42.978425 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_telemetry-operator-controller-manager-67cfc6749b-wjlfw_79d74066-3a39-400c-99f1-6d6592402337/manager/ 2025-10-13 20:48:42.978441 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_telemetry-operator-controller-manager-67cfc6749b-wjlfw_79d74066-3a39-400c-99f1-6d6592402337/manager/0.log.gz 2025-10-13 20:48:42.978456 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_test-operator-controller-manager-5458f77c4-xrndg_fed0d89f-c73d-487c-9ccf-e02164ae1b44/ 2025-10-13 20:48:42.978474 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_test-operator-controller-manager-5458f77c4-xrndg_fed0d89f-c73d-487c-9ccf-e02164ae1b44/kube-rbac-proxy/ 2025-10-13 20:48:42.978493 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_test-operator-controller-manager-5458f77c4-xrndg_fed0d89f-c73d-487c-9ccf-e02164ae1b44/kube-rbac-proxy/0.log 2025-10-13 20:48:42.978509 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_test-operator-controller-manager-5458f77c4-xrndg_fed0d89f-c73d-487c-9ccf-e02164ae1b44/manager/ 2025-10-13 20:48:42.978525 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_test-operator-controller-manager-5458f77c4-xrndg_fed0d89f-c73d-487c-9ccf-e02164ae1b44/manager/0.log 2025-10-13 20:48:42.978541 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_watcher-operator-controller-manager-7f554bff7b-mhwvn_a74eb777-ce55-4b07-8f76-a301465e9e78/ 2025-10-13 20:48:42.978556 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_watcher-operator-controller-manager-7f554bff7b-mhwvn_a74eb777-ce55-4b07-8f76-a301465e9e78/kube-rbac-proxy/ 2025-10-13 20:48:42.978572 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_watcher-operator-controller-manager-7f554bff7b-mhwvn_a74eb777-ce55-4b07-8f76-a301465e9e78/kube-rbac-proxy/0.log 2025-10-13 20:48:42.978588 | controller | cd+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_watcher-operator-controller-manager-7f554bff7b-mhwvn_a74eb777-ce55-4b07-8f76-a301465e9e78/manager/ 2025-10-13 20:48:42.978604 | controller | >f+++++++++ ci-framework-data/logs/crc/crc-logs-artifacts/pods/openstack-operators_watcher-operator-controller-manager-7f554bff7b-mhwvn_a74eb777-ce55-4b07-8f76-a301465e9e78/manager/0.log 2025-10-13 20:48:42.978620 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/ 2025-10-13 20:48:42.978636 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/event-filter.html 2025-10-13 20:48:42.978652 | controller | cL+++++++++ ci-framework-data/logs/openstack-must-gather/latest -> quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73 2025-10-13 20:48:42.978668 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/must-gather.logs 2025-10-13 20:48:42.978684 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/timestamp 2025-10-13 20:48:42.978699 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/ 2025-10-13 20:48:42.978718 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/gather.logs 2025-10-13 20:48:42.978753 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/must-gather.tar.xz 2025-10-13 20:48:42.978770 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/packagemanifests.gz 2025-10-13 20:48:42.978786 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/run.log 2025-10-13 20:48:42.978802 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/version 2025-10-13 20:48:42.978818 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/ 2025-10-13 20:48:42.978834 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.barbican.openstack.org.yaml 2025-10-13 20:48:42.978849 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.baremetal.openstack.org.yaml 2025-10-13 20:48:42.978865 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.cinder.openstack.org.yaml 2025-10-13 20:48:42.978881 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.client.openstack.org.yaml 2025-10-13 20:48:42.978896 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.core.openstack.org.yaml 2025-10-13 20:48:42.978912 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.dataplane.openstack.org.yaml 2025-10-13 20:48:42.978927 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.designate.openstack.org.yaml 2025-10-13 20:48:42.978942 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.glance.openstack.org.yaml 2025-10-13 20:48:42.978957 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.heat.openstack.org.yaml 2025-10-13 20:48:42.978972 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.horizon.openstack.org.yaml 2025-10-13 20:48:42.978991 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.instanceha.openstack.org.yaml 2025-10-13 20:48:42.979007 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.ironic.openstack.org.yaml 2025-10-13 20:48:42.979023 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.keystone.openstack.org.yaml 2025-10-13 20:48:42.979038 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.manila.openstack.org.yaml 2025-10-13 20:48:42.979053 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.mariadb.openstack.org.yaml 2025-10-13 20:48:42.979068 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.memcached.openstack.org.yaml 2025-10-13 20:48:42.979083 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.network.openstack.org.yaml 2025-10-13 20:48:42.979098 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.neutron.openstack.org.yaml 2025-10-13 20:48:42.979113 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.nova.openstack.org.yaml 2025-10-13 20:48:42.979128 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.octavia.openstack.org.yaml 2025-10-13 20:48:42.979143 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.operator.openstack.org.yaml 2025-10-13 20:48:42.979158 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.ovn.openstack.org.yaml 2025-10-13 20:48:42.979174 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.placement.openstack.org.yaml 2025-10-13 20:48:42.979189 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.rabbitmq.com.yaml 2025-10-13 20:48:42.979205 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.rabbitmq.openstack.org.yaml 2025-10-13 20:48:42.979223 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.redis.openstack.org.yaml 2025-10-13 20:48:42.979239 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.swift.openstack.org.yaml 2025-10-13 20:48:42.979255 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.telemetry.openstack.org.yaml 2025-10-13 20:48:42.979270 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.test.openstack.org.yaml 2025-10-13 20:48:42.979285 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.topology.openstack.org.yaml 2025-10-13 20:48:42.979301 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/apiservices/v1beta1.watcher.openstack.org.yaml 2025-10-13 20:48:42.979316 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ 2025-10-13 20:48:42.979332 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ansibletests.test.openstack.org.yaml 2025-10-13 20:48:42.979347 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/autoscalings.telemetry.openstack.org.yaml 2025-10-13 20:48:42.979362 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/barbicanapis.barbican.openstack.org.yaml 2025-10-13 20:48:42.979378 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/barbicankeystonelisteners.barbican.openstack.org.yaml 2025-10-13 20:48:42.979393 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/barbicans.barbican.openstack.org.yaml 2025-10-13 20:48:42.979408 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/barbicanworkers.barbican.openstack.org.yaml 2025-10-13 20:48:42.979423 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/bgpconfigurations.network.openstack.org.yaml 2025-10-13 20:48:42.979439 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ceilometers.telemetry.openstack.org.yaml 2025-10-13 20:48:42.979457 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/cinderapis.cinder.openstack.org.yaml 2025-10-13 20:48:42.979473 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/cinderbackups.cinder.openstack.org.yaml 2025-10-13 20:48:42.979489 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/cinders.cinder.openstack.org.yaml 2025-10-13 20:48:42.979504 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/cinderschedulers.cinder.openstack.org.yaml 2025-10-13 20:48:42.979520 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/cindervolumes.cinder.openstack.org.yaml 2025-10-13 20:48:42.979535 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designateapis.designate.openstack.org.yaml 2025-10-13 20:48:42.979551 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designatebackendbind9s.designate.openstack.org.yaml 2025-10-13 20:48:42.979566 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designatecentrals.designate.openstack.org.yaml 2025-10-13 20:48:42.979582 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designatemdnses.designate.openstack.org.yaml 2025-10-13 20:48:42.979598 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designateproducers.designate.openstack.org.yaml 2025-10-13 20:48:42.979614 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designates.designate.openstack.org.yaml 2025-10-13 20:48:42.979630 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designateunbounds.designate.openstack.org.yaml 2025-10-13 20:48:42.979645 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/designateworkers.designate.openstack.org.yaml 2025-10-13 20:48:42.979661 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/dnsdata.network.openstack.org.yaml 2025-10-13 20:48:42.979677 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/dnsmasqs.network.openstack.org.yaml 2025-10-13 20:48:42.979696 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/galerabackups.mariadb.openstack.org.yaml 2025-10-13 20:48:42.979712 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/galeras.mariadb.openstack.org.yaml 2025-10-13 20:48:42.979744 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/glanceapis.glance.openstack.org.yaml 2025-10-13 20:48:42.979761 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/glances.glance.openstack.org.yaml 2025-10-13 20:48:42.979777 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/heatapis.heat.openstack.org.yaml 2025-10-13 20:48:42.979792 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/heatcfnapis.heat.openstack.org.yaml 2025-10-13 20:48:42.979807 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/heatengines.heat.openstack.org.yaml 2025-10-13 20:48:42.979822 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/heats.heat.openstack.org.yaml 2025-10-13 20:48:42.979837 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/horizons.horizon.openstack.org.yaml 2025-10-13 20:48:42.979853 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/horizontests.test.openstack.org.yaml 2025-10-13 20:48:42.979869 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/instancehas.instanceha.openstack.org.yaml 2025-10-13 20:48:42.979885 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ipsets.network.openstack.org.yaml 2025-10-13 20:48:42.979900 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ironicapis.ironic.openstack.org.yaml 2025-10-13 20:48:42.979916 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ironicconductors.ironic.openstack.org.yaml 2025-10-13 20:48:42.979931 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ironicinspectors.ironic.openstack.org.yaml 2025-10-13 20:48:42.979946 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ironicneutronagents.ironic.openstack.org.yaml 2025-10-13 20:48:42.979965 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ironics.ironic.openstack.org.yaml 2025-10-13 20:48:42.979980 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/keystoneapis.keystone.openstack.org.yaml 2025-10-13 20:48:42.979996 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/keystoneendpoints.keystone.openstack.org.yaml 2025-10-13 20:48:42.980011 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/keystoneservices.keystone.openstack.org.yaml 2025-10-13 20:48:42.980027 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/loggings.telemetry.openstack.org.yaml 2025-10-13 20:48:42.980043 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/manilaapis.manila.openstack.org.yaml 2025-10-13 20:48:42.980058 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/manilas.manila.openstack.org.yaml 2025-10-13 20:48:42.980074 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/manilaschedulers.manila.openstack.org.yaml 2025-10-13 20:48:42.980089 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/manilashares.manila.openstack.org.yaml 2025-10-13 20:48:42.980104 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/mariadbaccounts.mariadb.openstack.org.yaml 2025-10-13 20:48:42.980119 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/mariadbdatabases.mariadb.openstack.org.yaml 2025-10-13 20:48:42.980134 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/memcacheds.memcached.openstack.org.yaml 2025-10-13 20:48:42.980150 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/metricstorages.telemetry.openstack.org.yaml 2025-10-13 20:48:42.980165 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/netconfigs.network.openstack.org.yaml 2025-10-13 20:48:42.980181 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/neutronapis.neutron.openstack.org.yaml 2025-10-13 20:48:42.980200 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/nova.nova.openstack.org.yaml 2025-10-13 20:48:42.980216 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/novaapis.nova.openstack.org.yaml 2025-10-13 20:48:42.980232 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/novacells.nova.openstack.org.yaml 2025-10-13 20:48:42.980248 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/novacomputes.nova.openstack.org.yaml 2025-10-13 20:48:42.980264 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/novaconductors.nova.openstack.org.yaml 2025-10-13 20:48:42.980280 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/novametadata.nova.openstack.org.yaml 2025-10-13 20:48:42.980296 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/novanovncproxies.nova.openstack.org.yaml 2025-10-13 20:48:42.980312 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/novaschedulers.nova.openstack.org.yaml 2025-10-13 20:48:42.980328 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/octaviaamphoracontrollers.octavia.openstack.org.yaml 2025-10-13 20:48:42.980344 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/octaviaapis.octavia.openstack.org.yaml 2025-10-13 20:48:42.980361 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/octaviarsyslogs.octavia.openstack.org.yaml 2025-10-13 20:48:42.980377 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/octavias.octavia.openstack.org.yaml 2025-10-13 20:48:42.980394 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackbaremetalsets.baremetal.openstack.org.yaml 2025-10-13 20:48:42.980410 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackclients.client.openstack.org.yaml 2025-10-13 20:48:42.980426 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackcontrolplanes.core.openstack.org.yaml 2025-10-13 20:48:42.980445 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackdataplanedeployments.dataplane.openstack.org.yaml 2025-10-13 20:48:42.980462 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackdataplanenodesets.dataplane.openstack.org.yaml 2025-10-13 20:48:42.980478 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackdataplaneservices.dataplane.openstack.org.yaml 2025-10-13 20:48:42.980494 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackprovisionservers.baremetal.openstack.org.yaml 2025-10-13 20:48:42.980510 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstacks.operator.openstack.org.yaml 2025-10-13 20:48:42.980526 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/openstackversions.core.openstack.org.yaml 2025-10-13 20:48:42.980541 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ovncontrollers.ovn.openstack.org.yaml 2025-10-13 20:48:42.980558 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ovndbclusters.ovn.openstack.org.yaml 2025-10-13 20:48:42.980573 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/ovnnorthds.ovn.openstack.org.yaml 2025-10-13 20:48:42.980589 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/placementapis.placement.openstack.org.yaml 2025-10-13 20:48:42.980605 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/rabbitmqs.rabbitmq.openstack.org.yaml 2025-10-13 20:48:42.980622 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/redises.redis.openstack.org.yaml 2025-10-13 20:48:42.980637 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/reservations.network.openstack.org.yaml 2025-10-13 20:48:42.980653 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/swiftproxies.swift.openstack.org.yaml 2025-10-13 20:48:42.980669 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/swiftrings.swift.openstack.org.yaml 2025-10-13 20:48:42.980689 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/swifts.swift.openstack.org.yaml 2025-10-13 20:48:42.980705 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/swiftstorages.swift.openstack.org.yaml 2025-10-13 20:48:42.980744 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/telemetries.telemetry.openstack.org.yaml 2025-10-13 20:48:42.980767 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/tempests.test.openstack.org.yaml 2025-10-13 20:48:42.980784 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/tobikoes.test.openstack.org.yaml 2025-10-13 20:48:42.980801 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/topologies.topology.openstack.org.yaml 2025-10-13 20:48:42.980817 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/transporturls.rabbitmq.openstack.org.yaml 2025-10-13 20:48:42.980833 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/watcherapis.watcher.openstack.org.yaml 2025-10-13 20:48:42.980849 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/watcherappliers.watcher.openstack.org.yaml 2025-10-13 20:48:42.980866 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/watcherdecisionengines.watcher.openstack.org.yaml 2025-10-13 20:48:42.980882 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/crd/watchers.watcher.openstack.org.yaml 2025-10-13 20:48:42.980898 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/csv/ 2025-10-13 20:48:42.980915 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/csv/cluster-observability-operator.v1.2.2 2025-10-13 20:48:42.980932 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/csv/kubernetes-nmstate-operator.4.18.0-202509241752 2025-10-13 20:48:42.980948 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/csv/metallb-operator.v4.18.0-202509240837 2025-10-13 20:48:42.980964 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/csv/openstack-operator.v0.5.0 2025-10-13 20:48:42.980988 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/ctlplane/ 2025-10-13 20:48:42.981005 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/ctlplane/endpoints 2025-10-13 20:48:42.981021 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/ctlplane/services 2025-10-13 20:48:42.981038 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/ctlplane/ovn/ 2025-10-13 20:48:42.981068 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/ctlplane/rabbitmq/ 2025-10-13 20:48:42.981087 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/dbs/ 2025-10-13 20:48:42.981104 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/dbs/openstack-kuttl-tests/ 2025-10-13 20:48:42.981120 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/dbs/openstack-kuttl-tests/openstack-cell1-galera-0-openstack_databases.sql.gz 2025-10-13 20:48:42.981137 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/dbs/openstack-kuttl-tests/openstack-galera-0-openstack_databases.sql.gz 2025-10-13 20:48:42.981154 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/ 2025-10-13 20:48:42.981170 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/ 2025-10-13 20:48:42.981187 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/all_resources.log 2025-10-13 20:48:42.981203 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/events.log 2025-10-13 20:48:42.981219 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/nad.log 2025-10-13 20:48:42.981235 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pvc.log 2025-10-13 20:48:42.981251 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/buildconfig/ 2025-10-13 20:48:42.981271 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/cert/ 2025-10-13 20:48:42.981287 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/certificaterequests/ 2025-10-13 20:48:42.981303 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/configmaps/ 2025-10-13 20:48:42.981319 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/cronjobs/ 2025-10-13 20:48:42.981335 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/daemonset/ 2025-10-13 20:48:42.981351 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/deployments/ 2025-10-13 20:48:42.981367 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/deployments/cert-manager-cainjector.yaml 2025-10-13 20:48:42.981383 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/deployments/cert-manager-webhook.yaml 2025-10-13 20:48:42.981400 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/deployments/cert-manager.yaml 2025-10-13 20:48:42.981416 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/imagestream/ 2025-10-13 20:48:42.981433 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/installplans/ 2025-10-13 20:48:42.981449 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/issuer/ 2025-10-13 20:48:42.981466 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/jobs/ 2025-10-13 20:48:42.981482 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/ 2025-10-13 20:48:42.981498 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-7d4cc89fcb-452pc/ 2025-10-13 20:48:42.981518 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-7d4cc89fcb-452pc/cert-manager-7d4cc89fcb-452pc-describe 2025-10-13 20:48:42.981536 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-7d4cc89fcb-452pc/logs/ 2025-10-13 20:48:42.981552 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-7d4cc89fcb-452pc/logs/cert-manager-controller.log 2025-10-13 20:48:42.981630 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-cainjector-7d9f95dbf-866gz/ 2025-10-13 20:48:42.981655 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-cainjector-7d9f95dbf-866gz/cert-manager-cainjector-7d9f95dbf-866gz-describe 2025-10-13 20:48:42.981675 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-cainjector-7d9f95dbf-866gz/logs/ 2025-10-13 20:48:42.981692 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-cainjector-7d9f95dbf-866gz/logs/cert-manager-cainjector.log 2025-10-13 20:48:42.981710 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-webhook-d969966f-qjpx9/ 2025-10-13 20:48:42.981743 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-webhook-d969966f-qjpx9/cert-manager-webhook-d969966f-qjpx9-describe 2025-10-13 20:48:42.981762 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-webhook-d969966f-qjpx9/logs/ 2025-10-13 20:48:42.981779 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/pods/cert-manager-webhook-d969966f-qjpx9/logs/cert-manager-webhook.log 2025-10-13 20:48:42.981796 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/replicaset/ 2025-10-13 20:48:42.981813 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/replicaset/cert-manager-7d4cc89fcb.yaml 2025-10-13 20:48:42.981833 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/replicaset/cert-manager-cainjector-7d9f95dbf.yaml 2025-10-13 20:48:42.981850 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/replicaset/cert-manager-webhook-d969966f.yaml 2025-10-13 20:48:42.981867 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/routes/ 2025-10-13 20:48:42.981884 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/services/ 2025-10-13 20:48:42.981901 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/services/cert-manager-cainjector.yaml 2025-10-13 20:48:42.981918 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/services/cert-manager-webhook.yaml 2025-10-13 20:48:42.981934 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/services/cert-manager.yaml 2025-10-13 20:48:42.981951 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/statefulset/ 2025-10-13 20:48:42.981967 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/cert-manager/subscriptions/ 2025-10-13 20:48:42.981983 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/ 2025-10-13 20:48:42.982000 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/all_resources.log 2025-10-13 20:48:42.982017 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/events.log 2025-10-13 20:48:42.982033 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/nad.log 2025-10-13 20:48:42.982049 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pvc.log 2025-10-13 20:48:42.982065 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/buildconfig/ 2025-10-13 20:48:42.982081 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/cert/ 2025-10-13 20:48:42.982101 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/certificaterequests/ 2025-10-13 20:48:42.982118 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/configmaps/ 2025-10-13 20:48:42.982139 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/cronjobs/ 2025-10-13 20:48:42.982163 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/daemonset/ 2025-10-13 20:48:42.982187 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/daemonset/frr-k8s.yaml 2025-10-13 20:48:42.982211 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/daemonset/speaker.yaml 2025-10-13 20:48:42.982234 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/deployments/ 2025-10-13 20:48:42.982251 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/deployments/controller.yaml 2025-10-13 20:48:42.982267 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/deployments/frr-k8s-webhook-server.yaml 2025-10-13 20:48:42.982284 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/deployments/metallb-operator-controller-manager.yaml 2025-10-13 20:48:42.982301 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/deployments/metallb-operator-webhook-server.yaml 2025-10-13 20:48:42.982318 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/imagestream/ 2025-10-13 20:48:42.982335 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/installplans/ 2025-10-13 20:48:42.982352 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/installplans/install-62qxv 2025-10-13 20:48:42.982368 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/issuer/ 2025-10-13 20:48:42.982388 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/jobs/ 2025-10-13 20:48:42.982407 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/ 2025-10-13 20:48:42.982431 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/controller-68d546b9d8-bgd9l/ 2025-10-13 20:48:42.982455 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/controller-68d546b9d8-bgd9l/controller-68d546b9d8-bgd9l-describe 2025-10-13 20:48:42.982475 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/controller-68d546b9d8-bgd9l/logs/ 2025-10-13 20:48:42.982492 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/controller-68d546b9d8-bgd9l/logs/controller.log.gz 2025-10-13 20:48:42.982510 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/controller-68d546b9d8-bgd9l/logs/kube-rbac-proxy.log 2025-10-13 20:48:42.982527 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/ 2025-10-13 20:48:42.982543 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/frr-k8s-mdf8c-describe 2025-10-13 20:48:42.982560 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/ 2025-10-13 20:48:42.982576 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/controller.log 2025-10-13 20:48:42.982593 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/cp-frr-files.log 2025-10-13 20:48:42.982609 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/cp-metrics.log 2025-10-13 20:48:42.982625 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/cp-reloader.log 2025-10-13 20:48:42.982646 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/frr-metrics.log 2025-10-13 20:48:42.982663 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/frr.log.gz 2025-10-13 20:48:42.982680 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/kube-rbac-proxy-frr.log 2025-10-13 20:48:42.982697 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/kube-rbac-proxy.log 2025-10-13 20:48:42.982713 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-mdf8c/logs/reloader.log 2025-10-13 20:48:42.982749 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-webhook-server-64bf5d555-f68l7/ 2025-10-13 20:48:42.982767 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-webhook-server-64bf5d555-f68l7/frr-k8s-webhook-server-64bf5d555-f68l7-describe 2025-10-13 20:48:42.982784 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-webhook-server-64bf5d555-f68l7/logs/ 2025-10-13 20:48:42.982802 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/frr-k8s-webhook-server-64bf5d555-f68l7/logs/frr-k8s-webhook-server.log 2025-10-13 20:48:42.982819 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-controller-manager-b7789ff7f-4dz47/ 2025-10-13 20:48:42.982835 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-controller-manager-b7789ff7f-4dz47/metallb-operator-controller-manager-b7789ff7f-4dz47-describe 2025-10-13 20:48:42.982853 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-controller-manager-b7789ff7f-4dz47/logs/ 2025-10-13 20:48:42.982871 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-controller-manager-b7789ff7f-4dz47/logs/manager.log 2025-10-13 20:48:42.982899 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-webhook-server-86869d57c5-28vf7/ 2025-10-13 20:48:42.982925 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-webhook-server-86869d57c5-28vf7/metallb-operator-webhook-server-86869d57c5-28vf7-describe 2025-10-13 20:48:42.982951 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-webhook-server-86869d57c5-28vf7/logs/ 2025-10-13 20:48:42.982969 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/metallb-operator-webhook-server-86869d57c5-28vf7/logs/webhook-server.log 2025-10-13 20:48:42.982986 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/speaker-lqgwl/ 2025-10-13 20:48:42.983003 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/speaker-lqgwl/speaker-lqgwl-describe 2025-10-13 20:48:42.983019 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/speaker-lqgwl/logs/ 2025-10-13 20:48:42.983036 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/speaker-lqgwl/logs/kube-rbac-proxy.log 2025-10-13 20:48:42.983052 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/pods/speaker-lqgwl/logs/speaker.log.gz 2025-10-13 20:48:42.983069 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/replicaset/ 2025-10-13 20:48:42.983085 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/replicaset/controller-68d546b9d8.yaml 2025-10-13 20:48:42.983101 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/replicaset/frr-k8s-webhook-server-64bf5d555.yaml 2025-10-13 20:48:42.983118 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/replicaset/metallb-operator-controller-manager-b7789ff7f.yaml 2025-10-13 20:48:42.983134 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/replicaset/metallb-operator-webhook-server-86869d57c5.yaml 2025-10-13 20:48:42.983155 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/routes/ 2025-10-13 20:48:42.983171 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/ 2025-10-13 20:48:42.983188 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/controller-monitor-service.yaml 2025-10-13 20:48:42.983204 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/frr-k8s-monitor-service.yaml 2025-10-13 20:48:42.983221 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/frr-k8s-webhook-service.yaml 2025-10-13 20:48:42.983238 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/metallb-operator-controller-manager-service.yaml 2025-10-13 20:48:42.983255 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/metallb-operator-webhook-server-service.yaml 2025-10-13 20:48:42.983271 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/metallb-operator-webhook-service.yaml 2025-10-13 20:48:42.983288 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/speaker-monitor-service.yaml 2025-10-13 20:48:42.983304 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/services/webhook-service.yaml 2025-10-13 20:48:42.983320 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/statefulset/ 2025-10-13 20:48:42.983336 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/subscriptions/ 2025-10-13 20:48:42.983352 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/metallb-system/subscriptions/metallb-operator-sub 2025-10-13 20:48:42.983369 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/ 2025-10-13 20:48:42.983388 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/all_resources.log 2025-10-13 20:48:42.983405 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/events.log 2025-10-13 20:48:42.983421 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/nad.log 2025-10-13 20:48:42.983437 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pvc.log 2025-10-13 20:48:42.983454 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/buildconfig/ 2025-10-13 20:48:42.983471 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/cert/ 2025-10-13 20:48:42.983489 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/certificaterequests/ 2025-10-13 20:48:42.983507 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/configmaps/ 2025-10-13 20:48:42.983524 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/cronjobs/ 2025-10-13 20:48:42.983541 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/daemonset/ 2025-10-13 20:48:42.983564 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/deployments/ 2025-10-13 20:48:42.983588 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/deployments/control-plane-machine-set-operator.yaml 2025-10-13 20:48:42.983613 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/deployments/machine-api-operator.yaml 2025-10-13 20:48:42.983638 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/imagestream/ 2025-10-13 20:48:42.983661 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/installplans/ 2025-10-13 20:48:42.983690 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/issuer/ 2025-10-13 20:48:42.983712 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/jobs/ 2025-10-13 20:48:42.983749 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/ 2025-10-13 20:48:42.983767 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-zqxbw/ 2025-10-13 20:48:42.983784 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-zqxbw/control-plane-machine-set-operator-78cbb6b69f-zqxbw-describe 2025-10-13 20:48:42.983801 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-zqxbw/logs/ 2025-10-13 20:48:42.983817 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/control-plane-machine-set-operator-78cbb6b69f-zqxbw/logs/control-plane-machine-set-operator.log 2025-10-13 20:48:42.983834 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-zggdj/ 2025-10-13 20:48:42.983851 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-zggdj/machine-api-operator-5694c8668f-zggdj-describe 2025-10-13 20:48:42.983867 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-zggdj/logs/ 2025-10-13 20:48:42.983883 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-zggdj/logs/kube-rbac-proxy.log 2025-10-13 20:48:42.983900 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/pods/machine-api-operator-5694c8668f-zggdj/logs/machine-api-operator.log 2025-10-13 20:48:42.983918 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/replicaset/ 2025-10-13 20:48:42.983938 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/replicaset/control-plane-machine-set-operator-78cbb6b69f.yaml 2025-10-13 20:48:42.983955 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/replicaset/machine-api-operator-5694c8668f.yaml 2025-10-13 20:48:42.983971 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/routes/ 2025-10-13 20:48:42.983987 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/services/ 2025-10-13 20:48:42.984003 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/services/cluster-autoscaler-operator.yaml 2025-10-13 20:48:42.984019 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/services/control-plane-machine-set-operator.yaml 2025-10-13 20:48:42.984035 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/services/machine-api-controllers.yaml 2025-10-13 20:48:42.984051 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/services/machine-api-operator-machine-webhook.yaml 2025-10-13 20:48:42.984067 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/services/machine-api-operator-webhook.yaml 2025-10-13 20:48:42.984083 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/services/machine-api-operator.yaml 2025-10-13 20:48:42.984098 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/statefulset/ 2025-10-13 20:48:42.984114 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-machine-api/subscriptions/ 2025-10-13 20:48:42.984130 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/ 2025-10-13 20:48:42.984145 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/all_resources.log 2025-10-13 20:48:42.984161 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/events.log 2025-10-13 20:48:42.984180 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/nad.log 2025-10-13 20:48:42.984196 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pvc.log 2025-10-13 20:48:42.984211 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/buildconfig/ 2025-10-13 20:48:42.984226 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/cert/ 2025-10-13 20:48:42.984241 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/certificaterequests/ 2025-10-13 20:48:42.984334 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/configmaps/ 2025-10-13 20:48:42.984358 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/cronjobs/ 2025-10-13 20:48:42.984374 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/daemonset/ 2025-10-13 20:48:42.984390 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/deployments/ 2025-10-13 20:48:42.984405 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/deployments/marketplace-operator.yaml 2025-10-13 20:48:42.984422 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/imagestream/ 2025-10-13 20:48:42.984438 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/installplans/ 2025-10-13 20:48:42.984454 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/issuer/ 2025-10-13 20:48:42.984471 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/jobs/ 2025-10-13 20:48:42.984489 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/jobs/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb692b16c.yaml 2025-10-13 20:48:42.984509 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/jobs/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2f2057.yaml 2025-10-13 20:48:42.984526 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/jobs/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2d8e94a.yaml 2025-10-13 20:48:42.984543 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/jobs/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbc47b.yaml 2025-10-13 20:48:42.984565 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/ 2025-10-13 20:48:42.984589 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8/ 2025-10-13 20:48:42.984612 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8-describe 2025-10-13 20:48:42.984636 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8/logs/ 2025-10-13 20:48:42.984652 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8/logs/extract.log 2025-10-13 20:48:42.984669 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8/logs/pull.log 2025-10-13 20:48:42.984684 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/695e9552c02c72940c72621f824780f00ca58086c3badc308bf0a2eb6962nx8/logs/util.log 2025-10-13 20:48:42.984700 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf/ 2025-10-13 20:48:42.984716 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf-describe 2025-10-13 20:48:42.984767 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf/logs/ 2025-10-13 20:48:42.984786 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf/logs/extract.log 2025-10-13 20:48:42.984802 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf/logs/pull.log 2025-10-13 20:48:42.984818 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/8f2f4ee801e5826a37d84a7b1fc4ccbf6b79de668302737d0f1152d8d2v9kdf/logs/util.log 2025-10-13 20:48:42.984834 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh/ 2025-10-13 20:48:42.984850 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh-describe 2025-10-13 20:48:42.984867 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh/logs/ 2025-10-13 20:48:42.984883 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh/logs/extract.log 2025-10-13 20:48:42.984900 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh/logs/pull.log 2025-10-13 20:48:42.984916 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/a6d815214afcb93f379916e45350d3de39072121f31a1d7eaaf6e22c2dkdsvh/logs/util.log 2025-10-13 20:48:42.984932 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/certified-operators-fs4s6/ 2025-10-13 20:48:42.984947 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/certified-operators-fs4s6/certified-operators-fs4s6-describe 2025-10-13 20:48:42.984970 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/certified-operators-fs4s6/logs/ 2025-10-13 20:48:42.984986 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/certified-operators-fs4s6/logs/extract-content.log 2025-10-13 20:48:42.985002 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/certified-operators-fs4s6/logs/extract-utilities.log 2025-10-13 20:48:42.985018 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/certified-operators-fs4s6/logs/registry-server.log 2025-10-13 20:48:42.985034 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-28xqw/ 2025-10-13 20:48:42.985050 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-28xqw/community-operators-28xqw-describe 2025-10-13 20:48:42.985080 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-28xqw/logs/ 2025-10-13 20:48:42.985098 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-28xqw/logs/extract-content.log 2025-10-13 20:48:42.985114 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-28xqw/logs/extract-utilities.log 2025-10-13 20:48:42.985131 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-28xqw/logs/registry-server.log 2025-10-13 20:48:42.985147 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-ppgz7/ 2025-10-13 20:48:42.985163 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-ppgz7/community-operators-ppgz7-describe 2025-10-13 20:48:42.985179 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-ppgz7/logs/ 2025-10-13 20:48:42.985198 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-ppgz7/logs/extract-content.log 2025-10-13 20:48:42.985215 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-ppgz7/logs/extract-utilities.log 2025-10-13 20:48:42.985231 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/community-operators-ppgz7/logs/registry-server.log.gz 2025-10-13 20:48:42.985246 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4/ 2025-10-13 20:48:42.985262 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4-describe 2025-10-13 20:48:42.985278 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4/logs/ 2025-10-13 20:48:42.985293 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4/logs/extract.log 2025-10-13 20:48:42.985308 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4/logs/pull.log 2025-10-13 20:48:42.985324 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/fa9831ede5d93c33d525b70ce6ddf94e500d80992af75a3305fe98835cbw4j4/logs/util.log 2025-10-13 20:48:42.985339 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-mxlh6/ 2025-10-13 20:48:42.985354 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-mxlh6/marketplace-operator-79b997595-mxlh6-describe 2025-10-13 20:48:42.985370 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-mxlh6/logs/ 2025-10-13 20:48:42.985389 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/marketplace-operator-79b997595-mxlh6/logs/marketplace-operator.log 2025-10-13 20:48:42.985404 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-marketplace-xr5dg/ 2025-10-13 20:48:42.985422 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-marketplace-xr5dg/redhat-marketplace-xr5dg-describe 2025-10-13 20:48:42.985445 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-marketplace-xr5dg/logs/ 2025-10-13 20:48:42.985468 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-marketplace-xr5dg/logs/extract-content.log 2025-10-13 20:48:42.985487 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-marketplace-xr5dg/logs/extract-utilities.log 2025-10-13 20:48:42.985504 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-marketplace-xr5dg/logs/registry-server.log.gz 2025-10-13 20:48:42.985520 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-operators-pdzb2/ 2025-10-13 20:48:42.985536 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-operators-pdzb2/redhat-operators-pdzb2-describe 2025-10-13 20:48:42.985552 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-operators-pdzb2/logs/ 2025-10-13 20:48:42.985569 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-operators-pdzb2/logs/extract-content.log 2025-10-13 20:48:42.985585 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-operators-pdzb2/logs/extract-utilities.log 2025-10-13 20:48:42.985601 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/pods/redhat-operators-pdzb2/logs/registry-server.log.gz 2025-10-13 20:48:42.985617 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/replicaset/ 2025-10-13 20:48:42.985636 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/replicaset/marketplace-operator-79b997595.yaml 2025-10-13 20:48:42.985653 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/routes/ 2025-10-13 20:48:42.985670 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/services/ 2025-10-13 20:48:42.985686 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/services/certified-operators.yaml 2025-10-13 20:48:42.985701 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/services/community-operators.yaml 2025-10-13 20:48:42.985717 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/services/marketplace-operator-metrics.yaml 2025-10-13 20:48:42.985755 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/services/redhat-marketplace.yaml 2025-10-13 20:48:42.985772 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/services/redhat-operators.yaml 2025-10-13 20:48:42.985788 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/statefulset/ 2025-10-13 20:48:42.985805 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-marketplace/subscriptions/ 2025-10-13 20:48:42.985821 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/ 2025-10-13 20:48:42.985837 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/all_resources.log 2025-10-13 20:48:42.985852 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/events.log 2025-10-13 20:48:42.985869 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/nad.log 2025-10-13 20:48:42.985888 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pvc.log 2025-10-13 20:48:42.985904 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/buildconfig/ 2025-10-13 20:48:42.985920 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/cert/ 2025-10-13 20:48:42.985935 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/certificaterequests/ 2025-10-13 20:48:42.985950 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/configmaps/ 2025-10-13 20:48:42.985966 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/cronjobs/ 2025-10-13 20:48:42.985981 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/daemonset/ 2025-10-13 20:48:42.985996 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/daemonset/nmstate-handler.yaml 2025-10-13 20:48:42.986012 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/deployments/ 2025-10-13 20:48:42.986027 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/deployments/nmstate-console-plugin.yaml 2025-10-13 20:48:42.986043 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/deployments/nmstate-metrics.yaml 2025-10-13 20:48:42.986059 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/deployments/nmstate-operator.yaml 2025-10-13 20:48:42.986074 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/deployments/nmstate-webhook.yaml 2025-10-13 20:48:42.986090 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/imagestream/ 2025-10-13 20:48:42.986106 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/installplans/ 2025-10-13 20:48:42.986124 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/installplans/install-t4fkl 2025-10-13 20:48:42.986140 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/issuer/ 2025-10-13 20:48:42.986156 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/jobs/ 2025-10-13 20:48:42.986171 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/ 2025-10-13 20:48:42.986187 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-console-plugin-6b874cbd85-mxxgp/ 2025-10-13 20:48:42.986203 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-console-plugin-6b874cbd85-mxxgp/nmstate-console-plugin-6b874cbd85-mxxgp-describe 2025-10-13 20:48:42.986218 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-console-plugin-6b874cbd85-mxxgp/logs/ 2025-10-13 20:48:42.986234 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-console-plugin-6b874cbd85-mxxgp/logs/nmstate-console-plugin.log 2025-10-13 20:48:42.986250 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-handler-bdw24/ 2025-10-13 20:48:42.986265 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-handler-bdw24/nmstate-handler-bdw24-describe 2025-10-13 20:48:42.986281 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-handler-bdw24/logs/ 2025-10-13 20:48:42.986298 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-handler-bdw24/logs/nmstate-handler.log 2025-10-13 20:48:42.986318 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-metrics-fdff9cb8d-2dk9z/ 2025-10-13 20:48:42.986339 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-metrics-fdff9cb8d-2dk9z/nmstate-metrics-fdff9cb8d-2dk9z-describe 2025-10-13 20:48:42.986363 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-metrics-fdff9cb8d-2dk9z/logs/ 2025-10-13 20:48:42.986387 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-metrics-fdff9cb8d-2dk9z/logs/kube-rbac-proxy.log 2025-10-13 20:48:42.986410 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-metrics-fdff9cb8d-2dk9z/logs/nmstate-metrics.log 2025-10-13 20:48:42.986434 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-operator-858ddd8f98-px675/ 2025-10-13 20:48:42.986477 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-operator-858ddd8f98-px675/nmstate-operator-858ddd8f98-px675-describe 2025-10-13 20:48:42.986513 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-operator-858ddd8f98-px675/logs/ 2025-10-13 20:48:42.986537 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-operator-858ddd8f98-px675/logs/nmstate-operator.log 2025-10-13 20:48:42.986561 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-webhook-6cdbc54649-vlxwz/ 2025-10-13 20:48:42.986585 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-webhook-6cdbc54649-vlxwz/nmstate-webhook-6cdbc54649-vlxwz-describe 2025-10-13 20:48:42.986607 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-webhook-6cdbc54649-vlxwz/logs/ 2025-10-13 20:48:42.986629 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/pods/nmstate-webhook-6cdbc54649-vlxwz/logs/nmstate-webhook.log 2025-10-13 20:48:42.986650 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/replicaset/ 2025-10-13 20:48:42.986666 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/replicaset/nmstate-console-plugin-6b874cbd85.yaml 2025-10-13 20:48:42.986682 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/replicaset/nmstate-metrics-fdff9cb8d.yaml 2025-10-13 20:48:42.986703 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/replicaset/nmstate-operator-858ddd8f98.yaml 2025-10-13 20:48:42.986719 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/replicaset/nmstate-webhook-6cdbc54649.yaml 2025-10-13 20:48:42.986757 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/routes/ 2025-10-13 20:48:42.986774 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/services/ 2025-10-13 20:48:42.986790 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/services/nmstate-console-plugin.yaml 2025-10-13 20:48:42.986805 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/services/nmstate-monitor.yaml 2025-10-13 20:48:42.986820 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/services/nmstate-webhook.yaml 2025-10-13 20:48:42.986835 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/statefulset/ 2025-10-13 20:48:42.986850 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/subscriptions/ 2025-10-13 20:48:42.986865 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-nmstate/subscriptions/kubernetes-nmstate-operator 2025-10-13 20:48:42.986880 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/ 2025-10-13 20:48:42.986895 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/all_resources.log 2025-10-13 20:48:42.986910 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/events.log 2025-10-13 20:48:42.986925 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/nad.log 2025-10-13 20:48:42.986943 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pvc.log 2025-10-13 20:48:42.986959 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/buildconfig/ 2025-10-13 20:48:42.986974 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/cert/ 2025-10-13 20:48:42.986989 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/certificaterequests/ 2025-10-13 20:48:42.987005 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/configmaps/ 2025-10-13 20:48:42.987021 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/cronjobs/ 2025-10-13 20:48:42.987037 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/daemonset/ 2025-10-13 20:48:42.987053 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/deployments/ 2025-10-13 20:48:42.987069 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/deployments/obo-prometheus-operator-admission-webhook.yaml 2025-10-13 20:48:42.987085 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/deployments/obo-prometheus-operator.yaml 2025-10-13 20:48:42.987101 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/deployments/observability-operator.yaml 2025-10-13 20:48:42.987116 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/deployments/perses-operator.yaml 2025-10-13 20:48:42.987131 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/imagestream/ 2025-10-13 20:48:42.987147 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/installplans/ 2025-10-13 20:48:42.987162 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/installplans/install-h29ng 2025-10-13 20:48:42.987181 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/issuer/ 2025-10-13 20:48:42.987197 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/jobs/ 2025-10-13 20:48:42.987214 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/ 2025-10-13 20:48:42.987229 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-7c8cf85677-4k7vt/ 2025-10-13 20:48:42.987244 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-7c8cf85677-4k7vt/obo-prometheus-operator-7c8cf85677-4k7vt-describe 2025-10-13 20:48:42.987260 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-7c8cf85677-4k7vt/logs/ 2025-10-13 20:48:42.987276 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-7c8cf85677-4k7vt/logs/prometheus-operator.log 2025-10-13 20:48:42.987292 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-8jjmk/ 2025-10-13 20:48:42.987309 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-8jjmk/obo-prometheus-operator-admission-webhook-8566c88866-8jjmk-describe 2025-10-13 20:48:42.987325 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-8jjmk/logs/ 2025-10-13 20:48:42.987341 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-8jjmk/logs/prometheus-operator-admission-webhook.log 2025-10-13 20:48:42.987358 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-c5nlk/ 2025-10-13 20:48:42.987382 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-c5nlk/obo-prometheus-operator-admission-webhook-8566c88866-c5nlk-describe 2025-10-13 20:48:42.987411 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-c5nlk/logs/ 2025-10-13 20:48:42.987435 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/obo-prometheus-operator-admission-webhook-8566c88866-c5nlk/logs/prometheus-operator-admission-webhook.log 2025-10-13 20:48:42.987454 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/observability-operator-cc5f78dfc-jdbm4/ 2025-10-13 20:48:42.987473 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/observability-operator-cc5f78dfc-jdbm4/observability-operator-cc5f78dfc-jdbm4-describe 2025-10-13 20:48:42.987491 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/observability-operator-cc5f78dfc-jdbm4/logs/ 2025-10-13 20:48:42.987507 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/observability-operator-cc5f78dfc-jdbm4/logs/operator.log 2025-10-13 20:48:42.987523 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/perses-operator-54bc95c9fb-wxw8s/ 2025-10-13 20:48:42.987538 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/perses-operator-54bc95c9fb-wxw8s/perses-operator-54bc95c9fb-wxw8s-describe 2025-10-13 20:48:42.987554 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/perses-operator-54bc95c9fb-wxw8s/logs/ 2025-10-13 20:48:42.987569 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/pods/perses-operator-54bc95c9fb-wxw8s/logs/perses-operator.log 2025-10-13 20:48:42.987585 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/replicaset/ 2025-10-13 20:48:42.987600 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/replicaset/obo-prometheus-operator-7c8cf85677.yaml 2025-10-13 20:48:42.987616 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/replicaset/obo-prometheus-operator-admission-webhook-8566c88866.yaml 2025-10-13 20:48:42.987635 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/replicaset/observability-operator-cc5f78dfc.yaml 2025-10-13 20:48:42.987655 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/replicaset/perses-operator-54bc95c9fb.yaml 2025-10-13 20:48:42.987679 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/routes/ 2025-10-13 20:48:42.987703 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/services/ 2025-10-13 20:48:42.987755 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/services/obo-prometheus-operator-admission-webhook-service.yaml 2025-10-13 20:48:42.987784 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/services/obo-prometheus-operator-admission-webhook.yaml 2025-10-13 20:48:42.987808 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/services/obo-prometheus-operator.yaml 2025-10-13 20:48:42.987831 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/services/observability-operator.yaml 2025-10-13 20:48:42.987855 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/statefulset/ 2025-10-13 20:48:42.987878 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/subscriptions/ 2025-10-13 20:48:42.987901 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openshift-operators/subscriptions/cluster-observability-operator 2025-10-13 20:48:42.987919 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/ 2025-10-13 20:48:42.987936 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/all_resources.log 2025-10-13 20:48:42.987953 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/events.log.gz 2025-10-13 20:48:42.987973 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/nad.log 2025-10-13 20:48:42.987990 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pvc.log 2025-10-13 20:48:42.988006 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/buildconfig/ 2025-10-13 20:48:42.988022 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/ 2025-10-13 20:48:42.988037 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/barbican-internal-svc.yaml 2025-10-13 20:48:42.988053 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/barbican-public-route.yaml 2025-10-13 20:48:42.988069 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/barbican-public-svc.yaml 2025-10-13 20:48:42.988086 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/ceilometer-internal-svc.yaml 2025-10-13 20:48:42.988102 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/cinder-internal-svc.yaml 2025-10-13 20:48:42.988126 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/cinder-public-route.yaml 2025-10-13 20:48:42.988150 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/cinder-public-svc.yaml 2025-10-13 20:48:42.988168 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/galera-openstack-cell1-svc.yaml 2025-10-13 20:48:42.988185 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/galera-openstack-svc.yaml 2025-10-13 20:48:42.988201 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/glance-default-internal-svc.yaml 2025-10-13 20:48:42.988221 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/glance-default-public-route.yaml 2025-10-13 20:48:42.988238 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/glance-default-public-svc.yaml 2025-10-13 20:48:42.988254 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/keystone-internal-svc.yaml 2025-10-13 20:48:42.988270 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/keystone-public-route.yaml 2025-10-13 20:48:42.988286 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/keystone-public-svc.yaml 2025-10-13 20:48:42.988303 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/kube-state-metrics-svc.yaml 2025-10-13 20:48:42.988319 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/memcached-svc.yaml 2025-10-13 20:48:42.988336 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/neutron-internal-svc.yaml 2025-10-13 20:48:42.988353 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/neutron-ovndbs.yaml 2025-10-13 20:48:42.988369 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/neutron-public-route.yaml 2025-10-13 20:48:42.988385 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/neutron-public-svc.yaml 2025-10-13 20:48:42.988401 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/nova-internal-svc.yaml 2025-10-13 20:48:42.988417 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/nova-metadata-internal-svc.yaml 2025-10-13 20:48:42.988433 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/nova-novncproxy-cell1-public-route.yaml 2025-10-13 20:48:42.988449 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/nova-novncproxy-cell1-public-svc.yaml 2025-10-13 20:48:42.988468 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/nova-novncproxy-cell1-vencrypt.yaml 2025-10-13 20:48:42.988484 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/nova-public-route.yaml 2025-10-13 20:48:42.988500 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/nova-public-svc.yaml 2025-10-13 20:48:42.988516 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/ovn-metrics.yaml 2025-10-13 20:48:42.988532 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/ovndbcluster-nb-ovndbs.yaml 2025-10-13 20:48:42.988548 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/ovndbcluster-sb-ovndbs.yaml 2025-10-13 20:48:42.988564 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/ovnnorthd-ovndbs.yaml 2025-10-13 20:48:42.988581 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/placement-internal-svc.yaml 2025-10-13 20:48:42.988597 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/placement-public-route.yaml 2025-10-13 20:48:42.988614 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/placement-public-svc.yaml 2025-10-13 20:48:42.988630 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/rabbitmq-cell1-svc.yaml 2025-10-13 20:48:42.988646 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/rabbitmq-svc.yaml 2025-10-13 20:48:42.988662 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/rootca-internal.yaml 2025-10-13 20:48:42.988678 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/rootca-libvirt.yaml 2025-10-13 20:48:42.988700 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/rootca-ovn.yaml 2025-10-13 20:48:42.988717 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/rootca-public.yaml 2025-10-13 20:48:42.988763 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/swift-internal-svc.yaml 2025-10-13 20:48:42.988782 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/swift-public-route.yaml 2025-10-13 20:48:42.988798 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cert/swift-public-svc.yaml 2025-10-13 20:48:42.988814 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ 2025-10-13 20:48:42.988830 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/barbican-internal-svc-1.yaml 2025-10-13 20:48:42.988846 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/barbican-internal-svc-2.yaml 2025-10-13 20:48:42.988862 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/barbican-public-route-1.yaml 2025-10-13 20:48:42.988878 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/barbican-public-route-2.yaml 2025-10-13 20:48:42.988894 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/barbican-public-svc-1.yaml 2025-10-13 20:48:42.988910 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/barbican-public-svc-2.yaml 2025-10-13 20:48:42.988926 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ceilometer-internal-svc-1.yaml 2025-10-13 20:48:42.988942 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ceilometer-internal-svc-2.yaml 2025-10-13 20:48:42.988963 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/cinder-internal-svc-1.yaml 2025-10-13 20:48:42.988979 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/cinder-internal-svc-2.yaml 2025-10-13 20:48:42.988995 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/cinder-public-route-1.yaml 2025-10-13 20:48:42.989011 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/cinder-public-route-2.yaml 2025-10-13 20:48:42.989027 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/cinder-public-svc-1.yaml 2025-10-13 20:48:42.989042 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/cinder-public-svc-2.yaml 2025-10-13 20:48:42.989058 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/galera-openstack-cell1-svc-1.yaml 2025-10-13 20:48:42.989094 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/galera-openstack-cell1-svc-2.yaml 2025-10-13 20:48:42.989114 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/galera-openstack-svc-1.yaml 2025-10-13 20:48:42.989139 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/galera-openstack-svc-2.yaml 2025-10-13 20:48:42.989163 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/glance-default-internal-svc-1.yaml 2025-10-13 20:48:42.989183 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/glance-default-internal-svc-2.yaml 2025-10-13 20:48:42.989201 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/glance-default-public-route-1.yaml 2025-10-13 20:48:42.989222 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/glance-default-public-route-2.yaml 2025-10-13 20:48:42.989238 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/glance-default-public-svc-1.yaml 2025-10-13 20:48:42.989253 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/glance-default-public-svc-2.yaml 2025-10-13 20:48:42.989268 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/keystone-internal-svc-1.yaml 2025-10-13 20:48:42.989283 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/keystone-internal-svc-2.yaml 2025-10-13 20:48:42.989299 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/keystone-public-route-1.yaml 2025-10-13 20:48:42.989314 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/keystone-public-route-2.yaml 2025-10-13 20:48:42.989329 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/keystone-public-svc-1.yaml 2025-10-13 20:48:42.989344 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/keystone-public-svc-2.yaml 2025-10-13 20:48:42.989359 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/kube-state-metrics-svc-1.yaml 2025-10-13 20:48:42.989374 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/kube-state-metrics-svc-2.yaml 2025-10-13 20:48:42.989389 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/memcached-svc-1.yaml 2025-10-13 20:48:42.989405 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/memcached-svc-2.yaml 2025-10-13 20:48:42.989423 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-internal-svc-1.yaml 2025-10-13 20:48:42.989439 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-internal-svc-2.yaml 2025-10-13 20:48:42.989518 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-ovndbs-1.yaml 2025-10-13 20:48:42.989543 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-ovndbs-2.yaml 2025-10-13 20:48:42.989560 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-public-route-1.yaml 2025-10-13 20:48:42.989576 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-public-route-2.yaml 2025-10-13 20:48:42.989592 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-public-svc-1.yaml 2025-10-13 20:48:42.989607 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/neutron-public-svc-2.yaml 2025-10-13 20:48:42.989623 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-internal-svc-1.yaml 2025-10-13 20:48:42.989639 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-internal-svc-2.yaml 2025-10-13 20:48:42.989654 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-novncproxy-cell1-public-route-1.yaml 2025-10-13 20:48:42.989670 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-novncproxy-cell1-public-route-2.yaml 2025-10-13 20:48:42.989685 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-novncproxy-cell1-public-svc-1.yaml 2025-10-13 20:48:42.989700 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-novncproxy-cell1-public-svc-2.yaml 2025-10-13 20:48:42.989719 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-novncproxy-cell1-vencrypt-1.yaml 2025-10-13 20:48:42.989753 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-novncproxy-cell1-vencrypt-2.yaml 2025-10-13 20:48:42.989770 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-public-route-1.yaml 2025-10-13 20:48:42.989785 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-public-route-2.yaml 2025-10-13 20:48:42.989801 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-public-svc-1.yaml 2025-10-13 20:48:42.989816 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/nova-public-svc-2.yaml 2025-10-13 20:48:42.989832 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovn-metrics-1.yaml 2025-10-13 20:48:42.989848 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovn-metrics-2.yaml 2025-10-13 20:48:42.989865 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovndbcluster-nb-ovndbs-1.yaml 2025-10-13 20:48:42.989880 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovndbcluster-nb-ovndbs-2.yaml 2025-10-13 20:48:42.989896 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovndbcluster-sb-ovndbs-1.yaml 2025-10-13 20:48:42.989911 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovndbcluster-sb-ovndbs-2.yaml 2025-10-13 20:48:42.989927 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovnnorthd-ovndbs-1.yaml 2025-10-13 20:48:42.989945 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/ovnnorthd-ovndbs-2.yaml 2025-10-13 20:48:42.989961 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/placement-internal-svc-1.yaml 2025-10-13 20:48:42.989977 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/placement-internal-svc-2.yaml 2025-10-13 20:48:42.989992 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/placement-public-route-1.yaml 2025-10-13 20:48:42.990007 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/placement-public-route-2.yaml 2025-10-13 20:48:42.990022 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/placement-public-svc-1.yaml 2025-10-13 20:48:42.990039 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/placement-public-svc-2.yaml 2025-10-13 20:48:42.990055 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rabbitmq-cell1-svc-1.yaml 2025-10-13 20:48:42.990071 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rabbitmq-cell1-svc-2.yaml 2025-10-13 20:48:42.990086 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rabbitmq-svc-1.yaml 2025-10-13 20:48:42.990102 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rabbitmq-svc-2.yaml 2025-10-13 20:48:42.990123 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-internal-1.yaml 2025-10-13 20:48:42.990147 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-internal-2.yaml 2025-10-13 20:48:42.990175 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-libvirt-1.yaml 2025-10-13 20:48:42.990192 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-libvirt-2.yaml 2025-10-13 20:48:42.990209 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-ovn-1.yaml 2025-10-13 20:48:42.990225 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-ovn-2.yaml 2025-10-13 20:48:42.990241 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-public-1.yaml 2025-10-13 20:48:42.990257 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/rootca-public-2.yaml 2025-10-13 20:48:42.990273 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/swift-internal-svc-1.yaml 2025-10-13 20:48:42.990289 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/swift-internal-svc-2.yaml 2025-10-13 20:48:42.990304 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/swift-public-route-1.yaml 2025-10-13 20:48:42.990319 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/swift-public-route-2.yaml 2025-10-13 20:48:42.990335 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/swift-public-svc-1.yaml 2025-10-13 20:48:42.990350 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/certificaterequests/swift-public-svc-2.yaml 2025-10-13 20:48:42.990367 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/ 2025-10-13 20:48:42.990408 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/dns-swift-storage-0.yaml 2025-10-13 20:48:42.990446 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/infra-instanceha-config.yaml 2025-10-13 20:48:42.990467 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/ovndbcluster-nb-config.yaml 2025-10-13 20:48:42.990484 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/ovndbcluster-nb-scripts.yaml 2025-10-13 20:48:42.990501 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/ovndbcluster-sb-config.yaml 2025-10-13 20:48:42.990517 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/ovndbcluster-sb-scripts.yaml 2025-10-13 20:48:42.990533 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/ovnnorthd-config.yaml 2025-10-13 20:48:42.990549 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/ovnnorthd-scripts.yaml 2025-10-13 20:48:42.990565 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/rabbitmq-cell1-config-data.yaml 2025-10-13 20:48:42.990581 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/rabbitmq-cell1-plugins-conf.yaml 2025-10-13 20:48:42.990597 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/rabbitmq-cell1-server-conf.yaml 2025-10-13 20:48:42.990613 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/rabbitmq-config-data.yaml 2025-10-13 20:48:42.990629 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/rabbitmq-plugins-conf.yaml 2025-10-13 20:48:42.990645 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/rabbitmq-server-conf.yaml 2025-10-13 20:48:42.990660 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/swift-ring-config-data.yaml 2025-10-13 20:48:42.990679 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/swift-ring-files.yaml 2025-10-13 20:48:42.990695 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/swift-ring-scripts.yaml 2025-10-13 20:48:42.990710 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/configmaps/swift-storage-config-data.yaml 2025-10-13 20:48:42.990743 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cronjobs/ 2025-10-13 20:48:42.990764 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cronjobs/cinder-db-purge.yaml 2025-10-13 20:48:42.990781 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cronjobs/glance-db-purge.yaml 2025-10-13 20:48:42.990797 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cronjobs/keystone-cron.yaml 2025-10-13 20:48:42.990812 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cronjobs/nova-cell0-db-purge.yaml 2025-10-13 20:48:42.990828 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/cronjobs/nova-cell1-db-purge.yaml 2025-10-13 20:48:42.990844 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ 2025-10-13 20:48:42.990859 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicanapis.barbican.openstack.org/ 2025-10-13 20:48:42.990875 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicanapis.barbican.openstack.org/barbican-api.yaml 2025-10-13 20:48:42.990891 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicankeystonelisteners.barbican.openstack.org/ 2025-10-13 20:48:42.990906 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicankeystonelisteners.barbican.openstack.org/barbican-keystone-listener.yaml 2025-10-13 20:48:42.990926 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicans.barbican.openstack.org/ 2025-10-13 20:48:42.990942 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicans.barbican.openstack.org/barbican.yaml 2025-10-13 20:48:42.990958 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicanworkers.barbican.openstack.org/ 2025-10-13 20:48:42.990974 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/barbicanworkers.barbican.openstack.org/barbican-worker.yaml 2025-10-13 20:48:42.990990 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ceilometers.telemetry.openstack.org/ 2025-10-13 20:48:42.991005 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ceilometers.telemetry.openstack.org/ceilometer.yaml 2025-10-13 20:48:42.991021 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cinderapis.cinder.openstack.org/ 2025-10-13 20:48:42.991036 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cinderapis.cinder.openstack.org/cinder-api.yaml 2025-10-13 20:48:42.991052 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cinders.cinder.openstack.org/ 2025-10-13 20:48:42.991068 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cinders.cinder.openstack.org/cinder.yaml 2025-10-13 20:48:42.991084 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cinderschedulers.cinder.openstack.org/ 2025-10-13 20:48:42.991099 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cinderschedulers.cinder.openstack.org/cinder-scheduler.yaml 2025-10-13 20:48:42.991125 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cindervolumes.cinder.openstack.org/ 2025-10-13 20:48:42.991169 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/cindervolumes.cinder.openstack.org/cinder-volume-volume1.yaml 2025-10-13 20:48:42.991190 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/dnsdata.network.openstack.org/ 2025-10-13 20:48:42.991208 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/dnsdata.network.openstack.org/dns-swift-storage-0.yaml 2025-10-13 20:48:42.991225 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/dnsdata.network.openstack.org/dnsmasq-svc.yaml 2025-10-13 20:48:42.991241 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/dnsmasqs.network.openstack.org/ 2025-10-13 20:48:42.991256 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/dnsmasqs.network.openstack.org/dnsmasq.yaml 2025-10-13 20:48:42.991272 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/galeras.mariadb.openstack.org/ 2025-10-13 20:48:42.991287 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/galeras.mariadb.openstack.org/openstack-cell1.yaml 2025-10-13 20:48:42.991303 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/galeras.mariadb.openstack.org/openstack.yaml 2025-10-13 20:48:42.991319 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/glanceapis.glance.openstack.org/ 2025-10-13 20:48:42.991334 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/glanceapis.glance.openstack.org/glance-default-external.yaml 2025-10-13 20:48:42.991350 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/glanceapis.glance.openstack.org/glance-default-internal.yaml 2025-10-13 20:48:42.991365 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/glances.glance.openstack.org/ 2025-10-13 20:48:42.991381 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/glances.glance.openstack.org/glance.yaml 2025-10-13 20:48:42.991400 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneapis.keystone.openstack.org/ 2025-10-13 20:48:42.991416 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneapis.keystone.openstack.org/keystone.yaml 2025-10-13 20:48:42.991432 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/ 2025-10-13 20:48:42.991448 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/barbican-api.yaml 2025-10-13 20:48:42.991463 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/cinderv3.yaml 2025-10-13 20:48:42.991479 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/glance-default-external.yaml 2025-10-13 20:48:42.991494 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/glance-default-internal.yaml 2025-10-13 20:48:42.991510 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/neutron.yaml 2025-10-13 20:48:42.991525 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/nova.yaml 2025-10-13 20:48:42.991541 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/placement.yaml 2025-10-13 20:48:42.991556 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneendpoints.keystone.openstack.org/swift.yaml 2025-10-13 20:48:42.991572 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/ 2025-10-13 20:48:42.991588 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/barbican.yaml 2025-10-13 20:48:42.991607 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/ceilometer.yaml 2025-10-13 20:48:42.991623 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/cinderv3.yaml 2025-10-13 20:48:42.991639 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/glance.yaml 2025-10-13 20:48:42.991654 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/neutron.yaml 2025-10-13 20:48:42.991754 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/nova.yaml 2025-10-13 20:48:42.991776 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/placement.yaml 2025-10-13 20:48:42.991793 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/keystoneservices.keystone.openstack.org/swift.yaml 2025-10-13 20:48:42.991811 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/ 2025-10-13 20:48:42.991827 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/barbican.yaml 2025-10-13 20:48:42.991843 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/cinder.yaml 2025-10-13 20:48:42.991858 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/glance.yaml 2025-10-13 20:48:42.991874 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/keystone.yaml 2025-10-13 20:48:42.991890 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/neutron.yaml 2025-10-13 20:48:42.991909 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/nova-api.yaml 2025-10-13 20:48:42.991926 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/nova-cell0.yaml 2025-10-13 20:48:42.991941 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/nova-cell1.yaml 2025-10-13 20:48:42.991957 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbaccounts.mariadb.openstack.org/placement.yaml 2025-10-13 20:48:42.991973 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/ 2025-10-13 20:48:42.991988 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/barbican.yaml 2025-10-13 20:48:42.992007 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/cinder.yaml 2025-10-13 20:48:42.992024 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/glance.yaml 2025-10-13 20:48:42.992064 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/keystone.yaml 2025-10-13 20:48:42.992096 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/neutron.yaml 2025-10-13 20:48:42.992126 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/nova-api.yaml 2025-10-13 20:48:42.992163 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/nova-cell0.yaml 2025-10-13 20:48:42.992196 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/nova-cell1.yaml 2025-10-13 20:48:42.992241 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/mariadbdatabases.mariadb.openstack.org/placement.yaml 2025-10-13 20:48:42.992267 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/memcacheds.memcached.openstack.org/ 2025-10-13 20:48:42.992288 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/memcacheds.memcached.openstack.org/memcached.yaml 2025-10-13 20:48:42.992305 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/netconfigs.network.openstack.org/ 2025-10-13 20:48:42.992321 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/netconfigs.network.openstack.org/netconfig.yaml 2025-10-13 20:48:42.992337 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/neutronapis.neutron.openstack.org/ 2025-10-13 20:48:42.992352 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/neutronapis.neutron.openstack.org/neutron.yaml 2025-10-13 20:48:42.992368 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/nova.nova.openstack.org/ 2025-10-13 20:48:42.992383 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/nova.nova.openstack.org/nova.yaml 2025-10-13 20:48:42.992399 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novaapis.nova.openstack.org/ 2025-10-13 20:48:42.992415 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novaapis.nova.openstack.org/nova-api.yaml 2025-10-13 20:48:42.992430 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novacells.nova.openstack.org/ 2025-10-13 20:48:42.992446 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novacells.nova.openstack.org/nova-cell0.yaml 2025-10-13 20:48:42.992468 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novacells.nova.openstack.org/nova-cell1.yaml 2025-10-13 20:48:42.992484 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novaconductors.nova.openstack.org/ 2025-10-13 20:48:42.992500 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novaconductors.nova.openstack.org/nova-cell0-conductor.yaml 2025-10-13 20:48:42.992516 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novaconductors.nova.openstack.org/nova-cell1-conductor.yaml 2025-10-13 20:48:42.992533 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novametadata.nova.openstack.org/ 2025-10-13 20:48:42.992548 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novametadata.nova.openstack.org/nova-metadata.yaml 2025-10-13 20:48:42.992564 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novanovncproxies.nova.openstack.org/ 2025-10-13 20:48:42.992580 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novanovncproxies.nova.openstack.org/nova-cell1-novncproxy.yaml 2025-10-13 20:48:42.992596 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novaschedulers.nova.openstack.org/ 2025-10-13 20:48:42.992612 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/novaschedulers.nova.openstack.org/nova-scheduler.yaml 2025-10-13 20:48:42.992628 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/openstackclients.client.openstack.org/ 2025-10-13 20:48:42.992644 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/openstackclients.client.openstack.org/openstackclient.yaml 2025-10-13 20:48:42.992659 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/openstackcontrolplanes.core.openstack.org/ 2025-10-13 20:48:42.992675 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/openstackcontrolplanes.core.openstack.org/openstack.yaml 2025-10-13 20:48:42.992694 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/openstackversions.core.openstack.org/ 2025-10-13 20:48:42.992710 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/openstackversions.core.openstack.org/openstack.yaml 2025-10-13 20:48:42.992753 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ovndbclusters.ovn.openstack.org/ 2025-10-13 20:48:42.992776 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ovndbclusters.ovn.openstack.org/ovndbcluster-nb.yaml 2025-10-13 20:48:42.992793 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ovndbclusters.ovn.openstack.org/ovndbcluster-sb.yaml 2025-10-13 20:48:42.992809 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ovnnorthds.ovn.openstack.org/ 2025-10-13 20:48:42.992824 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/ovnnorthds.ovn.openstack.org/ovnnorthd.yaml 2025-10-13 20:48:42.992840 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/placementapis.placement.openstack.org/ 2025-10-13 20:48:42.992856 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/placementapis.placement.openstack.org/placement.yaml 2025-10-13 20:48:42.992872 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/rabbitmqclusters.rabbitmq.com/ 2025-10-13 20:48:42.992888 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/rabbitmqclusters.rabbitmq.com/rabbitmq-cell1.yaml 2025-10-13 20:48:42.992903 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/rabbitmqclusters.rabbitmq.com/rabbitmq.yaml 2025-10-13 20:48:42.992919 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/rabbitmqs.rabbitmq.openstack.org/ 2025-10-13 20:48:42.992938 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/rabbitmqs.rabbitmq.openstack.org/rabbitmq-cell1.yaml 2025-10-13 20:48:42.992954 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/rabbitmqs.rabbitmq.openstack.org/rabbitmq.yaml 2025-10-13 20:48:42.992970 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swiftproxies.swift.openstack.org/ 2025-10-13 20:48:42.992985 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swiftproxies.swift.openstack.org/swift-proxy.yaml 2025-10-13 20:48:42.993000 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swiftrings.swift.openstack.org/ 2025-10-13 20:48:42.993015 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swiftrings.swift.openstack.org/swift-ring.yaml 2025-10-13 20:48:42.993029 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swifts.swift.openstack.org/ 2025-10-13 20:48:42.993044 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swifts.swift.openstack.org/swift.yaml 2025-10-13 20:48:42.993059 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swiftstorages.swift.openstack.org/ 2025-10-13 20:48:42.993089 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/swiftstorages.swift.openstack.org/swift-storage.yaml 2025-10-13 20:48:42.993109 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/telemetries.telemetry.openstack.org/ 2025-10-13 20:48:42.993151 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/telemetries.telemetry.openstack.org/telemetry.yaml 2025-10-13 20:48:42.993178 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/ 2025-10-13 20:48:42.993196 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/barbican-barbican-transport.yaml 2025-10-13 20:48:42.993219 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/ceilometer-transport.yaml 2025-10-13 20:48:42.993243 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/cinder-cinder-transport.yaml 2025-10-13 20:48:42.993265 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/keystone-keystone-transport.yaml 2025-10-13 20:48:42.993282 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/neutron-neutron-transport.yaml 2025-10-13 20:48:42.993299 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/nova-api-transport.yaml 2025-10-13 20:48:42.993315 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/crs/transporturls.rabbitmq.openstack.org/nova-cell1-transport.yaml 2025-10-13 20:48:42.993332 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/daemonset/ 2025-10-13 20:48:42.993348 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/ 2025-10-13 20:48:42.993364 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/barbican-api.yaml 2025-10-13 20:48:42.993384 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/barbican-keystone-listener.yaml 2025-10-13 20:48:42.993408 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/barbican-worker.yaml 2025-10-13 20:48:42.993434 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/dnsmasq-dnsmasq.yaml 2025-10-13 20:48:42.993459 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/keystone.yaml 2025-10-13 20:48:42.993484 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/neutron.yaml 2025-10-13 20:48:42.993502 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/placement.yaml 2025-10-13 20:48:42.993518 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/deployments/swift-proxy.yaml 2025-10-13 20:48:42.993534 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/imagestream/ 2025-10-13 20:48:42.993549 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/installplans/ 2025-10-13 20:48:42.993565 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/issuer/ 2025-10-13 20:48:42.993581 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/issuer/rootca-internal.yaml 2025-10-13 20:48:42.993597 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/issuer/rootca-libvirt.yaml 2025-10-13 20:48:42.993612 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/issuer/rootca-ovn.yaml 2025-10-13 20:48:42.993628 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/issuer/rootca-public.yaml 2025-10-13 20:48:42.993644 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/issuer/selfsigned-issuer.yaml 2025-10-13 20:48:42.993660 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/jobs/ 2025-10-13 20:48:42.993676 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/jobs/swift-ring-rebalance.yaml 2025-10-13 20:48:42.993692 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ 2025-10-13 20:48:42.993711 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-api-54cfd786d-vwmcd/ 2025-10-13 20:48:42.993748 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-api-54cfd786d-vwmcd/barbican-api-54cfd786d-vwmcd-describe 2025-10-13 20:48:42.993767 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-api-54cfd786d-vwmcd/logs/ 2025-10-13 20:48:42.993783 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-api-54cfd786d-vwmcd/logs/barbican-api-log.log 2025-10-13 20:48:42.993799 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-api-54cfd786d-vwmcd/logs/barbican-api.log 2025-10-13 20:48:42.993814 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-keystone-listener-576c97949d-5g2hx/ 2025-10-13 20:48:42.993830 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-keystone-listener-576c97949d-5g2hx/barbican-keystone-listener-576c97949d-5g2hx-describe 2025-10-13 20:48:42.993847 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-keystone-listener-576c97949d-5g2hx/logs/ 2025-10-13 20:48:42.993863 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-keystone-listener-576c97949d-5g2hx/logs/barbican-keystone-listener-log.log 2025-10-13 20:48:42.993878 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-keystone-listener-576c97949d-5g2hx/logs/barbican-keystone-listener.log 2025-10-13 20:48:42.993894 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-worker-c8f4d948c-lxfhn/ 2025-10-13 20:48:42.993909 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-worker-c8f4d948c-lxfhn/barbican-worker-c8f4d948c-lxfhn-describe 2025-10-13 20:48:42.993925 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-worker-c8f4d948c-lxfhn/logs/ 2025-10-13 20:48:42.993945 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-worker-c8f4d948c-lxfhn/logs/barbican-worker-log.log 2025-10-13 20:48:42.993961 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/barbican-worker-c8f4d948c-lxfhn/logs/barbican-worker.log 2025-10-13 20:48:42.993977 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ceilometer-0/ 2025-10-13 20:48:42.993992 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ceilometer-0/ceilometer-0-describe 2025-10-13 20:48:42.994008 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ceilometer-0/logs/ 2025-10-13 20:48:42.994023 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ceilometer-0/logs/ceilometer-central-agent.log 2025-10-13 20:48:42.994039 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ceilometer-0/logs/ceilometer-notification-agent.log 2025-10-13 20:48:42.994054 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ceilometer-0/logs/proxy-httpd.log 2025-10-13 20:48:42.994069 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ceilometer-0/logs/sg-core.log 2025-10-13 20:48:42.994084 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-api-0/ 2025-10-13 20:48:42.994100 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-api-0/cinder-api-0-describe 2025-10-13 20:48:42.994116 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-api-0/logs/ 2025-10-13 20:48:42.994131 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-api-0/logs/cinder-api-log.log 2025-10-13 20:48:42.994147 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-api-0/logs/cinder-api.log 2025-10-13 20:48:42.994169 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-scheduler-0/ 2025-10-13 20:48:42.994186 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-scheduler-0/cinder-scheduler-0-describe 2025-10-13 20:48:42.994201 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-scheduler-0/logs/ 2025-10-13 20:48:42.994217 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-scheduler-0/logs/cinder-scheduler.log 2025-10-13 20:48:42.994233 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/cinder-scheduler-0/logs/probe.log 2025-10-13 20:48:42.994248 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/dnsmasq-dnsmasq-7897767fb7-62vl2/ 2025-10-13 20:48:42.994264 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/dnsmasq-dnsmasq-7897767fb7-62vl2/dnsmasq-dnsmasq-7897767fb7-62vl2-describe 2025-10-13 20:48:42.994279 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/dnsmasq-dnsmasq-7897767fb7-62vl2/logs/ 2025-10-13 20:48:42.994295 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/dnsmasq-dnsmasq-7897767fb7-62vl2/logs/dnsmasq-dns.log 2025-10-13 20:48:42.994310 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/dnsmasq-dnsmasq-7897767fb7-62vl2/logs/init.log 2025-10-13 20:48:42.994325 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-external-api-0/ 2025-10-13 20:48:42.994340 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-external-api-0/glance-default-external-api-0-describe 2025-10-13 20:48:42.994356 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-external-api-0/logs/ 2025-10-13 20:48:42.994391 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-external-api-0/logs/glance-httpd.log 2025-10-13 20:48:42.994441 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-external-api-0/logs/glance-log.log 2025-10-13 20:48:42.994556 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-internal-api-0/ 2025-10-13 20:48:42.994581 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-internal-api-0/glance-default-internal-api-0-describe 2025-10-13 20:48:42.994599 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-internal-api-0/logs/ 2025-10-13 20:48:42.994615 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-internal-api-0/logs/glance-httpd.log 2025-10-13 20:48:42.994631 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/glance-default-internal-api-0/logs/glance-log.log 2025-10-13 20:48:42.994647 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/keystone-6f98bbf5c8-qqqjd/ 2025-10-13 20:48:42.994663 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/keystone-6f98bbf5c8-qqqjd/keystone-6f98bbf5c8-qqqjd-describe 2025-10-13 20:48:42.994679 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/keystone-6f98bbf5c8-qqqjd/logs/ 2025-10-13 20:48:42.994695 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/keystone-6f98bbf5c8-qqqjd/logs/keystone-api.log 2025-10-13 20:48:42.994711 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/kube-state-metrics-0/ 2025-10-13 20:48:42.994752 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/kube-state-metrics-0/kube-state-metrics-0-describe 2025-10-13 20:48:42.994771 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/kube-state-metrics-0/logs/ 2025-10-13 20:48:42.994791 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/kube-state-metrics-0/logs/kube-state-metrics.log 2025-10-13 20:48:42.994807 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/memcached-0/ 2025-10-13 20:48:42.994822 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/memcached-0/memcached-0-describe 2025-10-13 20:48:42.994837 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/memcached-0/logs/ 2025-10-13 20:48:42.994853 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/memcached-0/logs/memcached.log 2025-10-13 20:48:42.994874 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/neutron-579859f9f8-t8czw/ 2025-10-13 20:48:42.994897 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/neutron-579859f9f8-t8czw/neutron-579859f9f8-t8czw-describe 2025-10-13 20:48:42.994921 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/neutron-579859f9f8-t8czw/logs/ 2025-10-13 20:48:42.994944 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/neutron-579859f9f8-t8czw/logs/neutron-api.log 2025-10-13 20:48:42.994964 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/neutron-579859f9f8-t8czw/logs/neutron-httpd.log 2025-10-13 20:48:42.994981 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-api-0/ 2025-10-13 20:48:42.994997 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-api-0/nova-api-0-describe 2025-10-13 20:48:42.995013 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-api-0/logs/ 2025-10-13 20:48:42.995029 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-api-0/logs/nova-api-api.log 2025-10-13 20:48:42.995049 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-api-0/logs/nova-api-log.log 2025-10-13 20:48:42.995065 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell0-conductor-0/ 2025-10-13 20:48:42.995080 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell0-conductor-0/nova-cell0-conductor-0-describe 2025-10-13 20:48:42.995096 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell0-conductor-0/logs/ 2025-10-13 20:48:42.995112 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell0-conductor-0/logs/nova-cell0-conductor-conductor-previous.log 2025-10-13 20:48:42.995128 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell0-conductor-0/logs/nova-cell0-conductor-conductor.log 2025-10-13 20:48:42.995144 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-conductor-0/ 2025-10-13 20:48:42.995160 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-conductor-0/nova-cell1-conductor-0-describe 2025-10-13 20:48:42.995175 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-conductor-0/logs/ 2025-10-13 20:48:42.995191 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-conductor-0/logs/nova-cell1-conductor-conductor-previous.log 2025-10-13 20:48:42.995207 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-conductor-0/logs/nova-cell1-conductor-conductor.log 2025-10-13 20:48:42.995222 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-novncproxy-0/ 2025-10-13 20:48:42.995237 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-novncproxy-0/nova-cell1-novncproxy-0-describe 2025-10-13 20:48:42.995257 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-novncproxy-0/logs/ 2025-10-13 20:48:42.995273 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-cell1-novncproxy-0/logs/nova-cell1-novncproxy-novncproxy.log 2025-10-13 20:48:42.995289 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-metadata-0/ 2025-10-13 20:48:42.995304 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-metadata-0/nova-metadata-0-describe 2025-10-13 20:48:42.995321 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-metadata-0/logs/ 2025-10-13 20:48:42.995337 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-metadata-0/logs/nova-metadata-log.log 2025-10-13 20:48:42.995352 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-metadata-0/logs/nova-metadata-metadata.log 2025-10-13 20:48:42.995367 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-scheduler-0/ 2025-10-13 20:48:42.995383 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-scheduler-0/nova-scheduler-0-describe 2025-10-13 20:48:42.995398 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-scheduler-0/logs/ 2025-10-13 20:48:42.995414 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/nova-scheduler-0/logs/nova-scheduler-scheduler.log 2025-10-13 20:48:42.995429 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-cell1-galera-0/ 2025-10-13 20:48:42.995445 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-cell1-galera-0/openstack-cell1-galera-0-describe 2025-10-13 20:48:42.995461 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-cell1-galera-0/logs/ 2025-10-13 20:48:42.995480 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-cell1-galera-0/logs/galera.log 2025-10-13 20:48:42.995496 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-cell1-galera-0/logs/mysql-bootstrap.log 2025-10-13 20:48:42.995512 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-galera-0/ 2025-10-13 20:48:42.995527 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-galera-0/openstack-galera-0-describe 2025-10-13 20:48:42.995543 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-galera-0/logs/ 2025-10-13 20:48:42.995558 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-galera-0/logs/galera.log 2025-10-13 20:48:42.995573 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstack-galera-0/logs/mysql-bootstrap.log 2025-10-13 20:48:42.995589 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstackclient/ 2025-10-13 20:48:42.995604 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstackclient/openstackclient-describe 2025-10-13 20:48:42.995619 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstackclient/logs/ 2025-10-13 20:48:42.995635 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/openstackclient/logs/openstackclient.log 2025-10-13 20:48:42.995650 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovn-northd-0/ 2025-10-13 20:48:42.995665 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovn-northd-0/ovn-northd-0-describe 2025-10-13 20:48:42.995684 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovn-northd-0/logs/ 2025-10-13 20:48:42.995700 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovn-northd-0/logs/openstack-network-exporter.log 2025-10-13 20:48:42.995715 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovn-northd-0/logs/ovn-northd.log 2025-10-13 20:48:42.995749 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-nb-0/ 2025-10-13 20:48:42.995767 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-nb-0/ovsdbserver-nb-0-describe 2025-10-13 20:48:42.995783 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-nb-0/logs/ 2025-10-13 20:48:42.995799 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-nb-0/logs/openstack-network-exporter.log 2025-10-13 20:48:42.995815 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-nb-0/logs/ovsdbserver-nb.log 2025-10-13 20:48:42.995831 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-sb-0/ 2025-10-13 20:48:42.995846 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-sb-0/ovsdbserver-sb-0-describe 2025-10-13 20:48:42.995862 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-sb-0/logs/ 2025-10-13 20:48:42.995878 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-sb-0/logs/openstack-network-exporter.log 2025-10-13 20:48:42.995894 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/ovsdbserver-sb-0/logs/ovsdbserver-sb.log 2025-10-13 20:48:42.995910 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/placement-64d84d847d-vft6g/ 2025-10-13 20:48:42.995929 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/placement-64d84d847d-vft6g/placement-64d84d847d-vft6g-describe 2025-10-13 20:48:42.995944 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/placement-64d84d847d-vft6g/logs/ 2025-10-13 20:48:42.995960 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/placement-64d84d847d-vft6g/logs/placement-api.log 2025-10-13 20:48:42.995975 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/placement-64d84d847d-vft6g/logs/placement-log.log 2025-10-13 20:48:42.995991 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-cell1-server-0/ 2025-10-13 20:48:42.996006 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-cell1-server-0/rabbitmq-cell1-server-0-describe 2025-10-13 20:48:42.996022 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-cell1-server-0/logs/ 2025-10-13 20:48:42.996037 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-cell1-server-0/logs/rabbitmq.log 2025-10-13 20:48:42.996053 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-cell1-server-0/logs/setup-container.log 2025-10-13 20:48:42.996068 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-server-0/ 2025-10-13 20:48:42.996084 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-server-0/rabbitmq-server-0-describe 2025-10-13 20:48:42.996100 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-server-0/logs/ 2025-10-13 20:48:42.996116 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-server-0/logs/rabbitmq.log 2025-10-13 20:48:42.996131 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/rabbitmq-server-0/logs/setup-container.log 2025-10-13 20:48:42.996153 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-proxy-7b49dbb6d4-chqn8/ 2025-10-13 20:48:42.996169 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-proxy-7b49dbb6d4-chqn8/swift-proxy-7b49dbb6d4-chqn8-describe 2025-10-13 20:48:42.996185 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-proxy-7b49dbb6d4-chqn8/logs/ 2025-10-13 20:48:42.996202 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-proxy-7b49dbb6d4-chqn8/logs/proxy-httpd.log 2025-10-13 20:48:42.996218 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-proxy-7b49dbb6d4-chqn8/logs/proxy-server.log 2025-10-13 20:48:42.996233 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-ring-rebalance-gx4v6/ 2025-10-13 20:48:42.996249 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-ring-rebalance-gx4v6/swift-ring-rebalance-gx4v6-describe 2025-10-13 20:48:42.996264 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-ring-rebalance-gx4v6/logs/ 2025-10-13 20:48:42.996280 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-ring-rebalance-gx4v6/logs/swift-ring-rebalance.log 2025-10-13 20:48:42.996296 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/ 2025-10-13 20:48:42.996312 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/swift-storage-0-describe 2025-10-13 20:48:42.996327 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/ 2025-10-13 20:48:42.996343 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/account-auditor.log 2025-10-13 20:48:42.996361 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/account-reaper.log 2025-10-13 20:48:42.996377 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/account-replicator.log 2025-10-13 20:48:42.996393 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/account-server.log 2025-10-13 20:48:42.996408 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/container-auditor.log 2025-10-13 20:48:42.996424 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/container-replicator.log 2025-10-13 20:48:42.996440 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/container-server.log 2025-10-13 20:48:42.996455 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/container-updater.log 2025-10-13 20:48:42.996470 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/object-auditor.log 2025-10-13 20:48:42.996485 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/object-expirer.log 2025-10-13 20:48:42.996500 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/object-replicator.log 2025-10-13 20:48:42.996515 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/object-server.log 2025-10-13 20:48:42.996530 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/object-updater.log 2025-10-13 20:48:42.996545 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/rsync.log 2025-10-13 20:48:42.996560 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/pods/swift-storage-0/logs/swift-recon-cron.log 2025-10-13 20:48:42.996579 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/ 2025-10-13 20:48:42.996595 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-54cfd786d.yaml 2025-10-13 20:48:42.996610 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-56c8d464f6.yaml 2025-10-13 20:48:42.996625 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-659575d6f4.yaml 2025-10-13 20:48:42.996641 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-6798f4b48.yaml 2025-10-13 20:48:42.996656 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-6854f45cc6.yaml 2025-10-13 20:48:42.996672 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-6fd554c566.yaml 2025-10-13 20:48:42.996687 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-7b78d6b644.yaml 2025-10-13 20:48:42.996702 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-api-87c6c5c5b.yaml 2025-10-13 20:48:42.996718 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-keystone-listener-576c97949d.yaml 2025-10-13 20:48:42.996762 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-keystone-listener-5cc495fc5b.yaml 2025-10-13 20:48:42.996781 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-keystone-listener-5cc556c54b.yaml 2025-10-13 20:48:42.996803 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-keystone-listener-5fb9c49854.yaml 2025-10-13 20:48:42.996830 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-keystone-listener-65458ccc98.yaml 2025-10-13 20:48:42.996854 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-keystone-listener-bf4f477f8.yaml 2025-10-13 20:48:42.996871 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-worker-6464f596c.yaml 2025-10-13 20:48:42.996887 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-worker-758d764b9f.yaml 2025-10-13 20:48:42.996902 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-worker-76c58766f5.yaml 2025-10-13 20:48:42.996917 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-worker-85bc4866dc.yaml 2025-10-13 20:48:42.996933 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-worker-c847ddc47.yaml 2025-10-13 20:48:42.996948 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/barbican-worker-c8f4d948c.yaml 2025-10-13 20:48:42.996963 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-5464d4fd65.yaml 2025-10-13 20:48:42.996979 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-5b98b9f45.yaml 2025-10-13 20:48:42.996994 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-6685f57749.yaml 2025-10-13 20:48:42.997010 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-699487488f.yaml 2025-10-13 20:48:42.997025 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-6b7c46cb85.yaml 2025-10-13 20:48:42.997041 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-7897767fb7.yaml 2025-10-13 20:48:42.997060 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-78b9f876b9.yaml 2025-10-13 20:48:42.997094 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-84b9f45d47.yaml 2025-10-13 20:48:42.997116 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-85d5c6dbcc.yaml 2025-10-13 20:48:42.997134 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-89b47bd49.yaml 2025-10-13 20:48:42.997152 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/dnsmasq-dnsmasq-b569dffb9.yaml 2025-10-13 20:48:42.997169 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/keystone-5685896c94.yaml 2025-10-13 20:48:42.997187 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/keystone-596b7b4f4c.yaml 2025-10-13 20:48:42.997205 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/keystone-6446dcd7c7.yaml 2025-10-13 20:48:42.997222 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/keystone-6f98bbf5c8.yaml 2025-10-13 20:48:42.997240 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/keystone-775f594698.yaml 2025-10-13 20:48:42.997257 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/keystone-7c546c7bd6.yaml 2025-10-13 20:48:42.997275 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/keystone-c87449757.yaml 2025-10-13 20:48:42.997293 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-54fdcc89cb.yaml 2025-10-13 20:48:42.997311 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-56d6867f46.yaml 2025-10-13 20:48:42.997333 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-579859f9f8.yaml 2025-10-13 20:48:42.997350 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-5c8d5d6cb6.yaml 2025-10-13 20:48:42.997367 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-766f5f4786.yaml 2025-10-13 20:48:42.997383 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-77546b4cfd.yaml 2025-10-13 20:48:42.997399 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-7775d49c68.yaml 2025-10-13 20:48:42.997415 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-855b56d88b.yaml 2025-10-13 20:48:42.997430 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-85f6d48958.yaml 2025-10-13 20:48:42.997446 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/neutron-95496bc54.yaml 2025-10-13 20:48:42.997463 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/placement-548d897d7b.yaml 2025-10-13 20:48:42.997480 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/placement-64d84d847d.yaml 2025-10-13 20:48:42.997497 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/placement-6796996c74.yaml 2025-10-13 20:48:42.997512 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/placement-756d8c747d.yaml 2025-10-13 20:48:42.997527 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/placement-78454b578b.yaml 2025-10-13 20:48:42.997542 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/placement-796cf4c4bb.yaml 2025-10-13 20:48:42.997561 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/swift-proxy-657f6dc4d4.yaml 2025-10-13 20:48:42.997576 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/swift-proxy-74f77948c4.yaml 2025-10-13 20:48:42.997591 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/replicaset/swift-proxy-7b49dbb6d4.yaml 2025-10-13 20:48:42.997606 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/ 2025-10-13 20:48:42.997621 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/barbican-public.yaml 2025-10-13 20:48:42.997637 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/cinder-public.yaml 2025-10-13 20:48:42.997652 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/glance-default-public.yaml 2025-10-13 20:48:42.997667 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/keystone-public.yaml 2025-10-13 20:48:42.997682 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/neutron-public.yaml 2025-10-13 20:48:42.997697 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/nova-novncproxy-cell1-public.yaml 2025-10-13 20:48:42.997713 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/nova-public.yaml 2025-10-13 20:48:42.997748 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/placement-public.yaml 2025-10-13 20:48:42.997766 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/routes/swift-public.yaml 2025-10-13 20:48:42.997782 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ 2025-10-13 20:48:42.997802 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/ 2025-10-13 20:48:42.997818 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-api-config-data.yaml 2025-10-13 20:48:42.997834 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-api-config-data.yaml-00-default.conf 2025-10-13 20:48:42.997850 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-api-config-data.yaml-01-service-defaults.conf 2025-10-13 20:48:42.997866 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-config-data.yaml 2025-10-13 20:48:42.997882 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-config-data.yaml-00-default.conf 2025-10-13 20:48:42.997898 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-config-data.yaml-10-barbican_wsgi_main.conf 2025-10-13 20:48:42.997913 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-config-data.yaml-httpd.conf 2025-10-13 20:48:42.997929 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-config-data.yaml-mime.conf 2025-10-13 20:48:42.997945 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-config-data.yaml-ssl.conf 2025-10-13 20:48:42.997961 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-db-secret.yaml 2025-10-13 20:48:42.997976 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-keystone-listener-config-data.yaml 2025-10-13 20:48:42.997991 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-keystone-listener-config-data.yaml-00-default.conf 2025-10-13 20:48:42.998011 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-keystone-listener-config-data.yaml-01-service-defaults.conf 2025-10-13 20:48:42.998027 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-scripts.yaml 2025-10-13 20:48:42.998043 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-worker-config-data.yaml 2025-10-13 20:48:42.998059 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-worker-config-data.yaml-00-default.conf 2025-10-13 20:48:42.998076 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/barbican-worker-config-data.yaml-01-service-defaults.conf 2025-10-13 20:48:42.998092 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/cert-barbican-internal-svc.yaml 2025-10-13 20:48:42.998108 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/cert-barbican-public-route.yaml 2025-10-13 20:48:42.998123 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/cert-barbican-public-svc.yaml 2025-10-13 20:48:42.998138 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/barbican/rabbitmq-transport-url-barbican-barbican-transport.yaml 2025-10-13 20:48:42.998154 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ 2025-10-13 20:48:42.998170 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-compute-config-data.yaml 2025-10-13 20:48:42.998186 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-compute-config-data.yaml-ceilometer.conf 2025-10-13 20:48:42.998202 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-compute-config-data.yaml-custom.conf 2025-10-13 20:48:42.998221 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-compute-scripts.yaml 2025-10-13 20:48:42.998237 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-config-data.yaml 2025-10-13 20:48:42.998252 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-config-data.yaml-ceilometer.conf 2025-10-13 20:48:42.998268 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-config-data.yaml-custom.conf 2025-10-13 20:48:42.998284 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-config-data.yaml-httpd.conf 2025-10-13 20:48:42.998299 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-config-data.yaml-ssl.conf 2025-10-13 20:48:42.998315 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-ipmi-config-data.yaml 2025-10-13 20:48:42.998330 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-ipmi-config-data.yaml-ceilometer.conf 2025-10-13 20:48:42.998346 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-ipmi-config-data.yaml-custom.conf 2025-10-13 20:48:42.998363 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-ipmi-scripts.yaml 2025-10-13 20:48:42.998386 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/ceilometer-scripts.yaml 2025-10-13 20:48:42.998410 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/cert-ceilometer-internal-svc.yaml 2025-10-13 20:48:42.998432 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ceilometer/rabbitmq-transport-url-ceilometer-transport.yaml 2025-10-13 20:48:42.998453 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/ 2025-10-13 20:48:42.998470 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cert-cinder-internal-svc.yaml 2025-10-13 20:48:42.998486 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cert-cinder-public-route.yaml 2025-10-13 20:48:42.998502 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cert-cinder-public-svc.yaml 2025-10-13 20:48:42.998518 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-api-config-data.yaml 2025-10-13 20:48:42.998533 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-api-config-data.yaml-00-global-defaults.conf 2025-10-13 20:48:42.998548 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-api-config-data.yaml-01-service-defaults.conf 2025-10-13 20:48:42.998564 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-config-data.yaml 2025-10-13 20:48:42.998579 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-config-data.yaml-00-global-defaults.conf 2025-10-13 20:48:42.998595 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-config-data.yaml-10-cinder_wsgi.conf 2025-10-13 20:48:42.998611 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-config-data.yaml-httpd.conf 2025-10-13 20:48:42.998629 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-config-data.yaml-ssl.conf 2025-10-13 20:48:42.998651 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-db-secret.yaml 2025-10-13 20:48:42.998686 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-scheduler-config-data.yaml 2025-10-13 20:48:42.998712 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-scheduler-config-data.yaml-00-global-defaults.conf 2025-10-13 20:48:42.998752 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-scripts.yaml 2025-10-13 20:48:42.998771 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-volume-volume1-config-data.yaml 2025-10-13 20:48:42.998788 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-volume-volume1-config-data.yaml-00-global-defaults.conf 2025-10-13 20:48:42.998804 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/cinder-volume-volume1-config-data.yaml-01-service-defaults.conf 2025-10-13 20:48:42.998819 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/cinder/rabbitmq-transport-url-cinder-cinder-transport.yaml 2025-10-13 20:48:42.998835 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/dataplane/ 2025-10-13 20:48:42.998852 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/dataplane/dataplane-ansible-ssh-private-key-secret.yaml 2025-10-13 20:48:42.998868 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/ 2025-10-13 20:48:42.998884 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/cert-glance-default-internal-svc.yaml 2025-10-13 20:48:42.998900 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/cert-glance-default-public-route.yaml 2025-10-13 20:48:42.998915 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/cert-glance-default-public-svc.yaml 2025-10-13 20:48:42.998931 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-config-data.yaml 2025-10-13 20:48:42.998951 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-config-data.yaml-00-config.conf 2025-10-13 20:48:42.998967 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-config-data.yaml-01-config.conf 2025-10-13 20:48:42.998983 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-db-secret.yaml 2025-10-13 20:48:42.998998 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-external-config-data.yaml 2025-10-13 20:48:42.999013 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-external-config-data.yaml-00-config.conf 2025-10-13 20:48:42.999029 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-external-config-data.yaml-02-config.conf 2025-10-13 20:48:42.999044 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-external-config-data.yaml-10-glance-proxypass.conf 2025-10-13 20:48:42.999060 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-external-config-data.yaml-10-glance-wsgi.conf 2025-10-13 20:48:42.999076 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-external-config-data.yaml-httpd.conf 2025-10-13 20:48:42.999091 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-external-config-data.yaml-ssl.conf 2025-10-13 20:48:42.999107 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-internal-config-data.yaml 2025-10-13 20:48:42.999123 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-internal-config-data.yaml-00-config.conf 2025-10-13 20:48:42.999141 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-internal-config-data.yaml-02-config.conf 2025-10-13 20:48:42.999157 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-internal-config-data.yaml-10-glance-proxypass.conf 2025-10-13 20:48:42.999173 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-internal-config-data.yaml-10-glance-wsgi.conf 2025-10-13 20:48:42.999189 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-internal-config-data.yaml-httpd.conf 2025-10-13 20:48:42.999205 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-default-internal-config-data.yaml-ssl.conf 2025-10-13 20:48:42.999221 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/glance/glance-scripts.yaml 2025-10-13 20:48:42.999236 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/ 2025-10-13 20:48:42.999252 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/barbican-keystone-listener-config-data.yaml 2025-10-13 20:48:42.999267 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/barbican-keystone-listener-config-data.yaml-00-default.conf 2025-10-13 20:48:42.999283 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/barbican-keystone-listener-config-data.yaml-01-service-defaults.conf 2025-10-13 20:48:42.999299 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/cert-keystone-internal-svc.yaml 2025-10-13 20:48:42.999314 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/cert-keystone-public-route.yaml 2025-10-13 20:48:42.999330 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/cert-keystone-public-svc.yaml 2025-10-13 20:48:42.999349 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/keystone-config-data.yaml 2025-10-13 20:48:42.999365 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/keystone-config-data.yaml-httpd.conf 2025-10-13 20:48:42.999381 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/keystone-config-data.yaml-keystone.conf 2025-10-13 20:48:42.999396 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/keystone-config-data.yaml-ssl.conf 2025-10-13 20:48:42.999412 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/keystone-db-secret.yaml 2025-10-13 20:48:42.999428 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/keystone-scripts.yaml 2025-10-13 20:48:42.999444 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/keystone.yaml 2025-10-13 20:48:42.999459 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/keystone/rabbitmq-transport-url-keystone-keystone-transport.yaml 2025-10-13 20:48:42.999475 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/ 2025-10-13 20:48:42.999494 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/cert-neutron-internal-svc.yaml 2025-10-13 20:48:42.999512 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/cert-neutron-ovndbs.yaml 2025-10-13 20:48:42.999527 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/cert-neutron-public-route.yaml 2025-10-13 20:48:42.999574 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/cert-neutron-public-svc.yaml 2025-10-13 20:48:42.999593 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-config.yaml 2025-10-13 20:48:42.999615 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-config.yaml-01-neutron.conf 2025-10-13 20:48:42.999632 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-db-secret.yaml 2025-10-13 20:48:42.999648 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-dhcp-agent-neutron-config.yaml 2025-10-13 20:48:42.999664 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-dhcp-agent-neutron-config.yaml-10-neutron-dhcp.conf 2025-10-13 20:48:42.999681 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-httpd-config.yaml 2025-10-13 20:48:42.999697 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-httpd-config.yaml-10-neutron-httpd.conf 2025-10-13 20:48:42.999713 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-httpd-config.yaml-httpd.conf 2025-10-13 20:48:42.999746 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-httpd-config.yaml-ssl.conf 2025-10-13 20:48:42.999765 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-ovn-agent-neutron-config.yaml 2025-10-13 20:48:42.999781 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-ovn-agent-neutron-config.yaml-10-neutron-ovn.conf 2025-10-13 20:48:42.999797 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-ovn-metadata-agent-neutron-config.yaml 2025-10-13 20:48:42.999814 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-ovn-metadata-agent-neutron-config.yaml-10-neutron-metadata.conf 2025-10-13 20:48:42.999830 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-sriov-agent-neutron-config.yaml 2025-10-13 20:48:42.999849 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/neutron-sriov-agent-neutron-config.yaml-10-neutron-sriov.conf 2025-10-13 20:48:42.999865 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/nova-metadata-neutron-config.yaml 2025-10-13 20:48:42.999881 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/nova-metadata-neutron-config.yaml-05-nova-metadata.conf 2025-10-13 20:48:42.999897 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/neutron/rabbitmq-transport-url-neutron-neutron-transport.yaml 2025-10-13 20:48:42.999913 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/ 2025-10-13 20:48:42.999929 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/cert-nova-internal-svc.yaml 2025-10-13 20:48:42.999945 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/cert-nova-metadata-internal-svc.yaml 2025-10-13 20:48:42.999961 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/cert-nova-novncproxy-cell1-public-route.yaml 2025-10-13 20:48:42.999977 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/cert-nova-novncproxy-cell1-public-svc.yaml 2025-10-13 20:48:42.999992 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/cert-nova-novncproxy-cell1-vencrypt.yaml 2025-10-13 20:48:43.000008 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/cert-nova-public-route.yaml 2025-10-13 20:48:43.000025 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/cert-nova-public-svc.yaml 2025-10-13 20:48:43.000041 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-api-config-data.yaml 2025-10-13 20:48:43.000060 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-api-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000077 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-api-config-data.yaml-httpd.conf 2025-10-13 20:48:43.000093 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-api-config-data.yaml-ssl.conf 2025-10-13 20:48:43.000110 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-api-db-secret.yaml 2025-10-13 20:48:43.000126 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0-conductor-config-data.yaml 2025-10-13 20:48:43.000142 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0-conductor-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000158 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0-conductor-scripts.yaml 2025-10-13 20:48:43.000173 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0-db-secret.yaml 2025-10-13 20:48:43.000189 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0-manage-config-data.yaml 2025-10-13 20:48:43.000205 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0-manage-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000220 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0-manage-scripts.yaml 2025-10-13 20:48:43.000236 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell0.yaml 2025-10-13 20:48:43.000252 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-compute-config.yaml 2025-10-13 20:48:43.000270 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-compute-config.yaml-01-nova.conf 2025-10-13 20:48:43.000287 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-conductor-config-data.yaml 2025-10-13 20:48:43.000302 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-conductor-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000318 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-conductor-scripts.yaml 2025-10-13 20:48:43.000334 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-db-secret.yaml 2025-10-13 20:48:43.000349 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-manage-config-data.yaml 2025-10-13 20:48:43.000364 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-manage-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000380 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-manage-scripts.yaml 2025-10-13 20:48:43.000396 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-novncproxy-config-data.yaml 2025-10-13 20:48:43.000411 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1-novncproxy-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000426 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-cell1.yaml 2025-10-13 20:48:43.000442 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-metadata-config-data.yaml 2025-10-13 20:48:43.000458 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-metadata-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000476 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-metadata-config-data.yaml-httpd.conf 2025-10-13 20:48:43.000497 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-metadata-config-data.yaml-ssl.conf 2025-10-13 20:48:43.000513 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-metadata-neutron-config.yaml 2025-10-13 20:48:43.000528 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-metadata-neutron-config.yaml-05-nova-metadata.conf 2025-10-13 20:48:43.000544 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-scheduler-config-data.yaml 2025-10-13 20:48:43.000560 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova-scheduler-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000576 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/nova.yaml 2025-10-13 20:48:43.000592 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/rabbitmq-transport-url-nova-api-transport.yaml 2025-10-13 20:48:43.000608 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/nova/rabbitmq-transport-url-nova-cell1-transport.yaml 2025-10-13 20:48:43.000624 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/octavia/ 2025-10-13 20:48:43.000640 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/octavia/octavia-ca-passphrase.yaml 2025-10-13 20:48:43.000656 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/ 2025-10-13 20:48:43.000671 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-neutron-ovndbs.yaml 2025-10-13 20:48:43.000687 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-nova-novncproxy-cell1-public-route.yaml 2025-10-13 20:48:43.000706 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-nova-novncproxy-cell1-public-svc.yaml 2025-10-13 20:48:43.000748 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-nova-novncproxy-cell1-vencrypt.yaml 2025-10-13 20:48:43.000782 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-ovn-metrics.yaml 2025-10-13 20:48:43.000805 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-ovndbcluster-nb-ovndbs.yaml 2025-10-13 20:48:43.000827 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-ovndbcluster-sb-ovndbs.yaml 2025-10-13 20:48:43.000845 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/cert-ovnnorthd-ovndbs.yaml 2025-10-13 20:48:43.000861 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/neutron-ovn-agent-neutron-config.yaml 2025-10-13 20:48:43.000877 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/neutron-ovn-agent-neutron-config.yaml-10-neutron-ovn.conf 2025-10-13 20:48:43.000893 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/neutron-ovn-metadata-agent-neutron-config.yaml 2025-10-13 20:48:43.000909 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/neutron-ovn-metadata-agent-neutron-config.yaml-10-neutron-metadata.conf 2025-10-13 20:48:43.000925 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/nova-cell1-novncproxy-config-data.yaml 2025-10-13 20:48:43.000941 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/nova-cell1-novncproxy-config-data.yaml-01-nova.conf 2025-10-13 20:48:43.000956 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/ovn/rootca-ovn.yaml 2025-10-13 20:48:43.000976 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/ 2025-10-13 20:48:43.000992 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/cert-placement-internal-svc.yaml 2025-10-13 20:48:43.001008 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/cert-placement-public-route.yaml 2025-10-13 20:48:43.001023 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/cert-placement-public-svc.yaml 2025-10-13 20:48:43.001039 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/placement-config-data.yaml 2025-10-13 20:48:43.001055 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/placement-config-data.yaml-httpd.conf 2025-10-13 20:48:43.001071 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/placement-config-data.yaml-placement.conf 2025-10-13 20:48:43.001101 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/placement-config-data.yaml-ssl.conf 2025-10-13 20:48:43.001120 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/placement-db-secret.yaml 2025-10-13 20:48:43.001136 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/placement/placement-scripts.yaml 2025-10-13 20:48:43.001152 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/ 2025-10-13 20:48:43.001168 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/cert-rabbitmq-cell1-svc.yaml 2025-10-13 20:48:43.001184 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/cert-rabbitmq-svc.yaml 2025-10-13 20:48:43.001199 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-cell1-default-user.yaml 2025-10-13 20:48:43.001218 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-cell1-default-user.yaml-default_user.conf 2025-10-13 20:48:43.001234 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-cell1-erlang-cookie.yaml 2025-10-13 20:48:43.001250 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-default-user.yaml 2025-10-13 20:48:43.001265 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-default-user.yaml-default_user.conf 2025-10-13 20:48:43.001281 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-erlang-cookie.yaml 2025-10-13 20:48:43.001297 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-transport-url-barbican-barbican-transport.yaml 2025-10-13 20:48:43.001312 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-transport-url-ceilometer-transport.yaml 2025-10-13 20:48:43.001328 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-transport-url-cinder-cinder-transport.yaml 2025-10-13 20:48:43.001344 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-transport-url-keystone-keystone-transport.yaml 2025-10-13 20:48:43.001360 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-transport-url-neutron-neutron-transport.yaml 2025-10-13 20:48:43.001375 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-transport-url-nova-api-transport.yaml 2025-10-13 20:48:43.001391 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/rabbitmq/rabbitmq-transport-url-nova-cell1-transport.yaml 2025-10-13 20:48:43.001407 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/ 2025-10-13 20:48:43.001426 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/cert-swift-internal-svc.yaml 2025-10-13 20:48:43.001442 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/cert-swift-public-route.yaml 2025-10-13 20:48:43.001458 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/cert-swift-public-svc.yaml 2025-10-13 20:48:43.001473 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-conf.yaml 2025-10-13 20:48:43.001489 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-conf.yaml-swift.conf 2025-10-13 20:48:43.001505 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-proxy-config-data.yaml 2025-10-13 20:48:43.001520 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-proxy-config-data.yaml-00-proxy-server.conf 2025-10-13 20:48:43.001536 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-proxy-config-data.yaml-01-proxy-server.conf 2025-10-13 20:48:43.001551 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-proxy-config-data.yaml-dispersion.conf 2025-10-13 20:48:43.001567 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-proxy-config-data.yaml-httpd.conf 2025-10-13 20:48:43.001582 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-proxy-config-data.yaml-keymaster.conf 2025-10-13 20:48:43.001598 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/secrets/swift/swift-proxy-config-data.yaml-ssl.conf 2025-10-13 20:48:43.001613 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/ 2025-10-13 20:48:43.001632 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/barbican-internal.yaml 2025-10-13 20:48:43.001649 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/barbican-public.yaml 2025-10-13 20:48:43.001665 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/ceilometer-internal.yaml 2025-10-13 20:48:43.001680 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/cinder-internal.yaml 2025-10-13 20:48:43.001696 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/cinder-public.yaml 2025-10-13 20:48:43.001712 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/dnsmasq-dnsmasq.yaml 2025-10-13 20:48:43.001798 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/glance-default-external-api.yaml 2025-10-13 20:48:43.001825 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/glance-default-internal-api.yaml 2025-10-13 20:48:43.001842 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/glance-default-internal.yaml 2025-10-13 20:48:43.001862 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/glance-default-public.yaml 2025-10-13 20:48:43.001885 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/keystone-internal.yaml 2025-10-13 20:48:43.001909 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/keystone-public.yaml 2025-10-13 20:48:43.001930 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/kube-state-metrics.yaml 2025-10-13 20:48:43.001953 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/memcached.yaml 2025-10-13 20:48:43.001976 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/neutron-internal.yaml 2025-10-13 20:48:43.001993 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/neutron-public.yaml 2025-10-13 20:48:43.002009 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/nova-internal.yaml 2025-10-13 20:48:43.002025 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/nova-metadata-internal.yaml 2025-10-13 20:48:43.002041 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/nova-novncproxy-cell1-public.yaml 2025-10-13 20:48:43.002057 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/nova-public.yaml 2025-10-13 20:48:43.002073 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/openstack-cell1-galera.yaml 2025-10-13 20:48:43.002089 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/openstack-cell1.yaml 2025-10-13 20:48:43.002105 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/openstack-galera.yaml 2025-10-13 20:48:43.002122 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/openstack.yaml 2025-10-13 20:48:43.002138 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/ovn-northd-0.yaml 2025-10-13 20:48:43.002154 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/ovsdbserver-nb-0.yaml 2025-10-13 20:48:43.002170 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/ovsdbserver-nb.yaml 2025-10-13 20:48:43.002186 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/ovsdbserver-sb-0.yaml 2025-10-13 20:48:43.002202 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/ovsdbserver-sb.yaml 2025-10-13 20:48:43.002222 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/placement-internal.yaml 2025-10-13 20:48:43.002238 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/placement-public.yaml 2025-10-13 20:48:43.002253 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/rabbitmq-cell1-nodes.yaml 2025-10-13 20:48:43.002269 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/rabbitmq-cell1.yaml 2025-10-13 20:48:43.002284 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/rabbitmq-nodes.yaml 2025-10-13 20:48:43.002299 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/rabbitmq.yaml 2025-10-13 20:48:43.002315 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/swift-internal.yaml 2025-10-13 20:48:43.002330 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/swift-public.yaml 2025-10-13 20:48:43.002345 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/services/swift-storage.yaml 2025-10-13 20:48:43.002361 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/ 2025-10-13 20:48:43.002385 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/ceilometer.yaml 2025-10-13 20:48:43.002404 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/cinder-api.yaml 2025-10-13 20:48:43.002420 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/cinder-scheduler.yaml 2025-10-13 20:48:43.002436 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/cinder-volume-volume1.yaml 2025-10-13 20:48:43.002456 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/glance-default-external-api.yaml 2025-10-13 20:48:43.002472 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/glance-default-internal-api.yaml 2025-10-13 20:48:43.002488 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/kube-state-metrics.yaml 2025-10-13 20:48:43.002504 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/memcached.yaml 2025-10-13 20:48:43.002519 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/nova-api.yaml 2025-10-13 20:48:43.002535 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/nova-cell0-conductor.yaml 2025-10-13 20:48:43.002550 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/nova-cell1-conductor.yaml 2025-10-13 20:48:43.002565 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/nova-cell1-novncproxy.yaml 2025-10-13 20:48:43.002581 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/nova-metadata.yaml 2025-10-13 20:48:43.002596 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/nova-scheduler.yaml 2025-10-13 20:48:43.002612 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/openstack-cell1-galera.yaml 2025-10-13 20:48:43.002627 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/openstack-galera.yaml 2025-10-13 20:48:43.002643 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/ovn-northd.yaml 2025-10-13 20:48:43.002658 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/ovsdbserver-nb.yaml 2025-10-13 20:48:43.002678 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/ovsdbserver-sb.yaml 2025-10-13 20:48:43.002695 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/rabbitmq-cell1-server.yaml 2025-10-13 20:48:43.002711 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/rabbitmq-server.yaml 2025-10-13 20:48:43.002746 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/statefulset/swift-storage.yaml 2025-10-13 20:48:43.002765 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-kuttl-tests/subscriptions/ 2025-10-13 20:48:43.002781 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/ 2025-10-13 20:48:43.002797 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/all_resources.log 2025-10-13 20:48:43.002812 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/events.log 2025-10-13 20:48:43.002828 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/nad.log 2025-10-13 20:48:43.002843 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pvc.log 2025-10-13 20:48:43.002859 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/buildconfig/ 2025-10-13 20:48:43.002873 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/cert/ 2025-10-13 20:48:43.002888 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/cert/infra-operator-serving-cert.yaml 2025-10-13 20:48:43.002904 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/cert/openstack-baremetal-operator-serving-cert.yaml 2025-10-13 20:48:43.002923 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/cert/openstack-operator-serving-cert.yaml 2025-10-13 20:48:43.002939 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/certificaterequests/ 2025-10-13 20:48:43.002955 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/certificaterequests/infra-operator-serving-cert-1.yaml 2025-10-13 20:48:43.002971 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/certificaterequests/openstack-baremetal-operator-serving-cert-1.yaml 2025-10-13 20:48:43.002987 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/certificaterequests/openstack-operator-serving-cert-1.yaml 2025-10-13 20:48:43.003003 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/configmaps/ 2025-10-13 20:48:43.003019 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/cronjobs/ 2025-10-13 20:48:43.003034 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/crs/ 2025-10-13 20:48:43.003050 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/crs/openstacks.operator.openstack.org/ 2025-10-13 20:48:43.003065 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/crs/openstacks.operator.openstack.org/openstack.yaml 2025-10-13 20:48:43.003081 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/daemonset/ 2025-10-13 20:48:43.003097 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/ 2025-10-13 20:48:43.003113 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/barbican-operator-controller-manager.yaml 2025-10-13 20:48:43.003128 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/cinder-operator-controller-manager.yaml 2025-10-13 20:48:43.003144 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/designate-operator-controller-manager.yaml 2025-10-13 20:48:43.003166 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/glance-operator-controller-manager.yaml 2025-10-13 20:48:43.003182 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/heat-operator-controller-manager.yaml 2025-10-13 20:48:43.003198 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/horizon-operator-controller-manager.yaml 2025-10-13 20:48:43.003214 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/infra-operator-controller-manager.yaml 2025-10-13 20:48:43.003230 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/ironic-operator-controller-manager.yaml 2025-10-13 20:48:43.003246 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/keystone-operator-controller-manager.yaml 2025-10-13 20:48:43.003262 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/manila-operator-controller-manager.yaml 2025-10-13 20:48:43.003277 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/mariadb-operator-controller-manager.yaml 2025-10-13 20:48:43.003292 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/neutron-operator-controller-manager.yaml 2025-10-13 20:48:43.003308 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/nova-operator-controller-manager.yaml 2025-10-13 20:48:43.003323 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/octavia-operator-controller-manager.yaml 2025-10-13 20:48:43.003343 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/openstack-baremetal-operator-controller-manager.yaml 2025-10-13 20:48:43.003389 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/openstack-operator-controller-manager.yaml 2025-10-13 20:48:43.003419 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/openstack-operator-controller-operator.yaml 2025-10-13 20:48:43.003437 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/ovn-operator-controller-manager.yaml 2025-10-13 20:48:43.003454 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/placement-operator-controller-manager.yaml 2025-10-13 20:48:43.003470 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/rabbitmq-cluster-operator-manager.yaml 2025-10-13 20:48:43.003486 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/swift-operator-controller-manager.yaml 2025-10-13 20:48:43.003502 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/telemetry-operator-controller-manager.yaml 2025-10-13 20:48:43.003518 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/test-operator-controller-manager.yaml 2025-10-13 20:48:43.003533 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/deployments/watcher-operator-controller-manager.yaml 2025-10-13 20:48:43.003548 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/imagestream/ 2025-10-13 20:48:43.003564 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/installplans/ 2025-10-13 20:48:43.003581 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/installplans/install-t2hnv 2025-10-13 20:48:43.003597 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/issuer/ 2025-10-13 20:48:43.003613 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/issuer/infra-operator-selfsigned-issuer.yaml 2025-10-13 20:48:43.003630 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/issuer/openstack-baremetal-operator-selfsigned-issuer.yaml 2025-10-13 20:48:43.003649 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/issuer/openstack-operator-selfsigned-issuer.yaml 2025-10-13 20:48:43.003666 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/jobs/ 2025-10-13 20:48:43.003682 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/jobs/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036a29478.yaml 2025-10-13 20:48:43.003698 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ 2025-10-13 20:48:43.003714 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl/ 2025-10-13 20:48:43.003751 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl-describe 2025-10-13 20:48:43.003769 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl/logs/ 2025-10-13 20:48:43.003785 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl/logs/extract.log 2025-10-13 20:48:43.003801 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl/logs/pull.log 2025-10-13 20:48:43.003817 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/32da80840a2017f27ed4ad61f02adc64a25aa18e8dad0409953372036az5dhl/logs/util.log 2025-10-13 20:48:43.003833 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/barbican-operator-controller-manager-658bdf4b74-z9qnq/ 2025-10-13 20:48:43.003849 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/barbican-operator-controller-manager-658bdf4b74-z9qnq/barbican-operator-controller-manager-658bdf4b74-z9qnq-describe 2025-10-13 20:48:43.003868 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/barbican-operator-controller-manager-658bdf4b74-z9qnq/logs/ 2025-10-13 20:48:43.003884 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/barbican-operator-controller-manager-658bdf4b74-z9qnq/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.003900 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/barbican-operator-controller-manager-658bdf4b74-z9qnq/logs/manager.log.gz 2025-10-13 20:48:43.003916 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/cinder-operator-controller-manager-7b7fb68549-bsc2z/ 2025-10-13 20:48:43.003932 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/cinder-operator-controller-manager-7b7fb68549-bsc2z/cinder-operator-controller-manager-7b7fb68549-bsc2z-describe 2025-10-13 20:48:43.003948 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/cinder-operator-controller-manager-7b7fb68549-bsc2z/logs/ 2025-10-13 20:48:43.003964 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/cinder-operator-controller-manager-7b7fb68549-bsc2z/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.003980 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/cinder-operator-controller-manager-7b7fb68549-bsc2z/logs/manager.log.gz 2025-10-13 20:48:43.003996 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/designate-operator-controller-manager-85d5d9dd78-tmbdh/ 2025-10-13 20:48:43.004012 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/designate-operator-controller-manager-85d5d9dd78-tmbdh/designate-operator-controller-manager-85d5d9dd78-tmbdh-describe 2025-10-13 20:48:43.004029 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/designate-operator-controller-manager-85d5d9dd78-tmbdh/logs/ 2025-10-13 20:48:43.004045 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/designate-operator-controller-manager-85d5d9dd78-tmbdh/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004064 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/designate-operator-controller-manager-85d5d9dd78-tmbdh/logs/manager.log 2025-10-13 20:48:43.004080 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/glance-operator-controller-manager-84b9b84486-874c5/ 2025-10-13 20:48:43.004096 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/glance-operator-controller-manager-84b9b84486-874c5/glance-operator-controller-manager-84b9b84486-874c5-describe 2025-10-13 20:48:43.004112 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/glance-operator-controller-manager-84b9b84486-874c5/logs/ 2025-10-13 20:48:43.004129 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/glance-operator-controller-manager-84b9b84486-874c5/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004146 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/glance-operator-controller-manager-84b9b84486-874c5/logs/manager.log.gz 2025-10-13 20:48:43.004162 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/heat-operator-controller-manager-858f76bbdd-sbz6w/ 2025-10-13 20:48:43.004177 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/heat-operator-controller-manager-858f76bbdd-sbz6w/heat-operator-controller-manager-858f76bbdd-sbz6w-describe 2025-10-13 20:48:43.004193 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/heat-operator-controller-manager-858f76bbdd-sbz6w/logs/ 2025-10-13 20:48:43.004209 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/heat-operator-controller-manager-858f76bbdd-sbz6w/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004225 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/heat-operator-controller-manager-858f76bbdd-sbz6w/logs/manager.log 2025-10-13 20:48:43.004241 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/horizon-operator-controller-manager-7ffbcb7588-8zb7s/ 2025-10-13 20:48:43.004257 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/horizon-operator-controller-manager-7ffbcb7588-8zb7s/horizon-operator-controller-manager-7ffbcb7588-8zb7s-describe 2025-10-13 20:48:43.004276 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/horizon-operator-controller-manager-7ffbcb7588-8zb7s/logs/ 2025-10-13 20:48:43.004292 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/horizon-operator-controller-manager-7ffbcb7588-8zb7s/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004308 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/horizon-operator-controller-manager-7ffbcb7588-8zb7s/logs/manager.log 2025-10-13 20:48:43.004324 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/infra-operator-controller-manager-656bcbd775-pfsgv/ 2025-10-13 20:48:43.004340 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/infra-operator-controller-manager-656bcbd775-pfsgv/infra-operator-controller-manager-656bcbd775-pfsgv-describe 2025-10-13 20:48:43.004355 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/infra-operator-controller-manager-656bcbd775-pfsgv/logs/ 2025-10-13 20:48:43.004372 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/infra-operator-controller-manager-656bcbd775-pfsgv/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004388 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/infra-operator-controller-manager-656bcbd775-pfsgv/logs/manager.log.gz 2025-10-13 20:48:43.004404 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ironic-operator-controller-manager-9c5c78d49-j6lnp/ 2025-10-13 20:48:43.004420 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ironic-operator-controller-manager-9c5c78d49-j6lnp/ironic-operator-controller-manager-9c5c78d49-j6lnp-describe 2025-10-13 20:48:43.004436 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ironic-operator-controller-manager-9c5c78d49-j6lnp/logs/ 2025-10-13 20:48:43.004452 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ironic-operator-controller-manager-9c5c78d49-j6lnp/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004472 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ironic-operator-controller-manager-9c5c78d49-j6lnp/logs/manager.log 2025-10-13 20:48:43.004488 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/keystone-operator-controller-manager-55b6b7c7b8-vpmxg/ 2025-10-13 20:48:43.004504 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/keystone-operator-controller-manager-55b6b7c7b8-vpmxg/keystone-operator-controller-manager-55b6b7c7b8-vpmxg-describe 2025-10-13 20:48:43.004519 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/keystone-operator-controller-manager-55b6b7c7b8-vpmxg/logs/ 2025-10-13 20:48:43.004535 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/keystone-operator-controller-manager-55b6b7c7b8-vpmxg/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004551 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/keystone-operator-controller-manager-55b6b7c7b8-vpmxg/logs/manager.log.gz 2025-10-13 20:48:43.004567 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/manila-operator-controller-manager-5f67fbc655-4j2bx/ 2025-10-13 20:48:43.004582 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/manila-operator-controller-manager-5f67fbc655-4j2bx/manila-operator-controller-manager-5f67fbc655-4j2bx-describe 2025-10-13 20:48:43.004598 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/manila-operator-controller-manager-5f67fbc655-4j2bx/logs/ 2025-10-13 20:48:43.004614 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/manila-operator-controller-manager-5f67fbc655-4j2bx/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004636 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/manila-operator-controller-manager-5f67fbc655-4j2bx/logs/manager.log 2025-10-13 20:48:43.004780 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/mariadb-operator-controller-manager-f9fb45f8f-7kcc8/ 2025-10-13 20:48:43.004811 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/mariadb-operator-controller-manager-f9fb45f8f-7kcc8/mariadb-operator-controller-manager-f9fb45f8f-7kcc8-describe 2025-10-13 20:48:43.004829 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/mariadb-operator-controller-manager-f9fb45f8f-7kcc8/logs/ 2025-10-13 20:48:43.004845 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/mariadb-operator-controller-manager-f9fb45f8f-7kcc8/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004862 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/mariadb-operator-controller-manager-f9fb45f8f-7kcc8/logs/manager.log 2025-10-13 20:48:43.004877 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/neutron-operator-controller-manager-79d585cb66-p294z/ 2025-10-13 20:48:43.004893 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/neutron-operator-controller-manager-79d585cb66-p294z/neutron-operator-controller-manager-79d585cb66-p294z-describe 2025-10-13 20:48:43.004909 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/neutron-operator-controller-manager-79d585cb66-p294z/logs/ 2025-10-13 20:48:43.004924 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/neutron-operator-controller-manager-79d585cb66-p294z/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.004940 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/neutron-operator-controller-manager-79d585cb66-p294z/logs/manager.log.gz 2025-10-13 20:48:43.004956 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/nova-operator-controller-manager-5df598886f-rc6sk/ 2025-10-13 20:48:43.004971 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/nova-operator-controller-manager-5df598886f-rc6sk/nova-operator-controller-manager-5df598886f-rc6sk-describe 2025-10-13 20:48:43.004987 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/nova-operator-controller-manager-5df598886f-rc6sk/logs/ 2025-10-13 20:48:43.005005 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/nova-operator-controller-manager-5df598886f-rc6sk/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005021 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/nova-operator-controller-manager-5df598886f-rc6sk/logs/manager.log.gz 2025-10-13 20:48:43.005037 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/octavia-operator-controller-manager-69fdcfc5f5-mtsxj/ 2025-10-13 20:48:43.005053 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/octavia-operator-controller-manager-69fdcfc5f5-mtsxj/octavia-operator-controller-manager-69fdcfc5f5-mtsxj-describe 2025-10-13 20:48:43.005069 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/octavia-operator-controller-manager-69fdcfc5f5-mtsxj/logs/ 2025-10-13 20:48:43.005085 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/octavia-operator-controller-manager-69fdcfc5f5-mtsxj/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005118 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/octavia-operator-controller-manager-69fdcfc5f5-mtsxj/logs/manager.log 2025-10-13 20:48:43.005136 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-baremetal-operator-controller-manager-55b7d44848b86ln/ 2025-10-13 20:48:43.005153 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-baremetal-operator-controller-manager-55b7d44848b86ln/openstack-baremetal-operator-controller-manager-55b7d44848b86ln-describe 2025-10-13 20:48:43.005169 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-baremetal-operator-controller-manager-55b7d44848b86ln/logs/ 2025-10-13 20:48:43.005185 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-baremetal-operator-controller-manager-55b7d44848b86ln/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005201 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-baremetal-operator-controller-manager-55b7d44848b86ln/logs/manager.log 2025-10-13 20:48:43.005221 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-manager-7fb8c88b76-7cnqn/ 2025-10-13 20:48:43.005237 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-manager-7fb8c88b76-7cnqn/openstack-operator-controller-manager-7fb8c88b76-7cnqn-describe 2025-10-13 20:48:43.005253 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-manager-7fb8c88b76-7cnqn/logs/ 2025-10-13 20:48:43.005269 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-manager-7fb8c88b76-7cnqn/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005285 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-manager-7fb8c88b76-7cnqn/logs/manager.log.gz 2025-10-13 20:48:43.005301 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-operator-64895cd698-wnhtw/ 2025-10-13 20:48:43.005317 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-operator-64895cd698-wnhtw/openstack-operator-controller-operator-64895cd698-wnhtw-describe 2025-10-13 20:48:43.005333 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-operator-64895cd698-wnhtw/logs/ 2025-10-13 20:48:43.005349 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-operator-64895cd698-wnhtw/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005364 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-controller-operator-64895cd698-wnhtw/logs/operator.log 2025-10-13 20:48:43.005380 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-index-lqcbc/ 2025-10-13 20:48:43.005395 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-index-lqcbc/openstack-operator-index-lqcbc-describe 2025-10-13 20:48:43.005416 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-index-lqcbc/logs/ 2025-10-13 20:48:43.005432 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/openstack-operator-index-lqcbc/logs/registry-server.log 2025-10-13 20:48:43.005448 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ovn-operator-controller-manager-79df5fb58c-rw9zt/ 2025-10-13 20:48:43.005464 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ovn-operator-controller-manager-79df5fb58c-rw9zt/ovn-operator-controller-manager-79df5fb58c-rw9zt-describe 2025-10-13 20:48:43.005480 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ovn-operator-controller-manager-79df5fb58c-rw9zt/logs/ 2025-10-13 20:48:43.005495 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ovn-operator-controller-manager-79df5fb58c-rw9zt/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005511 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/ovn-operator-controller-manager-79df5fb58c-rw9zt/logs/manager.log 2025-10-13 20:48:43.005526 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/placement-operator-controller-manager-68b6c87b68-xnsxb/ 2025-10-13 20:48:43.005542 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/placement-operator-controller-manager-68b6c87b68-xnsxb/placement-operator-controller-manager-68b6c87b68-xnsxb-describe 2025-10-13 20:48:43.005558 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/placement-operator-controller-manager-68b6c87b68-xnsxb/logs/ 2025-10-13 20:48:43.005574 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/placement-operator-controller-manager-68b6c87b68-xnsxb/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005589 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/placement-operator-controller-manager-68b6c87b68-xnsxb/logs/manager.log 2025-10-13 20:48:43.005605 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl/ 2025-10-13 20:48:43.005623 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl/rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl-describe 2025-10-13 20:48:43.005639 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl/logs/ 2025-10-13 20:48:43.005656 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/rabbitmq-cluster-operator-manager-5f97d8c699-xqkbl/logs/operator.log 2025-10-13 20:48:43.005672 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/swift-operator-controller-manager-db6d7f97b-vvrmm/ 2025-10-13 20:48:43.005688 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/swift-operator-controller-manager-db6d7f97b-vvrmm/swift-operator-controller-manager-db6d7f97b-vvrmm-describe 2025-10-13 20:48:43.005704 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/swift-operator-controller-manager-db6d7f97b-vvrmm/logs/ 2025-10-13 20:48:43.005720 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/swift-operator-controller-manager-db6d7f97b-vvrmm/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005760 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/swift-operator-controller-manager-db6d7f97b-vvrmm/logs/manager.log 2025-10-13 20:48:43.005778 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/telemetry-operator-controller-manager-67cfc6749b-wjlfw/ 2025-10-13 20:48:43.005794 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/telemetry-operator-controller-manager-67cfc6749b-wjlfw/telemetry-operator-controller-manager-67cfc6749b-wjlfw-describe 2025-10-13 20:48:43.005810 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/telemetry-operator-controller-manager-67cfc6749b-wjlfw/logs/ 2025-10-13 20:48:43.005825 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/telemetry-operator-controller-manager-67cfc6749b-wjlfw/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005845 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/telemetry-operator-controller-manager-67cfc6749b-wjlfw/logs/manager.log.gz 2025-10-13 20:48:43.005860 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/test-operator-controller-manager-5458f77c4-xrndg/ 2025-10-13 20:48:43.005876 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/test-operator-controller-manager-5458f77c4-xrndg/test-operator-controller-manager-5458f77c4-xrndg-describe 2025-10-13 20:48:43.005892 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/test-operator-controller-manager-5458f77c4-xrndg/logs/ 2025-10-13 20:48:43.005908 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/test-operator-controller-manager-5458f77c4-xrndg/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.005924 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/test-operator-controller-manager-5458f77c4-xrndg/logs/manager.log 2025-10-13 20:48:43.005940 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/watcher-operator-controller-manager-7f554bff7b-mhwvn/ 2025-10-13 20:48:43.005956 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/watcher-operator-controller-manager-7f554bff7b-mhwvn/watcher-operator-controller-manager-7f554bff7b-mhwvn-describe 2025-10-13 20:48:43.005972 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/watcher-operator-controller-manager-7f554bff7b-mhwvn/logs/ 2025-10-13 20:48:43.005988 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/watcher-operator-controller-manager-7f554bff7b-mhwvn/logs/kube-rbac-proxy.log 2025-10-13 20:48:43.006003 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/pods/watcher-operator-controller-manager-7f554bff7b-mhwvn/logs/manager.log 2025-10-13 20:48:43.006020 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/ 2025-10-13 20:48:43.006036 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/barbican-operator-controller-manager-658bdf4b74.yaml 2025-10-13 20:48:43.006055 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/cinder-operator-controller-manager-7b7fb68549.yaml 2025-10-13 20:48:43.006071 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/designate-operator-controller-manager-85d5d9dd78.yaml 2025-10-13 20:48:43.006087 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/glance-operator-controller-manager-84b9b84486.yaml 2025-10-13 20:48:43.006103 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/heat-operator-controller-manager-858f76bbdd.yaml 2025-10-13 20:48:43.006118 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/horizon-operator-controller-manager-7ffbcb7588.yaml 2025-10-13 20:48:43.006134 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/infra-operator-controller-manager-656bcbd775.yaml 2025-10-13 20:48:43.006149 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/ironic-operator-controller-manager-9c5c78d49.yaml 2025-10-13 20:48:43.006164 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/keystone-operator-controller-manager-55b6b7c7b8.yaml 2025-10-13 20:48:43.006180 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/manila-operator-controller-manager-5f67fbc655.yaml 2025-10-13 20:48:43.006195 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/mariadb-operator-controller-manager-f9fb45f8f.yaml 2025-10-13 20:48:43.006210 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/neutron-operator-controller-manager-79d585cb66.yaml 2025-10-13 20:48:43.006225 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/nova-operator-controller-manager-5df598886f.yaml 2025-10-13 20:48:43.006243 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/octavia-operator-controller-manager-69fdcfc5f5.yaml 2025-10-13 20:48:43.006259 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/openstack-baremetal-operator-controller-manager-55b7d44848.yaml 2025-10-13 20:48:43.006274 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/openstack-operator-controller-manager-7fb8c88b76.yaml 2025-10-13 20:48:43.006291 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/openstack-operator-controller-operator-64895cd698.yaml 2025-10-13 20:48:43.006313 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/ovn-operator-controller-manager-79df5fb58c.yaml 2025-10-13 20:48:43.006334 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/placement-operator-controller-manager-68b6c87b68.yaml 2025-10-13 20:48:43.006355 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/rabbitmq-cluster-operator-manager-5f97d8c699.yaml 2025-10-13 20:48:43.006375 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/swift-operator-controller-manager-db6d7f97b.yaml 2025-10-13 20:48:43.006394 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/telemetry-operator-controller-manager-67cfc6749b.yaml 2025-10-13 20:48:43.006411 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/test-operator-controller-manager-5458f77c4.yaml 2025-10-13 20:48:43.006426 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/replicaset/watcher-operator-controller-manager-7f554bff7b.yaml 2025-10-13 20:48:43.006442 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/routes/ 2025-10-13 20:48:43.006458 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/ 2025-10-13 20:48:43.006476 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/barbican-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006501 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/cinder-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006517 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/controller-operator-metrics-service-operator.yaml 2025-10-13 20:48:43.006533 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/designate-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006549 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/glance-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006566 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/heat-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006582 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/horizon-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006598 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/infra-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006614 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/infra-operator-webhook-service.yaml 2025-10-13 20:48:43.006629 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/ironic-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006645 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/keystone-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006661 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/manila-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006676 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/mariadb-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006695 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/neutron-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006711 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/nova-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006743 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/octavia-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006761 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/openstack-baremetal-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006777 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/openstack-baremetal-operator-webhook-service.yaml 2025-10-13 20:48:43.006792 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/openstack-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006808 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/openstack-operator-index.yaml 2025-10-13 20:48:43.006824 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/openstack-operator-webhook-service.yaml 2025-10-13 20:48:43.006840 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/ovn-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006857 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/placement-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006873 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/rabbitmq-cluster-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006890 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/swift-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006906 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/telemetry-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006926 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/test-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006943 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/services/watcher-operator-controller-manager-metrics-service.yaml 2025-10-13 20:48:43.006959 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/statefulset/ 2025-10-13 20:48:43.006975 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/subscriptions/ 2025-10-13 20:48:43.006991 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack-operators/subscriptions/openstack-operator 2025-10-13 20:48:43.007007 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/ 2025-10-13 20:48:43.007023 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/all_resources.log 2025-10-13 20:48:43.007039 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/events.log 2025-10-13 20:48:43.007055 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/nad.log 2025-10-13 20:48:43.007071 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/pvc.log 2025-10-13 20:48:43.007086 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/buildconfig/ 2025-10-13 20:48:43.007102 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/cert/ 2025-10-13 20:48:43.007118 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/certificaterequests/ 2025-10-13 20:48:43.007133 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/configmaps/ 2025-10-13 20:48:43.007149 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/cronjobs/ 2025-10-13 20:48:43.007167 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/daemonset/ 2025-10-13 20:48:43.007183 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/deployments/ 2025-10-13 20:48:43.007199 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/imagestream/ 2025-10-13 20:48:43.007214 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/installplans/ 2025-10-13 20:48:43.007229 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/issuer/ 2025-10-13 20:48:43.007245 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/jobs/ 2025-10-13 20:48:43.007261 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/pods/ 2025-10-13 20:48:43.007276 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/pods/-describe 2025-10-13 20:48:43.007292 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/pods/logs/ 2025-10-13 20:48:43.007308 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/replicaset/ 2025-10-13 20:48:43.007323 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/routes/ 2025-10-13 20:48:43.007338 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/services/ 2025-10-13 20:48:43.007354 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/statefulset/ 2025-10-13 20:48:43.007369 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/namespaces/openstack/subscriptions/ 2025-10-13 20:48:43.007385 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/ 2025-10-13 20:48:43.007400 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/l2advertisement.log 2025-10-13 20:48:43.007419 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/ipaddresspools/ 2025-10-13 20:48:43.007435 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/ipaddresspools/ctlplane.log 2025-10-13 20:48:43.007451 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/ipaddresspools/designateext.log 2025-10-13 20:48:43.007467 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/ipaddresspools/internalapi.log 2025-10-13 20:48:43.007482 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/ipaddresspools/storage.log 2025-10-13 20:48:43.007497 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/ipaddresspools/tenant.log 2025-10-13 20:48:43.007513 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/nnce/ 2025-10-13 20:48:43.007529 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/nnce/crc.ens7-crc.log 2025-10-13 20:48:43.007545 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/nncp/ 2025-10-13 20:48:43.007561 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/nncp/ens7-crc.log 2025-10-13 20:48:43.007576 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/nns/ 2025-10-13 20:48:43.007592 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/network/nns/crc.log 2025-10-13 20:48:43.007608 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/nodes/ 2025-10-13 20:48:43.007623 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/nodes/crc.describe 2025-10-13 20:48:43.007639 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/nodes/crc.yaml 2025-10-13 20:48:43.007655 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/sos-reports/ 2025-10-13 20:48:43.007670 | controller | cL+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/sos-reports/sos-report- -> ../_all_nodes/sosreport- 2025-10-13 20:48:43.007689 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/sos-reports/_all_nodes/ 2025-10-13 20:48:43.007706 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/ 2025-10-13 20:48:43.007722 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/mutating/ 2025-10-13 20:48:43.007756 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/mutating/cert-manager-webhook.yaml 2025-10-13 20:48:43.007772 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/mutating/infra-operator-mutating-webhook-configuration.yaml 2025-10-13 20:48:43.007788 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/mutating/nmstate.yaml 2025-10-13 20:48:43.007804 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/mutating/openstack-baremetal-operator-mutating-webhook-configuration.yaml 2025-10-13 20:48:43.007819 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/mutating/openstack-operator-mutating-webhook-configuration.yaml 2025-10-13 20:48:43.007835 | controller | cd+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/ 2025-10-13 20:48:43.007850 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/alertmanagerconfigs.monitoring.rhobs-2fs7j.yaml 2025-10-13 20:48:43.007866 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/bfdprofilevalidationwebhook.metallb.io-m8sq5.yaml 2025-10-13 20:48:43.007882 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/bgpadvertisementvalidationwebhook.metallb.io-qmjkw.yaml 2025-10-13 20:48:43.007898 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/bgppeersvalidationwebhook.metallb.io-r6k9f.yaml 2025-10-13 20:48:43.007913 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/cert-manager-webhook.yaml 2025-10-13 20:48:43.007930 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/communityvalidationwebhook.metallb.io-rb4tk.yaml 2025-10-13 20:48:43.007949 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/controlplanemachineset.machine.openshift.io.yaml 2025-10-13 20:48:43.007966 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/frr-k8s-validating-webhook-configuration.yaml 2025-10-13 20:48:43.007983 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/infra-operator-validating-webhook-configuration.yaml 2025-10-13 20:48:43.007998 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/ipaddresspoolvalidationwebhook.metallb.io-5n6cl.yaml 2025-10-13 20:48:43.008014 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/l2advertisementvalidationwebhook.metallb.io-vhjjr.yaml 2025-10-13 20:48:43.008030 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/metallbvalidationwebhook.metallb.io-n6jzp.yaml 2025-10-13 20:48:43.008045 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/monitoringconfigmaps.openshift.io.yaml 2025-10-13 20:48:43.008061 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/multus.openshift.io.yaml 2025-10-13 20:48:43.008077 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/network-node-identity.openshift.io.yaml 2025-10-13 20:48:43.008093 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/openstack-baremetal-operator-validating-webhook-configuration.yaml 2025-10-13 20:48:43.008109 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/openstack-operator-validating-webhook-configuration.yaml 2025-10-13 20:48:43.008124 | controller | >f+++++++++ ci-framework-data/logs/openstack-must-gather/quay-io-openstack-k8s-operators-openstack-must-gather-sha256-e47a4aa8269216b0129e9fddb38d1be800ea526ade3cd3a21f4ec3db47293d73/webhooks/validating/prometheusrules.monitoring.rhobs-nt9dh.yaml 2025-10-13 20:48:43.008140 | controller | cd+++++++++ ci-framework-data/tests/ 2025-10-13 20:48:43.008157 | controller | cd+++++++++ ci-framework-data/tests/kuttl_openstack/ 2025-10-13 20:48:43.008173 | controller | >f+++++++++ ci-framework-data/tests/kuttl_openstack/kuttl-report-openstack.xml 2025-10-13 20:48:43.008191 | controller | cd+++++++++ registries.conf.d/ 2025-10-13 20:48:43.008210 | controller | >f+++++++++ registries.conf.d/000-shortnames.conf 2025-10-13 20:48:43.008227 | controller | cd+++++++++ system-config/ 2025-10-13 20:48:43.008243 | controller | cd+++++++++ system-config/libvirt/ 2025-10-13 20:48:43.008259 | controller | >f+++++++++ system-config/libvirt/libvirt-admin.conf 2025-10-13 20:48:43.008275 | controller | >f+++++++++ system-config/libvirt/libvirt.conf 2025-10-13 20:48:43.584463 | controller | changed: .d..t...... ./ 2025-10-13 20:48:44.153590 | controller | changed: .d..t...... ./ 2025-10-13 20:48:44.276404 | 2025-10-13 20:48:44.276516 | TASK [Return artifact to Zuul] 2025-10-13 20:48:44.311604 | controller | skipping: Conditional result was False 2025-10-13 20:48:44.421111 | 2025-10-13 20:48:44.421212 | PLAY [Run ci/playbooks/collect-logs.yml on CRC host] 2025-10-13 20:48:44.481754 | 2025-10-13 20:48:44.481872 | TASK [Get kubelet journalctl logs] 2025-10-13 20:48:47.026007 | crc | Output suppressed because no_log was given 2025-10-13 20:48:47.052314 | 2025-10-13 20:48:47.052389 | PLAY RECAP 2025-10-13 20:48:47.052434 | controller | ok: 15 changed: 11 unreachable: 0 failed: 0 skipped: 7 rescued: 0 ignored: 1 2025-10-13 20:48:47.052461 | crc | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-13 20:48:47.052480 | 2025-10-13 20:48:47.181070 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/collect-logs.yml@main] 2025-10-13 20:48:47.187674 | POST-RUN START: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml@main] 2025-10-13 20:48:47.761693 | 2025-10-13 20:48:47.761819 | PLAY [Run ci/playbooks/multinode-autohold.yml] 2025-10-13 20:48:47.849456 | 2025-10-13 20:48:47.849598 | TASK [Verify if "success" flag exists after successful tests execution] 2025-10-13 20:48:48.523460 | controller | ok 2025-10-13 20:48:48.551911 | 2025-10-13 20:48:48.552074 | TASK [Fetch existing autoholds from zuul] 2025-10-13 20:48:48.674510 | controller | ok 2025-10-13 20:48:48.737521 | 2025-10-13 20:48:48.737641 | TASK [krb_request : Perform the request] 2025-10-13 20:48:49.536004 | controller | ok 2025-10-13 20:48:49.588151 | 2025-10-13 20:48:49.588262 | TASK [Check if any autohold matches] 2025-10-13 20:48:49.663299 | controller | skipping: Conditional result was False 2025-10-13 20:48:49.839070 | 2025-10-13 20:48:49.839172 | PLAY RECAP 2025-10-13 20:48:49.839223 | controller | ok: 2 changed: 0 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2025-10-13 20:48:49.839244 | 2025-10-13 20:48:49.929243 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/openstack-k8s-operators/ci-framework/ci/playbooks/multinode-autohold.yml@main] 2025-10-13 20:48:49.932577 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml@master] 2025-10-13 20:48:50.514154 | 2025-10-13 20:48:50.514274 | PLAY [crc] 2025-10-13 20:48:50.541299 | 2025-10-13 20:48:50.541399 | TASK [Print machineconfigpool] 2025-10-13 20:48:51.391079 | crc | NAME CONFIG UPDATED UPDATING DEGRADED MACHINECOUNT READYMACHINECOUNT UPDATEDMACHINECOUNT DEGRADEDMACHINECOUNT AGE 2025-10-13 20:48:51.391185 | crc | master rendered-master-f83a149c7490c3b0bf850df839837383 False False True 1 0 0 1 232d 2025-10-13 20:48:51.391213 | crc | worker rendered-worker-594cc07c9feefb5e37f2530ac457d36c True False False 0 0 0 0 232d 2025-10-13 20:48:51.582535 | crc | changed 2025-10-13 20:48:51.637343 | 2025-10-13 20:48:51.637442 | PLAY RECAP 2025-10-13 20:48:51.637504 | crc | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-13 20:48:51.637534 | 2025-10-13 20:48:51.733490 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/crc/print-machineconfigpool.yaml@master] 2025-10-13 20:48:51.741190 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/crc/compress-crc-cloud-logs.yaml@master] 2025-10-13 20:48:52.329241 | 2025-10-13 20:48:52.329345 | PLAY [crc] 2025-10-13 20:48:52.355829 | 2025-10-13 20:48:52.355917 | TASK [Create compressed log tar gz file - crc-cloud logs] 2025-10-13 20:48:53.104410 | crc | tar: Removing leading `/' from member names 2025-10-13 20:48:53.104483 | crc | tar: /var/home/core/workdir/*log: Cannot stat: No such file or directory 2025-10-13 20:48:53.111187 | crc | tar: Exiting with failure status due to previous errors 2025-10-13 20:48:53.395059 | crc | ok 2025-10-13 20:48:53.410024 | 2025-10-13 20:48:53.410161 | TASK [Copy crc-cloud logs] 2025-10-13 20:48:53.805941 | crc | cp: cannot stat '/var/home/core/workdir/*log': No such file or directory 2025-10-13 20:48:53.974285 | crc | ok 2025-10-13 20:48:54.030365 | 2025-10-13 20:48:54.030455 | PLAY RECAP 2025-10-13 20:48:54.030509 | crc | ok: 2 changed: 0 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-13 20:48:54.030536 | 2025-10-13 20:48:54.129239 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/crc/compress-crc-cloud-logs.yaml@master] 2025-10-13 20:48:54.132558 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/crc/compress-logs.yaml@master] 2025-10-13 20:48:54.707792 | 2025-10-13 20:48:54.707900 | PLAY [all] 2025-10-13 20:48:54.838069 | 2025-10-13 20:48:54.838211 | TASK [Create compressed log tar gz file - ci-framework-data] 2025-10-13 20:48:55.578807 | controller | tar: Removing leading `/' from member names 2025-10-13 20:48:55.702951 | crc | tar: Removing leading `/' from member names 2025-10-13 20:48:55.707266 | crc | tar: /var/home/core/ci-framework-data: Cannot stat: No such file or directory 2025-10-13 20:48:55.707286 | crc | tar: Exiting with failure status due to previous errors 2025-10-13 20:48:55.709691 | crc | mv: cannot move '/var/home/core/ci-framework-data-crc-all-logs.tar.gz' to '/var/home/core/ci-framework-data/logs/ci-framework-data-crc-all-logs.tar.gz': No such file or directory 2025-10-13 20:48:55.711488 | crc | chown: cannot access '/var/home/core/ci-framework-data/logs/ci-framework-data-crc-all-logs.tar.gz': No such file or directory 2025-10-13 20:48:56.008429 | crc | ERROR 2025-10-13 20:48:56.008816 | crc | { 2025-10-13 20:48:56.008891 | crc | "delta": "0:00:00.015438", 2025-10-13 20:48:56.008937 | crc | "end": "2025-10-13 20:48:55.711924", 2025-10-13 20:48:56.008976 | crc | "msg": "non-zero return code", 2025-10-13 20:48:56.009013 | crc | "rc": 1, 2025-10-13 20:48:56.009051 | crc | "start": "2025-10-13 20:48:55.696486" 2025-10-13 20:48:56.009086 | crc | } 2025-10-13 20:48:56.009149 | crc | ERROR: Ignoring Errors 2025-10-13 20:49:05.707255 | controller | ok 2025-10-13 20:49:05.733764 | 2025-10-13 20:49:05.733888 | TASK [Create compressed log tar gz file - zuul-output] 2025-10-13 20:49:06.224458 | controller | tar: Removing leading `/' from member names 2025-10-13 20:49:06.270406 | crc | tar: Removing leading `/' from member names 2025-10-13 20:49:06.927550 | crc | ok 2025-10-13 20:49:09.443228 | controller | ok 2025-10-13 20:49:09.602544 | 2025-10-13 20:49:09.602654 | PLAY RECAP 2025-10-13 20:49:09.602697 | controller | ok: 2 changed: 0 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2025-10-13 20:49:09.602738 | crc | ok: 2 changed: 0 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1 2025-10-13 20:49:09.602762 | 2025-10-13 20:49:09.694225 | POST-RUN END RESULT_NORMAL: [trusted : review.rdoproject.org/config/playbooks/crc/compress-logs.yaml@master] 2025-10-13 20:49:09.697564 | POST-RUN START: [trusted : review.rdoproject.org/config/playbooks/crc/bootstraped-ci-network-cleanup.yml@master] 2025-10-13 20:49:10.275326 | 2025-10-13 20:49:10.275502 | PLAY [Run playbooks/crc/bootstraped-ci-network-cleanup.yml] 2025-10-13 20:49:10.361743 | 2025-10-13 20:49:10.361873 | TASK [Create openstack config dir] 2025-10-13 20:49:10.998305 | controller | ok 2025-10-13 20:49:11.024906 | 2025-10-13 20:49:11.025003 | TASK [Check for cleanup skip flag file presence] 2025-10-13 20:49:11.473270 | controller | ok 2025-10-13 20:49:11.500009 | 2025-10-13 20:49:11.500125 | TASK [Generate clouds config from cloud_secrets secret] 2025-10-13 20:49:11.775859 | controller | ERROR 2025-10-13 20:49:11.776131 | controller | { 2025-10-13 20:49:11.776176 | controller | "exception": "Traceback (most recent call last):\n File \"/usr/lib/zuul/ansible/8/lib/python3.11/site-packages/ansible/template/__init__.py\", line 1015, in do_template\n res = myenv.concat(rf)\n ^^^^^^^^^^^^^^^^\n File \"/usr/lib/zuul/ansible/8/lib/python3.11/site-packages/ansible/template/native_helpers.py\", line 83, in ansible_concat\n return ''.join([to_text(v) for v in nodes])\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"/usr/lib/zuul/ansible/8/lib/python3.11/site-packages/ansible/template/native_helpers.py\", line 83, in \n return ''.join([to_text(v) for v in nodes])\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File \"