2025-10-13 19:31:40,643 p=27415 u=zuul n=ansible | Starting galaxy collection install process 2025-10-13 19:31:40,643 p=27415 u=zuul n=ansible | Process install dependency map 2025-10-13 19:31:55,656 p=27415 u=zuul n=ansible | Starting collection install process 2025-10-13 19:31:55,656 p=27415 u=zuul n=ansible | Installing 'cifmw.general:1.0.0+c48116c3' to '/home/zuul/.ansible/collections/ansible_collections/cifmw/general' 2025-10-13 19:31:56,111 p=27415 u=zuul n=ansible | Created collection for cifmw.general:1.0.0+c48116c3 at /home/zuul/.ansible/collections/ansible_collections/cifmw/general 2025-10-13 19:31:56,111 p=27415 u=zuul n=ansible | cifmw.general:1.0.0+c48116c3 was installed successfully 2025-10-13 19:31:56,111 p=27415 u=zuul n=ansible | Installing 'containers.podman:1.16.2' to '/home/zuul/.ansible/collections/ansible_collections/containers/podman' 2025-10-13 19:31:56,166 p=27415 u=zuul n=ansible | Created collection for containers.podman:1.16.2 at /home/zuul/.ansible/collections/ansible_collections/containers/podman 2025-10-13 19:31:56,166 p=27415 u=zuul n=ansible | containers.podman:1.16.2 was installed successfully 2025-10-13 19:31:56,166 p=27415 u=zuul n=ansible | Installing 'community.general:10.0.1' to '/home/zuul/.ansible/collections/ansible_collections/community/general' 2025-10-13 19:31:56,919 p=27415 u=zuul n=ansible | Created collection for community.general:10.0.1 at /home/zuul/.ansible/collections/ansible_collections/community/general 2025-10-13 19:31:56,919 p=27415 u=zuul n=ansible | community.general:10.0.1 was installed successfully 2025-10-13 19:31:56,919 p=27415 u=zuul n=ansible | Installing 'ansible.posix:1.6.2' to '/home/zuul/.ansible/collections/ansible_collections/ansible/posix' 2025-10-13 19:31:56,965 p=27415 u=zuul n=ansible | Created collection for ansible.posix:1.6.2 at /home/zuul/.ansible/collections/ansible_collections/ansible/posix 2025-10-13 19:31:56,965 p=27415 u=zuul n=ansible | ansible.posix:1.6.2 was installed successfully 2025-10-13 19:31:56,965 p=27415 u=zuul n=ansible | Installing 'ansible.utils:5.1.2' to '/home/zuul/.ansible/collections/ansible_collections/ansible/utils' 2025-10-13 19:31:57,057 p=27415 u=zuul n=ansible | Created collection for ansible.utils:5.1.2 at /home/zuul/.ansible/collections/ansible_collections/ansible/utils 2025-10-13 19:31:57,057 p=27415 u=zuul n=ansible | ansible.utils:5.1.2 was installed successfully 2025-10-13 19:31:57,057 p=27415 u=zuul n=ansible | Installing 'community.libvirt:1.3.0' to '/home/zuul/.ansible/collections/ansible_collections/community/libvirt' 2025-10-13 19:31:57,081 p=27415 u=zuul n=ansible | Created collection for community.libvirt:1.3.0 at /home/zuul/.ansible/collections/ansible_collections/community/libvirt 2025-10-13 19:31:57,081 p=27415 u=zuul n=ansible | community.libvirt:1.3.0 was installed successfully 2025-10-13 19:31:57,081 p=27415 u=zuul n=ansible | Installing 'community.crypto:2.22.3' to '/home/zuul/.ansible/collections/ansible_collections/community/crypto' 2025-10-13 19:31:57,222 p=27415 u=zuul n=ansible | Created collection for community.crypto:2.22.3 at /home/zuul/.ansible/collections/ansible_collections/community/crypto 2025-10-13 19:31:57,222 p=27415 u=zuul n=ansible | community.crypto:2.22.3 was installed successfully 2025-10-13 19:31:57,222 p=27415 u=zuul n=ansible | Installing 'kubernetes.core:5.0.0' to '/home/zuul/.ansible/collections/ansible_collections/kubernetes/core' 2025-10-13 19:31:57,335 p=27415 u=zuul n=ansible | Created collection for kubernetes.core:5.0.0 at /home/zuul/.ansible/collections/ansible_collections/kubernetes/core 2025-10-13 19:31:57,335 p=27415 u=zuul n=ansible | kubernetes.core:5.0.0 was installed successfully 2025-10-13 19:31:57,335 p=27415 u=zuul n=ansible | Installing 'ansible.netcommon:7.1.0' to '/home/zuul/.ansible/collections/ansible_collections/ansible/netcommon' 2025-10-13 19:31:57,400 p=27415 u=zuul n=ansible | Created collection for ansible.netcommon:7.1.0 at /home/zuul/.ansible/collections/ansible_collections/ansible/netcommon 2025-10-13 19:31:57,400 p=27415 u=zuul n=ansible | ansible.netcommon:7.1.0 was installed successfully 2025-10-13 19:31:57,400 p=27415 u=zuul n=ansible | Installing 'openstack.config_template:2.1.1' to '/home/zuul/.ansible/collections/ansible_collections/openstack/config_template' 2025-10-13 19:31:57,417 p=27415 u=zuul n=ansible | Created collection for openstack.config_template:2.1.1 at /home/zuul/.ansible/collections/ansible_collections/openstack/config_template 2025-10-13 19:31:57,417 p=27415 u=zuul n=ansible | openstack.config_template:2.1.1 was installed successfully 2025-10-13 19:31:57,417 p=27415 u=zuul n=ansible | Installing 'junipernetworks.junos:9.1.0' to '/home/zuul/.ansible/collections/ansible_collections/junipernetworks/junos' 2025-10-13 19:31:57,640 p=27415 u=zuul n=ansible | Created collection for junipernetworks.junos:9.1.0 at /home/zuul/.ansible/collections/ansible_collections/junipernetworks/junos 2025-10-13 19:31:57,640 p=27415 u=zuul n=ansible | junipernetworks.junos:9.1.0 was installed successfully 2025-10-13 19:31:57,640 p=27415 u=zuul n=ansible | Installing 'cisco.ios:9.0.3' to '/home/zuul/.ansible/collections/ansible_collections/cisco/ios' 2025-10-13 19:31:57,886 p=27415 u=zuul n=ansible | Created collection for cisco.ios:9.0.3 at /home/zuul/.ansible/collections/ansible_collections/cisco/ios 2025-10-13 19:31:57,886 p=27415 u=zuul n=ansible | cisco.ios:9.0.3 was installed successfully 2025-10-13 19:31:57,887 p=27415 u=zuul n=ansible | Installing 'mellanox.onyx:1.0.0' to '/home/zuul/.ansible/collections/ansible_collections/mellanox/onyx' 2025-10-13 19:31:57,919 p=27415 u=zuul n=ansible | Created collection for mellanox.onyx:1.0.0 at /home/zuul/.ansible/collections/ansible_collections/mellanox/onyx 2025-10-13 19:31:57,919 p=27415 u=zuul n=ansible | mellanox.onyx:1.0.0 was installed successfully 2025-10-13 19:31:57,919 p=27415 u=zuul n=ansible | Installing 'community.okd:4.0.0' to '/home/zuul/.ansible/collections/ansible_collections/community/okd' 2025-10-13 19:31:57,947 p=27415 u=zuul n=ansible | Created collection for community.okd:4.0.0 at /home/zuul/.ansible/collections/ansible_collections/community/okd 2025-10-13 19:31:57,947 p=27415 u=zuul n=ansible | community.okd:4.0.0 was installed successfully 2025-10-13 19:31:57,947 p=27415 u=zuul n=ansible | Installing '@NAMESPACE@.@NAME@:3.1.4' to '/home/zuul/.ansible/collections/ansible_collections/@NAMESPACE@/@NAME@' 2025-10-13 19:31:58,033 p=27415 u=zuul n=ansible | Created collection for @NAMESPACE@.@NAME@:3.1.4 at /home/zuul/.ansible/collections/ansible_collections/@NAMESPACE@/@NAME@ 2025-10-13 19:31:58,034 p=27415 u=zuul n=ansible | @NAMESPACE@.@NAME@:3.1.4 was installed successfully 2025-10-13 19:32:12,793 p=28354 u=zuul n=ansible | PLAY [Bootstrap playbook] ****************************************************** 2025-10-13 19:32:12,811 p=28354 u=zuul n=ansible | TASK [Gathering Facts ] ******************************************************** 2025-10-13 19:32:12,811 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:12 +0000 (0:00:00.033) 0:00:00.033 ******** 2025-10-13 19:32:13,741 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:13,756 p=28354 u=zuul n=ansible | TASK [cifmw_setup : Set custom cifmw PATH reusable fact cifmw_path={{ ansible_user_dir }}/.crc/bin:{{ ansible_user_dir }}/.crc/bin/oc:{{ ansible_user_dir }}/bin:{{ ansible_env.PATH }}, cacheable=True] *** 2025-10-13 19:32:13,756 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:13 +0000 (0:00:00.944) 0:00:00.977 ******** 2025-10-13 19:32:13,778 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:13,783 p=28354 u=zuul n=ansible | TASK [cifmw_setup : Get customized parameters ci_framework_params={{ hostvars[inventory_hostname] | dict2items | selectattr("key", "match", "^(cifmw|pre|post)_(?!install_yamls|openshift_token|openshift_login|openshift_kubeconfig).*") | list | items2dict }}] *** 2025-10-13 19:32:13,783 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:13 +0000 (0:00:00.027) 0:00:01.005 ******** 2025-10-13 19:32:13,829 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:13,835 p=28354 u=zuul n=ansible | TASK [install_ca : Ensure target directory exists path={{ cifmw_install_ca_trust_dir }}, state=directory, mode=0755] *** 2025-10-13 19:32:13,835 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:13 +0000 (0:00:00.051) 0:00:01.057 ******** 2025-10-13 19:32:14,173 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:14,180 p=28354 u=zuul n=ansible | TASK [install_ca : Install internal CA from url url={{ cifmw_install_ca_url }}, dest={{ cifmw_install_ca_trust_dir }}, validate_certs={{ cifmw_install_ca_url_validate_certs | default(omit) }}, mode=0644] *** 2025-10-13 19:32:14,181 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:14 +0000 (0:00:00.345) 0:00:01.403 ******** 2025-10-13 19:32:14,204 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:14,218 p=28354 u=zuul n=ansible | TASK [install_ca : Install custom CA bundle from inline dest={{ cifmw_install_ca_trust_dir }}/cifmw_inline_ca_bundle.crt, content={{ cifmw_install_ca_bundle_inline }}, mode=0644] *** 2025-10-13 19:32:14,218 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:14 +0000 (0:00:00.037) 0:00:01.440 ******** 2025-10-13 19:32:14,239 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:14,252 p=28354 u=zuul n=ansible | TASK [install_ca : Install custom CA bundle from file dest={{ cifmw_install_ca_trust_dir }}/{{ cifmw_install_ca_bundle_src | basename }}, src={{ cifmw_install_ca_bundle_src }}, mode=0644] *** 2025-10-13 19:32:14,253 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:14 +0000 (0:00:00.034) 0:00:01.474 ******** 2025-10-13 19:32:14,273 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:14,281 p=28354 u=zuul n=ansible | TASK [install_ca : Update ca bundle _raw_params=update-ca-trust] *************** 2025-10-13 19:32:14,281 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:14 +0000 (0:00:00.028) 0:00:01.503 ******** 2025-10-13 19:32:15,801 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:15,812 p=28354 u=zuul n=ansible | TASK [repo_setup : Ensure directories are present path={{ cifmw_repo_setup_basedir }}/{{ item }}, state=directory, mode=0755] *** 2025-10-13 19:32:15,813 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:15 +0000 (0:00:01.531) 0:00:03.034 ******** 2025-10-13 19:32:16,025 p=28354 u=zuul n=ansible | changed: [localhost] => (item=tmp) 2025-10-13 19:32:16,245 p=28354 u=zuul n=ansible | changed: [localhost] => (item=artifacts/repositories) 2025-10-13 19:32:16,422 p=28354 u=zuul n=ansible | changed: [localhost] => (item=venv/repo_setup) 2025-10-13 19:32:16,439 p=28354 u=zuul n=ansible | TASK [repo_setup : Make sure git-core package is installed name=git-core, state=present] *** 2025-10-13 19:32:16,440 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:16 +0000 (0:00:00.626) 0:00:03.661 ******** 2025-10-13 19:32:17,522 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:17,527 p=28354 u=zuul n=ansible | TASK [repo_setup : Get repo-setup repository accept_hostkey=True, dest={{ cifmw_repo_setup_basedir }}/tmp/repo-setup, repo={{ cifmw_repo_setup_src }}] *** 2025-10-13 19:32:17,527 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:17 +0000 (0:00:01.087) 0:00:04.749 ******** 2025-10-13 19:32:18,568 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:18,577 p=28354 u=zuul n=ansible | TASK [repo_setup : Initialize python venv and install requirements virtualenv={{ cifmw_repo_setup_venv }}, requirements={{ cifmw_repo_setup_basedir }}/tmp/repo-setup/requirements.txt, virtualenv_command=python3 -m venv --system-site-packages --upgrade-deps] *** 2025-10-13 19:32:18,577 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:18 +0000 (0:00:01.049) 0:00:05.799 ******** 2025-10-13 19:32:27,252 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:27,258 p=28354 u=zuul n=ansible | TASK [repo_setup : Install repo-setup package chdir={{ cifmw_repo_setup_basedir }}/tmp/repo-setup, creates={{ cifmw_repo_setup_venv }}/bin/repo-setup, _raw_params={{ cifmw_repo_setup_venv }}/bin/python setup.py install] *** 2025-10-13 19:32:27,258 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:27 +0000 (0:00:08.681) 0:00:14.480 ******** 2025-10-13 19:32:28,021 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:28,028 p=28354 u=zuul n=ansible | TASK [repo_setup : Set cifmw_repo_setup_dlrn_hash_tag from content provider cifmw_repo_setup_dlrn_hash_tag={{ content_provider_dlrn_md5_hash }}] *** 2025-10-13 19:32:28,029 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:28 +0000 (0:00:00.770) 0:00:15.250 ******** 2025-10-13 19:32:28,045 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:28,051 p=28354 u=zuul n=ansible | TASK [repo_setup : Run repo-setup _raw_params={{ cifmw_repo_setup_venv }}/bin/repo-setup {{ cifmw_repo_setup_promotion }} {{ cifmw_repo_setup_additional_repos }} -d {{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }} -b {{ cifmw_repo_setup_branch }} --rdo-mirror {{ cifmw_repo_setup_rdo_mirror }} {% if cifmw_repo_setup_dlrn_hash_tag | length > 0 %} --dlrn-hash-tag {{ cifmw_repo_setup_dlrn_hash_tag }} {% endif %} -o {{ cifmw_repo_setup_output }}] *** 2025-10-13 19:32:28,051 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:28 +0000 (0:00:00.022) 0:00:15.273 ******** 2025-10-13 19:32:28,641 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:28,648 p=28354 u=zuul n=ansible | TASK [repo_setup : Get component repo url={{ cifmw_repo_setup_dlrn_uri }}/{{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }}-{{ cifmw_repo_setup_branch }}/component/{{ cifmw_repo_setup_component_name }}/{{ cifmw_repo_setup_component_promotion_tag }}/delorean.repo, dest={{ cifmw_repo_setup_output }}/{{ cifmw_repo_setup_component_name }}_{{ cifmw_repo_setup_component_promotion_tag }}_delorean.repo, mode=0644] *** 2025-10-13 19:32:28,648 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:28 +0000 (0:00:00.596) 0:00:15.870 ******** 2025-10-13 19:32:28,678 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:28,687 p=28354 u=zuul n=ansible | TASK [repo_setup : Rename component repo path={{ cifmw_repo_setup_output }}/{{ cifmw_repo_setup_component_name }}_{{ cifmw_repo_setup_component_promotion_tag }}_delorean.repo, regexp=delorean-component-{{ cifmw_repo_setup_component_name }}, replace={{ cifmw_repo_setup_component_name }}-{{ cifmw_repo_setup_component_promotion_tag }}] *** 2025-10-13 19:32:28,687 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:28 +0000 (0:00:00.039) 0:00:15.909 ******** 2025-10-13 19:32:28,715 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:28,723 p=28354 u=zuul n=ansible | TASK [repo_setup : Disable component repo in current-podified dlrn repo path={{ cifmw_repo_setup_output }}/delorean.repo, section=delorean-component-{{ cifmw_repo_setup_component_name }}, option=enabled, value=0, mode=0644] *** 2025-10-13 19:32:28,723 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:28 +0000 (0:00:00.036) 0:00:15.945 ******** 2025-10-13 19:32:28,753 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:28,761 p=28354 u=zuul n=ansible | TASK [repo_setup : Run repo-setup-get-hash _raw_params={{ cifmw_repo_setup_venv }}/bin/repo-setup-get-hash --dlrn-url {{ cifmw_repo_setup_dlrn_uri[:-1] }} --os-version {{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }} --release {{ cifmw_repo_setup_branch }} {% if cifmw_repo_setup_component_name | length > 0 -%} --component {{ cifmw_repo_setup_component_name }} --tag {{ cifmw_repo_setup_component_promotion_tag }} {% else -%} --tag {{cifmw_repo_setup_promotion }} {% endif -%} {% if (cifmw_repo_setup_dlrn_hash_tag | length > 0) and (cifmw_repo_setup_component_name | length <= 0) -%} --dlrn-hash-tag {{ cifmw_repo_setup_dlrn_hash_tag }} {% endif -%} --json] *** 2025-10-13 19:32:28,762 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:28 +0000 (0:00:00.038) 0:00:15.983 ******** 2025-10-13 19:32:29,210 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:29,219 p=28354 u=zuul n=ansible | TASK [repo_setup : Dump full hash in delorean.repo.md5 file content={{ _repo_setup_json['full_hash'] }} , dest={{ cifmw_repo_setup_basedir }}/artifacts/repositories/delorean.repo.md5, mode=0644] *** 2025-10-13 19:32:29,219 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:29 +0000 (0:00:00.457) 0:00:16.441 ******** 2025-10-13 19:32:29,890 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:29,905 p=28354 u=zuul n=ansible | TASK [repo_setup : Dump current-podified hash url={{ cifmw_repo_setup_dlrn_uri }}/{{ cifmw_repo_setup_os_release }}{{ cifmw_repo_setup_dist_major_version }}-{{ cifmw_repo_setup_branch }}/current-podified/delorean.repo.md5, dest={{ cifmw_repo_setup_basedir }}/artifacts/repositories/delorean.repo.md5, mode=0644] *** 2025-10-13 19:32:29,905 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:29 +0000 (0:00:00.686) 0:00:17.127 ******** 2025-10-13 19:32:29,930 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:29,940 p=28354 u=zuul n=ansible | TASK [repo_setup : Slurp current podified hash src={{ cifmw_repo_setup_basedir }}/artifacts/repositories/delorean.repo.md5] *** 2025-10-13 19:32:29,941 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:29 +0000 (0:00:00.035) 0:00:17.163 ******** 2025-10-13 19:32:29,966 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:29,975 p=28354 u=zuul n=ansible | TASK [repo_setup : Update the value of full_hash _repo_setup_json={{ _repo_setup_json | combine({'full_hash': _hash}, recursive=true) }}] *** 2025-10-13 19:32:29,975 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:29 +0000 (0:00:00.034) 0:00:17.197 ******** 2025-10-13 19:32:29,998 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,007 p=28354 u=zuul n=ansible | TASK [repo_setup : Export hashes facts for further use cifmw_repo_setup_full_hash={{ _repo_setup_json['full_hash'] }}, cifmw_repo_setup_commit_hash={{ _repo_setup_json['commit_hash'] }}, cifmw_repo_setup_distro_hash={{ _repo_setup_json['distro_hash'] }}, cifmw_repo_setup_extended_hash={{ _repo_setup_json['extended_hash'] }}, cifmw_repo_setup_dlrn_api_url={{ _repo_setup_json['dlrn_api_url'] }}, cifmw_repo_setup_dlrn_url={{ _repo_setup_json['dlrn_url'] }}, cifmw_repo_setup_release={{ _repo_setup_json['release'] }}, cacheable=True] *** 2025-10-13 19:32:30,007 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.031) 0:00:17.229 ******** 2025-10-13 19:32:30,042 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:30,051 p=28354 u=zuul n=ansible | TASK [repo_setup : Create download directory path={{ cifmw_repo_setup_rhos_release_path }}, state=directory, mode=0755] *** 2025-10-13 19:32:30,051 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.044) 0:00:17.273 ******** 2025-10-13 19:32:30,070 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,081 p=28354 u=zuul n=ansible | TASK [repo_setup : Print the URL to request msg={{ cifmw_repo_setup_rhos_release_rpm }}] *** 2025-10-13 19:32:30,081 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.029) 0:00:17.303 ******** 2025-10-13 19:32:30,098 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,108 p=28354 u=zuul n=ansible | TASK [Download the RPM name=krb_request] *************************************** 2025-10-13 19:32:30,108 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.027) 0:00:17.330 ******** 2025-10-13 19:32:30,125 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,135 p=28354 u=zuul n=ansible | TASK [repo_setup : Install RHOS Release tool name={{ cifmw_repo_setup_rhos_release_rpm if cifmw_repo_setup_rhos_release_rpm is not url else cifmw_krb_request_out.path }}, state=present, disable_gpg_check={{ cifmw_repo_setup_rhos_release_gpg_check | bool }}] *** 2025-10-13 19:32:30,135 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.027) 0:00:17.357 ******** 2025-10-13 19:32:30,153 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,162 p=28354 u=zuul n=ansible | TASK [repo_setup : Get rhos-release tool version _raw_params=rhos-release --version] *** 2025-10-13 19:32:30,162 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.026) 0:00:17.384 ******** 2025-10-13 19:32:30,179 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,186 p=28354 u=zuul n=ansible | TASK [repo_setup : Print rhos-release tool version msg={{ rr_version.stdout }}] *** 2025-10-13 19:32:30,186 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.024) 0:00:17.408 ******** 2025-10-13 19:32:30,203 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,211 p=28354 u=zuul n=ansible | TASK [repo_setup : Generate repos using rhos-release {{ cifmw_repo_setup_rhos_release_args }} _raw_params=rhos-release {{ cifmw_repo_setup_rhos_release_args }} \ -t {{ cifmw_repo_setup_output }}] *** 2025-10-13 19:32:30,211 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.024) 0:00:17.433 ******** 2025-10-13 19:32:30,233 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,241 p=28354 u=zuul n=ansible | TASK [repo_setup : Check for /etc/ci/mirror_info.sh path=/etc/ci/mirror_info.sh] *** 2025-10-13 19:32:30,241 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.029) 0:00:17.463 ******** 2025-10-13 19:32:30,452 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:30,472 p=28354 u=zuul n=ansible | TASK [repo_setup : Use RDO proxy mirrors chdir={{ cifmw_repo_setup_output }}, _raw_params=set -o pipefail source /etc/ci/mirror_info.sh sed -i -e "s|https://trunk.rdoproject.org|$NODEPOOL_RDO_PROXY|g" *.repo ] *** 2025-10-13 19:32:30,473 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.231) 0:00:17.695 ******** 2025-10-13 19:32:30,696 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:30,703 p=28354 u=zuul n=ansible | TASK [repo_setup : Use RDO CentOS mirrors (remove CentOS 10 conditional when Nodepool mirrors exist) chdir={{ cifmw_repo_setup_output }}, _raw_params=set -o pipefail source /etc/ci/mirror_info.sh sed -i -e "s|http://mirror.stream.centos.org|$NODEPOOL_CENTOS_MIRROR|g" *.repo ] *** 2025-10-13 19:32:30,704 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.230) 0:00:17.925 ******** 2025-10-13 19:32:30,927 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:30,940 p=28354 u=zuul n=ansible | TASK [repo_setup : Check for gating.repo file on content provider url=http://{{ content_provider_registry_ip }}:8766/gating.repo] *** 2025-10-13 19:32:30,941 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.237) 0:00:18.162 ******** 2025-10-13 19:32:30,960 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:30,967 p=28354 u=zuul n=ansible | TASK [repo_setup : Populate gating repo from content provider ip content=[gating-repo] baseurl=http://{{ content_provider_registry_ip }}:8766/ enabled=1 gpgcheck=0 priority=1 , dest={{ cifmw_repo_setup_output }}/gating.repo, mode=0644] *** 2025-10-13 19:32:30,967 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:30 +0000 (0:00:00.026) 0:00:18.189 ******** 2025-10-13 19:32:30,995 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:31,002 p=28354 u=zuul n=ansible | TASK [repo_setup : Check for DLRN repo at the destination path={{ cifmw_repo_setup_output }}/delorean.repo] *** 2025-10-13 19:32:31,002 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:31 +0000 (0:00:00.034) 0:00:18.224 ******** 2025-10-13 19:32:31,039 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:31,048 p=28354 u=zuul n=ansible | TASK [repo_setup : Lower the priority of DLRN repos to allow installation from gating repo path={{ cifmw_repo_setup_output }}/delorean.repo, regexp=priority=1, replace=priority=20] *** 2025-10-13 19:32:31,048 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:31 +0000 (0:00:00.046) 0:00:18.270 ******** 2025-10-13 19:32:31,077 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:31,084 p=28354 u=zuul n=ansible | TASK [repo_setup : Check for DLRN component repo path={{ cifmw_repo_setup_output }}/{{ _comp_repo }}] *** 2025-10-13 19:32:31,084 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:31 +0000 (0:00:00.036) 0:00:18.306 ******** 2025-10-13 19:32:31,115 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:31,121 p=28354 u=zuul n=ansible | TASK [repo_setup : Lower the priority of componennt repos to allow installation from gating repo path={{ cifmw_repo_setup_output }}//{{ _comp_repo }}, regexp=priority=1, replace=priority=2] *** 2025-10-13 19:32:31,121 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:31 +0000 (0:00:00.037) 0:00:18.343 ******** 2025-10-13 19:32:31,150 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:32:31,157 p=28354 u=zuul n=ansible | TASK [repo_setup : Find existing repos from /etc/yum.repos.d directory paths=/etc/yum.repos.d/, patterns=*.repo, recurse=False] *** 2025-10-13 19:32:31,157 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:31 +0000 (0:00:00.035) 0:00:18.379 ******** 2025-10-13 19:32:31,477 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:31,483 p=28354 u=zuul n=ansible | TASK [repo_setup : Remove existing repos from /etc/yum.repos.d directory path={{ item }}, state=absent] *** 2025-10-13 19:32:31,483 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:31 +0000 (0:00:00.326) 0:00:18.705 ******** 2025-10-13 19:32:31,705 p=28354 u=zuul n=ansible | changed: [localhost] => (item=/etc/yum.repos.d/centos-addons.repo) 2025-10-13 19:32:31,891 p=28354 u=zuul n=ansible | changed: [localhost] => (item=/etc/yum.repos.d/centos.repo) 2025-10-13 19:32:31,899 p=28354 u=zuul n=ansible | TASK [repo_setup : Cleanup existing metadata _raw_params=dnf clean metadata] *** 2025-10-13 19:32:31,899 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:31 +0000 (0:00:00.415) 0:00:19.121 ******** 2025-10-13 19:32:32,351 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:32,358 p=28354 u=zuul n=ansible | TASK [repo_setup : Copy generated repos to /etc/yum.repos.d directory mode=0755, remote_src=True, src={{ cifmw_repo_setup_output }}/, dest=/etc/yum.repos.d] *** 2025-10-13 19:32:32,359 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:32 +0000 (0:00:00.459) 0:00:19.580 ******** 2025-10-13 19:32:32,606 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:32,618 p=28354 u=zuul n=ansible | TASK [ci_setup : Gather variables for each operating system _raw_params={{ item }}] *** 2025-10-13 19:32:32,618 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:32 +0000 (0:00:00.259) 0:00:19.840 ******** 2025-10-13 19:32:32,655 p=28354 u=zuul n=ansible | ok: [localhost] => (item=/home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_setup/vars/redhat.yml) 2025-10-13 19:32:32,663 p=28354 u=zuul n=ansible | TASK [ci_setup : List packages to install var=cifmw_ci_setup_packages] ********* 2025-10-13 19:32:32,663 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:32 +0000 (0:00:00.045) 0:00:19.885 ******** 2025-10-13 19:32:32,679 p=28354 u=zuul n=ansible | ok: [localhost] => cifmw_ci_setup_packages: - bash-completion - ca-certificates - git-core - make - tar - tmux - python3-pip 2025-10-13 19:32:32,685 p=28354 u=zuul n=ansible | TASK [ci_setup : Install needed packages name={{ cifmw_ci_setup_packages }}, state=latest] *** 2025-10-13 19:32:32,685 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:32 +0000 (0:00:00.021) 0:00:19.907 ******** 2025-10-13 19:32:58,950 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:58,956 p=28354 u=zuul n=ansible | TASK [ci_setup : Gather version of openshift client _raw_params=oc version --client -o yaml] *** 2025-10-13 19:32:58,957 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:58 +0000 (0:00:26.271) 0:00:46.178 ******** 2025-10-13 19:32:59,121 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:32:59,130 p=28354 u=zuul n=ansible | TASK [ci_setup : Ensure openshift client install path is present path={{ cifmw_ci_setup_oc_install_path }}, state=directory, mode=0755] *** 2025-10-13 19:32:59,130 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:59 +0000 (0:00:00.173) 0:00:46.352 ******** 2025-10-13 19:32:59,309 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:32:59,316 p=28354 u=zuul n=ansible | TASK [ci_setup : Install openshift client src={{ cifmw_ci_setup_openshift_client_download_uri }}/{{ cifmw_ci_setup_openshift_client_version }}/openshift-client-linux.tar.gz, dest={{ cifmw_ci_setup_oc_install_path }}, remote_src=True, mode=0755, creates={{ cifmw_ci_setup_oc_install_path }}/oc] *** 2025-10-13 19:32:59,316 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:32:59 +0000 (0:00:00.186) 0:00:46.538 ******** 2025-10-13 19:33:04,628 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:04,637 p=28354 u=zuul n=ansible | TASK [ci_setup : Add the OC path to cifmw_path if needed cifmw_path={{ cifmw_ci_setup_oc_install_path }}:{{ ansible_env.PATH }}, cacheable=True] *** 2025-10-13 19:33:04,637 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:04 +0000 (0:00:05.320) 0:00:51.859 ******** 2025-10-13 19:33:04,666 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:04,676 p=28354 u=zuul n=ansible | TASK [ci_setup : Create completion file] *************************************** 2025-10-13 19:33:04,677 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:04 +0000 (0:00:00.039) 0:00:51.898 ******** 2025-10-13 19:33:05,032 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:05,041 p=28354 u=zuul n=ansible | TASK [ci_setup : Source completion from within .bashrc create=True, mode=0644, path={{ ansible_user_dir }}/.bashrc, block=if [ -f ~/.oc_completion ]; then source ~/.oc_completion fi] *** 2025-10-13 19:33:05,041 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.364) 0:00:52.263 ******** 2025-10-13 19:33:05,348 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:05,363 p=28354 u=zuul n=ansible | TASK [ci_setup : Check rhsm status _raw_params=subscription-manager status] **** 2025-10-13 19:33:05,363 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.322) 0:00:52.585 ******** 2025-10-13 19:33:05,385 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:05,400 p=28354 u=zuul n=ansible | TASK [ci_setup : Gather the repos to be enabled _repos={{ cifmw_ci_setup_rhel_rhsm_default_repos + (cifmw_ci_setup_rhel_rhsm_extra_repos | default([])) }}] *** 2025-10-13 19:33:05,401 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.037) 0:00:52.623 ******** 2025-10-13 19:33:05,423 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:05,432 p=28354 u=zuul n=ansible | TASK [ci_setup : Enabling the required repositories. name={{ item }}, state={{ rhsm_repo_state | default('enabled') }}] *** 2025-10-13 19:33:05,432 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.031) 0:00:52.654 ******** 2025-10-13 19:33:05,453 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:05,463 p=28354 u=zuul n=ansible | TASK [ci_setup : Get current /etc/redhat-release _raw_params=cat /etc/redhat-release] *** 2025-10-13 19:33:05,463 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.030) 0:00:52.685 ******** 2025-10-13 19:33:05,483 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:05,493 p=28354 u=zuul n=ansible | TASK [ci_setup : Print current /etc/redhat-release msg={{ _current_rh_release.stdout }}] *** 2025-10-13 19:33:05,493 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.029) 0:00:52.715 ******** 2025-10-13 19:33:05,514 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:05,523 p=28354 u=zuul n=ansible | TASK [ci_setup : Ensure the repos are enabled in the system using yum name={{ item.name }}, baseurl={{ item.baseurl }}, description={{ item.description | default(item.name) }}, gpgcheck={{ item.gpgcheck | default(false) }}, enabled=True, state={{ yum_repo_state | default('present') }}] *** 2025-10-13 19:33:05,524 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.030) 0:00:52.745 ******** 2025-10-13 19:33:05,552 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:05,562 p=28354 u=zuul n=ansible | TASK [ci_setup : Manage directories path={{ item }}, state={{ directory_state }}, mode=0755, owner={{ ansible_user_id }}, group={{ ansible_user_id }}] *** 2025-10-13 19:33:05,563 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:05 +0000 (0:00:00.039) 0:00:52.784 ******** 2025-10-13 19:33:05,805 p=28354 u=zuul n=ansible | changed: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/manifests/openstack/cr) 2025-10-13 19:33:06,015 p=28354 u=zuul n=ansible | changed: [localhost] => (item=/home/zuul/ci-framework-data/logs) 2025-10-13 19:33:06,221 p=28354 u=zuul n=ansible | ok: [localhost] => (item=/home/zuul/ci-framework-data/tmp) 2025-10-13 19:33:06,439 p=28354 u=zuul n=ansible | changed: [localhost] => (item=/home/zuul/ci-framework-data/volumes) 2025-10-13 19:33:06,707 p=28354 u=zuul n=ansible | ok: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/parameters) 2025-10-13 19:33:06,723 p=28354 u=zuul n=ansible | TASK [Prepare install_yamls make targets name=install_yamls, apply={'tags': ['bootstrap']}] *** 2025-10-13 19:33:06,723 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:06 +0000 (0:00:01.160) 0:00:53.945 ******** 2025-10-13 19:33:06,854 p=28354 u=zuul n=ansible | TASK [install_yamls : Ensure directories exist path={{ item }}, state=directory, mode=0755] *** 2025-10-13 19:33:06,854 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:06 +0000 (0:00:00.131) 0:00:54.076 ******** 2025-10-13 19:33:07,046 p=28354 u=zuul n=ansible | ok: [localhost] => (item=/home/zuul/ci-framework-data/artifacts) 2025-10-13 19:33:07,221 p=28354 u=zuul n=ansible | changed: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/roles/install_yamls_makes/tasks) 2025-10-13 19:33:07,378 p=28354 u=zuul n=ansible | ok: [localhost] => (item=/home/zuul/ci-framework-data/artifacts/parameters) 2025-10-13 19:33:07,386 p=28354 u=zuul n=ansible | TASK [Create variables with local repos based on Zuul items name=install_yamls, tasks_from=zuul_set_operators_repo.yml] *** 2025-10-13 19:33:07,386 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:07 +0000 (0:00:00.531) 0:00:54.608 ******** 2025-10-13 19:33:07,420 p=28354 u=zuul n=ansible | TASK [install_yamls : Set fact with local repos based on Zuul items cifmw_install_yamls_operators_repo={{ cifmw_install_yamls_operators_repo | default({}) | combine(_repo_operator_info | items2dict) }}] *** 2025-10-13 19:33:07,420 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:07 +0000 (0:00:00.034) 0:00:54.642 ******** 2025-10-13 19:33:07,446 p=28354 u=zuul n=ansible | skipping: [localhost] => (item={'branch': 'main', 'change': '3404', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3404', 'commit_id': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'patchset': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07,451 p=28354 u=zuul n=ansible | skipping: [localhost] => (item={'branch': 'main', 'change': '3406', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3406', 'commit_id': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'patchset': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07,455 p=28354 u=zuul n=ansible | skipping: [localhost] => (item={'branch': 'main', 'change': '3402', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3402', 'commit_id': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'patchset': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07,456 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:07,463 p=28354 u=zuul n=ansible | TASK [install_yamls : Print helpful data for debugging msg=_repo_operator_name: {{ _repo_operator_name }} _repo_operator_info: {{ _repo_operator_info }} cifmw_install_yamls_operators_repo: {{ cifmw_install_yamls_operators_repo }} ] *** 2025-10-13 19:33:07,463 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:07 +0000 (0:00:00.042) 0:00:54.685 ******** 2025-10-13 19:33:07,488 p=28354 u=zuul n=ansible | skipping: [localhost] => (item={'branch': 'main', 'change': '3404', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3404', 'commit_id': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'patchset': '9f142a3066b32ef704ae4f0d5fc5f7189e41a1f8', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07,493 p=28354 u=zuul n=ansible | skipping: [localhost] => (item={'branch': 'main', 'change': '3406', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3406', 'commit_id': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'patchset': '3b7e5d87cb08f8ceea89c6e58502f20dfffec667', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07,498 p=28354 u=zuul n=ansible | skipping: [localhost] => (item={'branch': 'main', 'change': '3402', 'change_url': 'https://github.com/openstack-k8s-operators/ci-framework/pull/3402', 'commit_id': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'patchset': 'a301e7c15ccc9d964f35eb738c51dc015730d4ed', 'project': {'canonical_hostname': 'github.com', 'canonical_name': 'github.com/openstack-k8s-operators/ci-framework', 'name': 'openstack-k8s-operators/ci-framework', 'short_name': 'ci-framework', 'src_dir': 'src/github.com/openstack-k8s-operators/ci-framework'}, 'topic': None}) 2025-10-13 19:33:07,499 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:07,511 p=28354 u=zuul n=ansible | TASK [install_yamls : Compute the cifmw_install_yamls_vars final value _install_yamls_override_vars={{ _install_yamls_override_vars | default({}) | combine(item, recursive=True) }}] *** 2025-10-13 19:33:07,511 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:07 +0000 (0:00:00.047) 0:00:54.733 ******** 2025-10-13 19:33:07,602 p=28354 u=zuul n=ansible | ok: [localhost] => (item={'BMO_SETUP': False}) 2025-10-13 19:33:07,637 p=28354 u=zuul n=ansible | TASK [install_yamls : Set environment override cifmw_install_yamls_environment fact cifmw_install_yamls_environment={{ _install_yamls_override_vars.keys() | map('upper') | zip(_install_yamls_override_vars.values()) | items2dict(key_name=0, value_name=1) | combine({ 'OUT': cifmw_install_yamls_manifests_dir, 'OUTPUT_DIR': cifmw_install_yamls_edpm_dir, 'CHECKOUT_FROM_OPENSTACK_REF': cifmw_install_yamls_checkout_openstack_ref, 'OPENSTACK_K8S_BRANCH': (zuul is defined and not zuul.branch |regex_search('master|rhos')) | ternary(zuul.branch, 'main') }) | combine(install_yamls_operators_repos) }}, cacheable=True] *** 2025-10-13 19:33:07,637 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:07 +0000 (0:00:00.126) 0:00:54.859 ******** 2025-10-13 19:33:07,676 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:07,682 p=28354 u=zuul n=ansible | TASK [install_yamls : Get environment structure base_path={{ cifmw_install_yamls_repo }}] *** 2025-10-13 19:33:07,682 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:07 +0000 (0:00:00.044) 0:00:54.904 ******** 2025-10-13 19:33:08,193 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:08,201 p=28354 u=zuul n=ansible | TASK [install_yamls : Ensure Output directory exists path={{ cifmw_install_yamls_out_dir }}, state=directory, mode=0755] *** 2025-10-13 19:33:08,201 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:08 +0000 (0:00:00.518) 0:00:55.423 ******** 2025-10-13 19:33:08,382 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:08,391 p=28354 u=zuul n=ansible | TASK [install_yamls : Ensure user cifmw_install_yamls_vars contains existing Makefile variables that=_cifmw_install_yamls_unmatched_vars | length == 0, msg=cifmw_install_yamls_vars contains a variable that is not defined in install_yamls Makefile nor cifmw_install_yamls_whitelisted_vars: {{ _cifmw_install_yamls_unmatched_vars | join(', ')}}, quiet=True] *** 2025-10-13 19:33:08,391 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:08 +0000 (0:00:00.189) 0:00:55.613 ******** 2025-10-13 19:33:08,425 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:08,440 p=28354 u=zuul n=ansible | TASK [install_yamls : Generate /home/zuul/ci-framework-data/artifacts/install_yamls.sh dest={{ cifmw_install_yamls_out_dir }}/{{ cifmw_install_yamls_envfile }}, content={% for k,v in cifmw_install_yamls_environment.items() %} export {{ k }}={{ v }} {% endfor %}, mode=0644] *** 2025-10-13 19:33:08,441 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:08 +0000 (0:00:00.049) 0:00:55.662 ******** 2025-10-13 19:33:08,817 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:08,824 p=28354 u=zuul n=ansible | TASK [install_yamls : Set install_yamls default values cifmw_install_yamls_defaults={{ get_makefiles_env_output.makefiles_values | combine(cifmw_install_yamls_environment) }}, cacheable=True] *** 2025-10-13 19:33:08,824 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:08 +0000 (0:00:00.383) 0:00:56.046 ******** 2025-10-13 19:33:08,847 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:08,854 p=28354 u=zuul n=ansible | TASK [install_yamls : Show the env structure var=cifmw_install_yamls_environment] *** 2025-10-13 19:33:08,854 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:08 +0000 (0:00:00.030) 0:00:56.076 ******** 2025-10-13 19:33:08,870 p=28354 u=zuul n=ansible | ok: [localhost] => cifmw_install_yamls_environment: BMO_SETUP: false CHECKOUT_FROM_OPENSTACK_REF: 'true' OPENSTACK_K8S_BRANCH: main OUT: /home/zuul/ci-framework-data/artifacts/manifests OUTPUT_DIR: /home/zuul/ci-framework-data/artifacts/edpm 2025-10-13 19:33:08,878 p=28354 u=zuul n=ansible | TASK [install_yamls : Show the env structure defaults var=cifmw_install_yamls_defaults] *** 2025-10-13 19:33:08,878 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:08 +0000 (0:00:00.023) 0:00:56.100 ******** 2025-10-13 19:33:08,907 p=28354 u=zuul n=ansible | ok: [localhost] => cifmw_install_yamls_defaults: ADOPTED_EXTERNAL_NETWORK: 172.21.1.0/24 ADOPTED_INTERNALAPI_NETWORK: 172.17.1.0/24 ADOPTED_STORAGEMGMT_NETWORK: 172.20.1.0/24 ADOPTED_STORAGE_NETWORK: 172.18.1.0/24 ADOPTED_TENANT_NETWORK: 172.9.1.0/24 ANSIBLEEE: config/samples/_v1beta1_ansibleee.yaml ANSIBLEEE_BRANCH: main ANSIBLEEE_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/config/samples/_v1beta1_ansibleee.yaml ANSIBLEEE_IMG: quay.io/openstack-k8s-operators/openstack-ansibleee-operator-index:latest ANSIBLEEE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/kuttl-test.yaml ANSIBLEEE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-ansibleee-operator/tests/kuttl/tests ANSIBLEEE_KUTTL_NAMESPACE: ansibleee-kuttl-tests ANSIBLEEE_REPO: https://github.com/openstack-k8s-operators/openstack-ansibleee-operator ANSIBLEE_COMMIT_HASH: '' BARBICAN: config/samples/barbican_v1beta1_barbican.yaml BARBICAN_BRANCH: main BARBICAN_COMMIT_HASH: '' BARBICAN_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/config/samples/barbican_v1beta1_barbican.yaml BARBICAN_DEPL_IMG: unused BARBICAN_IMG: quay.io/openstack-k8s-operators/barbican-operator-index:latest BARBICAN_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/kuttl-test.yaml BARBICAN_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator/tests/kuttl/tests BARBICAN_KUTTL_NAMESPACE: barbican-kuttl-tests BARBICAN_REPO: https://github.com/openstack-k8s-operators/barbican-operator.git BARBICAN_SERVICE_ENABLED: 'true' BARBICAN_SIMPLE_CRYPTO_ENCRYPTION_KEY: sEFmdFjDUqRM2VemYslV5yGNWjokioJXsg8Nrlc3drU= BAREMETAL_BRANCH: main BAREMETAL_COMMIT_HASH: '' BAREMETAL_IMG: quay.io/openstack-k8s-operators/openstack-baremetal-operator-index:latest BAREMETAL_OS_CONTAINER_IMG: '' BAREMETAL_OS_IMG: '' BAREMETAL_REPO: https://github.com/openstack-k8s-operators/openstack-baremetal-operator.git BAREMETAL_TIMEOUT: 20m BASH_IMG: quay.io/openstack-k8s-operators/bash:latest BGP_ASN: '64999' BGP_LEAF_1: 100.65.4.1 BGP_LEAF_2: 100.64.4.1 BGP_OVN_ROUTING: 'false' BGP_PEER_ASN: '64999' BGP_SOURCE_IP: 172.30.4.2 BGP_SOURCE_IP6: f00d:f00d:f00d:f00d:f00d:f00d:f00d:42 BMAAS_BRIDGE_IPV4_PREFIX: 172.20.1.2/24 BMAAS_BRIDGE_IPV6_PREFIX: fd00:bbbb::2/64 BMAAS_INSTANCE_DISK_SIZE: '20' BMAAS_INSTANCE_MEMORY: '4096' BMAAS_INSTANCE_NAME_PREFIX: crc-bmaas BMAAS_INSTANCE_NET_MODEL: virtio BMAAS_INSTANCE_OS_VARIANT: centos-stream9 BMAAS_INSTANCE_VCPUS: '2' BMAAS_INSTANCE_VIRT_TYPE: kvm BMAAS_IPV4: 'true' BMAAS_IPV6: 'false' BMAAS_LIBVIRT_USER: sushyemu BMAAS_METALLB_ADDRESS_POOL: 172.20.1.64/26 BMAAS_METALLB_POOL_NAME: baremetal BMAAS_NETWORK_IPV4_PREFIX: 172.20.1.1/24 BMAAS_NETWORK_IPV6_PREFIX: fd00:bbbb::1/64 BMAAS_NETWORK_NAME: crc-bmaas BMAAS_NODE_COUNT: '1' BMAAS_OCP_INSTANCE_NAME: crc BMAAS_REDFISH_PASSWORD: password BMAAS_REDFISH_USERNAME: admin BMAAS_ROUTE_LIBVIRT_NETWORKS: crc-bmaas,crc,default BMAAS_SUSHY_EMULATOR_DRIVER: libvirt BMAAS_SUSHY_EMULATOR_IMAGE: quay.io/metal3-io/sushy-tools:latest BMAAS_SUSHY_EMULATOR_NAMESPACE: sushy-emulator BMAAS_SUSHY_EMULATOR_OS_CLIENT_CONFIG_FILE: /etc/openstack/clouds.yaml BMAAS_SUSHY_EMULATOR_OS_CLOUD: openstack BMH_NAMESPACE: openstack BMO_BRANCH: release-0.9 BMO_COMMIT_HASH: '' BMO_IPA_BRANCH: stable/2024.1 BMO_IRONIC_HOST: 192.168.122.10 BMO_PROVISIONING_INTERFACE: '' BMO_REPO: https://github.com/metal3-io/baremetal-operator BMO_SETUP: false BMO_SETUP_ROUTE_REPLACE: 'true' BM_CTLPLANE_INTERFACE: enp1s0 BM_INSTANCE_MEMORY: '8192' BM_INSTANCE_NAME_PREFIX: edpm-compute-baremetal BM_INSTANCE_NAME_SUFFIX: '0' BM_NETWORK_NAME: default BM_NODE_COUNT: '1' BM_ROOT_PASSWORD: '' BM_ROOT_PASSWORD_SECRET: '' CEILOMETER_CENTRAL_DEPL_IMG: unused CEILOMETER_NOTIFICATION_DEPL_IMG: unused CEPH_BRANCH: release-1.15 CEPH_CLIENT: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/toolbox.yaml CEPH_COMMON: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/common.yaml CEPH_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/cluster-test.yaml CEPH_CRDS: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/crds.yaml CEPH_IMG: quay.io/ceph/demo:latest-squid CEPH_OP: /home/zuul/ci-framework-data/artifacts/manifests/operator/rook/deploy/examples/operator-openshift.yaml CEPH_REPO: https://github.com/rook/rook.git CERTMANAGER_TIMEOUT: 300s CHECKOUT_FROM_OPENSTACK_REF: 'true' CINDER: config/samples/cinder_v1beta1_cinder.yaml CINDERAPI_DEPL_IMG: unused CINDERBKP_DEPL_IMG: unused CINDERSCH_DEPL_IMG: unused CINDERVOL_DEPL_IMG: unused CINDER_BRANCH: main CINDER_COMMIT_HASH: '' CINDER_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/config/samples/cinder_v1beta1_cinder.yaml CINDER_IMG: quay.io/openstack-k8s-operators/cinder-operator-index:latest CINDER_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/kuttl-test.yaml CINDER_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator/test/kuttl/tests CINDER_KUTTL_NAMESPACE: cinder-kuttl-tests CINDER_REPO: https://github.com/openstack-k8s-operators/cinder-operator.git CLEANUP_DIR_CMD: rm -Rf CRC_BGP_NIC_1_MAC: '52:54:00:11:11:11' CRC_BGP_NIC_2_MAC: '52:54:00:11:11:12' CRC_HTTPS_PROXY: '' CRC_HTTP_PROXY: '' CRC_STORAGE_NAMESPACE: crc-storage CRC_STORAGE_RETRIES: '3' CRC_URL: '''https://developers.redhat.com/content-gateway/rest/mirror/pub/openshift-v4/clients/crc/latest/crc-linux-amd64.tar.xz''' CRC_VERSION: latest DATAPLANE_ANSIBLE_SECRET: dataplane-ansible-ssh-private-key-secret DATAPLANE_ANSIBLE_USER: '' DATAPLANE_COMPUTE_IP: 192.168.122.100 DATAPLANE_CONTAINER_PREFIX: openstack DATAPLANE_CONTAINER_TAG: current-podified DATAPLANE_CUSTOM_SERVICE_RUNNER_IMG: quay.io/openstack-k8s-operators/openstack-ansibleee-runner:latest DATAPLANE_DEFAULT_GW: 192.168.122.1 DATAPLANE_EXTRA_NOVA_CONFIG_FILE: /dev/null DATAPLANE_GROWVOLS_ARGS: /=8GB /tmp=1GB /home=1GB /var=100% DATAPLANE_KUSTOMIZE_SCENARIO: preprovisioned DATAPLANE_NETWORKER_IP: 192.168.122.200 DATAPLANE_NETWORK_INTERFACE_NAME: eth0 DATAPLANE_NOVA_NFS_PATH: '' DATAPLANE_NTP_SERVER: pool.ntp.org DATAPLANE_PLAYBOOK: osp.edpm.download_cache DATAPLANE_REGISTRY_URL: quay.io/podified-antelope-centos9 DATAPLANE_RUNNER_IMG: '' DATAPLANE_SERVER_ROLE: compute DATAPLANE_SSHD_ALLOWED_RANGES: '[''192.168.122.0/24'']' DATAPLANE_TIMEOUT: 30m DATAPLANE_TLS_ENABLED: 'true' DATAPLANE_TOTAL_NETWORKER_NODES: '1' DATAPLANE_TOTAL_NODES: '1' DBSERVICE: galera DESIGNATE: config/samples/designate_v1beta1_designate.yaml DESIGNATE_BRANCH: main DESIGNATE_COMMIT_HASH: '' DESIGNATE_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/config/samples/designate_v1beta1_designate.yaml DESIGNATE_IMG: quay.io/openstack-k8s-operators/designate-operator-index:latest DESIGNATE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/kuttl-test.yaml DESIGNATE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator/tests/kuttl/tests DESIGNATE_KUTTL_NAMESPACE: designate-kuttl-tests DESIGNATE_REPO: https://github.com/openstack-k8s-operators/designate-operator.git DNSDATA: config/samples/network_v1beta1_dnsdata.yaml DNSDATA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_dnsdata.yaml DNSMASQ: config/samples/network_v1beta1_dnsmasq.yaml DNSMASQ_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_dnsmasq.yaml DNS_DEPL_IMG: unused DNS_DOMAIN: localdomain DOWNLOAD_TOOLS_SELECTION: all EDPM_ATTACH_EXTNET: 'true' EDPM_COMPUTE_ADDITIONAL_HOST_ROUTES: '''[]''' EDPM_COMPUTE_ADDITIONAL_NETWORKS: '''[]''' EDPM_COMPUTE_CELLS: '1' EDPM_COMPUTE_CEPH_ENABLED: 'true' EDPM_COMPUTE_CEPH_NOVA: 'true' EDPM_COMPUTE_DHCP_AGENT_ENABLED: 'true' EDPM_COMPUTE_SRIOV_ENABLED: 'true' EDPM_COMPUTE_SUFFIX: '0' EDPM_CONFIGURE_DEFAULT_ROUTE: 'true' EDPM_CONFIGURE_HUGEPAGES: 'false' EDPM_CONFIGURE_NETWORKING: 'true' EDPM_FIRSTBOOT_EXTRA: /tmp/edpm-firstboot-extra EDPM_NETWORKER_SUFFIX: '0' EDPM_TOTAL_NETWORKERS: '1' EDPM_TOTAL_NODES: '1' GALERA_REPLICAS: '' GENERATE_SSH_KEYS: 'true' GIT_CLONE_OPTS: '' GLANCE: config/samples/glance_v1beta1_glance.yaml GLANCEAPI_DEPL_IMG: unused GLANCE_BRANCH: main GLANCE_COMMIT_HASH: '' GLANCE_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/config/samples/glance_v1beta1_glance.yaml GLANCE_IMG: quay.io/openstack-k8s-operators/glance-operator-index:latest GLANCE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/kuttl-test.yaml GLANCE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator/test/kuttl/tests GLANCE_KUTTL_NAMESPACE: glance-kuttl-tests GLANCE_REPO: https://github.com/openstack-k8s-operators/glance-operator.git HEAT: config/samples/heat_v1beta1_heat.yaml HEATAPI_DEPL_IMG: unused HEATCFNAPI_DEPL_IMG: unused HEATENGINE_DEPL_IMG: unused HEAT_AUTH_ENCRYPTION_KEY: 767c3ed056cbaa3b9dfedb8c6f825bf0 HEAT_BRANCH: main HEAT_COMMIT_HASH: '' HEAT_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/config/samples/heat_v1beta1_heat.yaml HEAT_IMG: quay.io/openstack-k8s-operators/heat-operator-index:latest HEAT_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/kuttl-test.yaml HEAT_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator/tests/kuttl/tests HEAT_KUTTL_NAMESPACE: heat-kuttl-tests HEAT_REPO: https://github.com/openstack-k8s-operators/heat-operator.git HEAT_SERVICE_ENABLED: 'true' HORIZON: config/samples/horizon_v1beta1_horizon.yaml HORIZON_BRANCH: main HORIZON_COMMIT_HASH: '' HORIZON_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/config/samples/horizon_v1beta1_horizon.yaml HORIZON_DEPL_IMG: unused HORIZON_IMG: quay.io/openstack-k8s-operators/horizon-operator-index:latest HORIZON_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/kuttl-test.yaml HORIZON_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator/tests/kuttl/tests HORIZON_KUTTL_NAMESPACE: horizon-kuttl-tests HORIZON_REPO: https://github.com/openstack-k8s-operators/horizon-operator.git INFRA_BRANCH: main INFRA_COMMIT_HASH: '' INFRA_IMG: quay.io/openstack-k8s-operators/infra-operator-index:latest INFRA_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/kuttl-test.yaml INFRA_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/tests/kuttl/tests INFRA_KUTTL_NAMESPACE: infra-kuttl-tests INFRA_REPO: https://github.com/openstack-k8s-operators/infra-operator.git INSTALL_CERT_MANAGER: 'true' INSTALL_NMSTATE: true || false INSTALL_NNCP: true || false INTERNALAPI_HOST_ROUTES: '' IPV6_LAB_IPV4_NETWORK_IPADDRESS: 172.30.0.1/24 IPV6_LAB_IPV6_NETWORK_IPADDRESS: fd00:abcd:abcd:fc00::1/64 IPV6_LAB_LIBVIRT_STORAGE_POOL: default IPV6_LAB_MANAGE_FIREWALLD: 'true' IPV6_LAB_NAT64_HOST_IPV4: 172.30.0.2/24 IPV6_LAB_NAT64_HOST_IPV6: fd00:abcd:abcd:fc00::2/64 IPV6_LAB_NAT64_INSTANCE_NAME: nat64-router IPV6_LAB_NAT64_IPV6_NETWORK: fd00:abcd:abcd:fc00::/64 IPV6_LAB_NAT64_TAYGA_DYNAMIC_POOL: 192.168.255.0/24 IPV6_LAB_NAT64_TAYGA_IPV4: 192.168.255.1 IPV6_LAB_NAT64_TAYGA_IPV6: fd00:abcd:abcd:fc00::3 IPV6_LAB_NAT64_TAYGA_IPV6_PREFIX: fd00:abcd:abcd:fcff::/96 IPV6_LAB_NAT64_UPDATE_PACKAGES: 'false' IPV6_LAB_NETWORK_NAME: nat64 IPV6_LAB_SNO_CLUSTER_NETWORK: fd00:abcd:0::/48 IPV6_LAB_SNO_HOST_IP: fd00:abcd:abcd:fc00::11 IPV6_LAB_SNO_HOST_PREFIX: '64' IPV6_LAB_SNO_INSTANCE_NAME: sno IPV6_LAB_SNO_MACHINE_NETWORK: fd00:abcd:abcd:fc00::/64 IPV6_LAB_SNO_OCP_MIRROR_URL: https://mirror.openshift.com/pub/openshift-v4/clients/ocp IPV6_LAB_SNO_OCP_VERSION: latest-4.14 IPV6_LAB_SNO_SERVICE_NETWORK: fd00:abcd:abcd:fc03::/112 IPV6_LAB_SSH_PUB_KEY: /home/zuul/.ssh/id_rsa.pub IPV6_LAB_WORK_DIR: /home/zuul/.ipv6lab IRONIC: config/samples/ironic_v1beta1_ironic.yaml IRONICAPI_DEPL_IMG: unused IRONICCON_DEPL_IMG: unused IRONICINS_DEPL_IMG: unused IRONICNAG_DEPL_IMG: unused IRONICPXE_DEPL_IMG: unused IRONIC_BRANCH: main IRONIC_COMMIT_HASH: '' IRONIC_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/config/samples/ironic_v1beta1_ironic.yaml IRONIC_IMAGE_TAG: release-24.1 IRONIC_IMG: quay.io/openstack-k8s-operators/ironic-operator-index:latest IRONIC_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/kuttl-test.yaml IRONIC_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator/tests/kuttl/tests IRONIC_KUTTL_NAMESPACE: ironic-kuttl-tests IRONIC_REPO: https://github.com/openstack-k8s-operators/ironic-operator.git KEYSTONEAPI: config/samples/keystone_v1beta1_keystoneapi.yaml KEYSTONEAPI_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/config/samples/keystone_v1beta1_keystoneapi.yaml KEYSTONEAPI_DEPL_IMG: unused KEYSTONE_BRANCH: main KEYSTONE_COMMIT_HASH: '' KEYSTONE_FEDERATION_CLIENT_SECRET: COX8bmlKAWn56XCGMrKQJj7dgHNAOl6f KEYSTONE_FEDERATION_CRYPTO_PASSPHRASE: openstack KEYSTONE_IMG: quay.io/openstack-k8s-operators/keystone-operator-index:latest KEYSTONE_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/kuttl-test.yaml KEYSTONE_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator/tests/kuttl/tests KEYSTONE_KUTTL_NAMESPACE: keystone-kuttl-tests KEYSTONE_REPO: https://github.com/openstack-k8s-operators/keystone-operator.git KUBEADMIN_PWD: '12345678' LIBVIRT_SECRET: libvirt-secret LOKI_DEPLOY_MODE: openshift-network LOKI_DEPLOY_NAMESPACE: netobserv LOKI_DEPLOY_SIZE: 1x.demo LOKI_NAMESPACE: openshift-operators-redhat LOKI_OPERATOR_GROUP: openshift-operators-redhat-loki LOKI_SUBSCRIPTION: loki-operator LVMS_CR: '1' MANILA: config/samples/manila_v1beta1_manila.yaml MANILAAPI_DEPL_IMG: unused MANILASCH_DEPL_IMG: unused MANILASHARE_DEPL_IMG: unused MANILA_BRANCH: main MANILA_COMMIT_HASH: '' MANILA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/config/samples/manila_v1beta1_manila.yaml MANILA_IMG: quay.io/openstack-k8s-operators/manila-operator-index:latest MANILA_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/kuttl-test.yaml MANILA_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator/test/kuttl/tests MANILA_KUTTL_NAMESPACE: manila-kuttl-tests MANILA_REPO: https://github.com/openstack-k8s-operators/manila-operator.git MANILA_SERVICE_ENABLED: 'true' MARIADB: config/samples/mariadb_v1beta1_galera.yaml MARIADB_BRANCH: main MARIADB_CHAINSAW_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/chainsaw/config.yaml MARIADB_CHAINSAW_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/chainsaw/tests MARIADB_CHAINSAW_NAMESPACE: mariadb-chainsaw-tests MARIADB_COMMIT_HASH: '' MARIADB_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/config/samples/mariadb_v1beta1_galera.yaml MARIADB_DEPL_IMG: unused MARIADB_IMG: quay.io/openstack-k8s-operators/mariadb-operator-index:latest MARIADB_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/kuttl-test.yaml MARIADB_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator/tests/kuttl/tests MARIADB_KUTTL_NAMESPACE: mariadb-kuttl-tests MARIADB_REPO: https://github.com/openstack-k8s-operators/mariadb-operator.git MEMCACHED: config/samples/memcached_v1beta1_memcached.yaml MEMCACHED_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/memcached_v1beta1_memcached.yaml MEMCACHED_DEPL_IMG: unused METADATA_SHARED_SECRET: '1234567842' METALLB_IPV6_POOL: fd00:aaaa::80-fd00:aaaa::90 METALLB_POOL: 192.168.122.80-192.168.122.90 MICROSHIFT: '0' NAMESPACE: openstack NETCONFIG: config/samples/network_v1beta1_netconfig.yaml NETCONFIG_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator/config/samples/network_v1beta1_netconfig.yaml NETCONFIG_DEPL_IMG: unused NETOBSERV_DEPLOY_NAMESPACE: netobserv NETOBSERV_NAMESPACE: openshift-netobserv-operator NETOBSERV_OPERATOR_GROUP: openshift-netobserv-operator-net NETOBSERV_SUBSCRIPTION: netobserv-operator NETWORK_BGP: 'false' NETWORK_DESIGNATE_ADDRESS_PREFIX: 172.28.0 NETWORK_DESIGNATE_EXT_ADDRESS_PREFIX: 172.50.0 NETWORK_INTERNALAPI_ADDRESS_PREFIX: 172.17.0 NETWORK_ISOLATION: 'true' NETWORK_ISOLATION_INSTANCE_NAME: crc NETWORK_ISOLATION_IPV4: 'true' NETWORK_ISOLATION_IPV4_ADDRESS: 172.16.1.1/24 NETWORK_ISOLATION_IPV4_NAT: 'true' NETWORK_ISOLATION_IPV6: 'false' NETWORK_ISOLATION_IPV6_ADDRESS: fd00:aaaa::1/64 NETWORK_ISOLATION_IP_ADDRESS: 192.168.122.10 NETWORK_ISOLATION_MAC: '52:54:00:11:11:10' NETWORK_ISOLATION_NETWORK_NAME: net-iso NETWORK_ISOLATION_NET_NAME: default NETWORK_ISOLATION_USE_DEFAULT_NETWORK: 'true' NETWORK_MTU: '1500' NETWORK_STORAGEMGMT_ADDRESS_PREFIX: 172.20.0 NETWORK_STORAGE_ADDRESS_PREFIX: 172.18.0 NETWORK_STORAGE_MACVLAN: '' NETWORK_TENANT_ADDRESS_PREFIX: 172.19.0 NETWORK_VLAN_START: '20' NETWORK_VLAN_STEP: '1' NEUTRONAPI: config/samples/neutron_v1beta1_neutronapi.yaml NEUTRONAPI_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/config/samples/neutron_v1beta1_neutronapi.yaml NEUTRONAPI_DEPL_IMG: unused NEUTRON_BRANCH: main NEUTRON_COMMIT_HASH: '' NEUTRON_IMG: quay.io/openstack-k8s-operators/neutron-operator-index:latest NEUTRON_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/kuttl-test.yaml NEUTRON_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator/test/kuttl/tests NEUTRON_KUTTL_NAMESPACE: neutron-kuttl-tests NEUTRON_REPO: https://github.com/openstack-k8s-operators/neutron-operator.git NFS_HOME: /home/nfs NMSTATE_NAMESPACE: openshift-nmstate NMSTATE_OPERATOR_GROUP: openshift-nmstate-tn6k8 NMSTATE_SUBSCRIPTION: kubernetes-nmstate-operator NNCP_ADDITIONAL_HOST_ROUTES: '' NNCP_BGP_1_INTERFACE: enp7s0 NNCP_BGP_1_IP_ADDRESS: 100.65.4.2 NNCP_BGP_2_INTERFACE: enp8s0 NNCP_BGP_2_IP_ADDRESS: 100.64.4.2 NNCP_BRIDGE: ospbr NNCP_CLEANUP_TIMEOUT: 120s NNCP_CTLPLANE_IPV6_ADDRESS_PREFIX: 'fd00:aaaa::' NNCP_CTLPLANE_IPV6_ADDRESS_SUFFIX: '10' NNCP_CTLPLANE_IP_ADDRESS_PREFIX: 192.168.122 NNCP_CTLPLANE_IP_ADDRESS_SUFFIX: '10' NNCP_DNS_SERVER: 192.168.122.1 NNCP_DNS_SERVER_IPV6: fd00:aaaa::1 NNCP_GATEWAY: 192.168.122.1 NNCP_GATEWAY_IPV6: fd00:aaaa::1 NNCP_INTERFACE: enp6s0 NNCP_NODES: '' NNCP_TIMEOUT: 240s NOVA: config/samples/nova_v1beta1_nova_collapsed_cell.yaml NOVA_BRANCH: main NOVA_COMMIT_HASH: '' NOVA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/nova-operator/config/samples/nova_v1beta1_nova_collapsed_cell.yaml NOVA_IMG: quay.io/openstack-k8s-operators/nova-operator-index:latest NOVA_REPO: https://github.com/openstack-k8s-operators/nova-operator.git NUMBER_OF_INSTANCES: '1' OCP_NETWORK_NAME: crc OCTAVIA: config/samples/octavia_v1beta1_octavia.yaml OCTAVIA_BRANCH: main OCTAVIA_COMMIT_HASH: '' OCTAVIA_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/config/samples/octavia_v1beta1_octavia.yaml OCTAVIA_IMG: quay.io/openstack-k8s-operators/octavia-operator-index:latest OCTAVIA_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/kuttl-test.yaml OCTAVIA_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator/tests/kuttl/tests OCTAVIA_KUTTL_NAMESPACE: octavia-kuttl-tests OCTAVIA_REPO: https://github.com/openstack-k8s-operators/octavia-operator.git OKD: 'false' OPENSTACK_BRANCH: main OPENSTACK_BUNDLE_IMG: quay.io/openstack-k8s-operators/openstack-operator-bundle:latest OPENSTACK_COMMIT_HASH: '' OPENSTACK_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml OPENSTACK_CRDS_DIR: openstack_crds OPENSTACK_CTLPLANE: config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml OPENSTACK_IMG: quay.io/openstack-k8s-operators/openstack-operator-index:latest OPENSTACK_K8S_BRANCH: main OPENSTACK_K8S_TAG: latest OPENSTACK_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/kuttl-test.yaml OPENSTACK_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests OPENSTACK_KUTTL_NAMESPACE: openstack-kuttl-tests OPENSTACK_NEUTRON_CUSTOM_CONF: '' OPENSTACK_REPO: https://github.com/openstack-k8s-operators/openstack-operator.git OPENSTACK_STORAGE_BUNDLE_IMG: quay.io/openstack-k8s-operators/openstack-operator-storage-bundle:latest OPERATOR_BASE_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator OPERATOR_CHANNEL: '' OPERATOR_NAMESPACE: openstack-operators OPERATOR_SOURCE: '' OPERATOR_SOURCE_NAMESPACE: '' OUT: /home/zuul/ci-framework-data/artifacts/manifests OUTPUT_DIR: /home/zuul/ci-framework-data/artifacts/edpm OVNCONTROLLER: config/samples/ovn_v1beta1_ovncontroller.yaml OVNCONTROLLER_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovncontroller.yaml OVNCONTROLLER_NMAP: 'true' OVNDBS: config/samples/ovn_v1beta1_ovndbcluster.yaml OVNDBS_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovndbcluster.yaml OVNNORTHD: config/samples/ovn_v1beta1_ovnnorthd.yaml OVNNORTHD_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/config/samples/ovn_v1beta1_ovnnorthd.yaml OVN_BRANCH: main OVN_COMMIT_HASH: '' OVN_IMG: quay.io/openstack-k8s-operators/ovn-operator-index:latest OVN_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/kuttl-test.yaml OVN_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator/tests/kuttl/tests OVN_KUTTL_NAMESPACE: ovn-kuttl-tests OVN_REPO: https://github.com/openstack-k8s-operators/ovn-operator.git PASSWORD: '12345678' PLACEMENTAPI: config/samples/placement_v1beta1_placementapi.yaml PLACEMENTAPI_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/config/samples/placement_v1beta1_placementapi.yaml PLACEMENTAPI_DEPL_IMG: unused PLACEMENT_BRANCH: main PLACEMENT_COMMIT_HASH: '' PLACEMENT_IMG: quay.io/openstack-k8s-operators/placement-operator-index:latest PLACEMENT_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/kuttl-test.yaml PLACEMENT_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator/tests/kuttl/tests PLACEMENT_KUTTL_NAMESPACE: placement-kuttl-tests PLACEMENT_REPO: https://github.com/openstack-k8s-operators/placement-operator.git PULL_SECRET: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/pull-secret.txt RABBITMQ: docs/examples/default-security-context/rabbitmq.yaml RABBITMQ_BRANCH: patches RABBITMQ_COMMIT_HASH: '' RABBITMQ_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/rabbitmq-operator/docs/examples/default-security-context/rabbitmq.yaml RABBITMQ_DEPL_IMG: unused RABBITMQ_IMG: quay.io/openstack-k8s-operators/rabbitmq-cluster-operator-index:latest RABBITMQ_REPO: https://github.com/openstack-k8s-operators/rabbitmq-cluster-operator.git REDHAT_OPERATORS: 'false' REDIS: config/samples/redis_v1beta1_redis.yaml REDIS_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator-redis/config/samples/redis_v1beta1_redis.yaml REDIS_DEPL_IMG: unused RH_REGISTRY_PWD: '' RH_REGISTRY_USER: '' SECRET: osp-secret SG_CORE_DEPL_IMG: unused STANDALONE_COMPUTE_DRIVER: libvirt STANDALONE_EXTERNAL_NET_PREFFIX: 172.21.0 STANDALONE_INTERNALAPI_NET_PREFIX: 172.17.0 STANDALONE_STORAGEMGMT_NET_PREFIX: 172.20.0 STANDALONE_STORAGE_NET_PREFIX: 172.18.0 STANDALONE_TENANT_NET_PREFIX: 172.19.0 STORAGEMGMT_HOST_ROUTES: '' STORAGE_CLASS: local-storage STORAGE_HOST_ROUTES: '' SWIFT: config/samples/swift_v1beta1_swift.yaml SWIFT_BRANCH: main SWIFT_COMMIT_HASH: '' SWIFT_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/config/samples/swift_v1beta1_swift.yaml SWIFT_IMG: quay.io/openstack-k8s-operators/swift-operator-index:latest SWIFT_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/kuttl-test.yaml SWIFT_KUTTL_DIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator/tests/kuttl/tests SWIFT_KUTTL_NAMESPACE: swift-kuttl-tests SWIFT_REPO: https://github.com/openstack-k8s-operators/swift-operator.git TELEMETRY: config/samples/telemetry_v1beta1_telemetry.yaml TELEMETRY_BRANCH: main TELEMETRY_COMMIT_HASH: '' TELEMETRY_CR: /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator/config/samples/telemetry_v1beta1_telemetry.yaml TELEMETRY_IMG: quay.io/openstack-k8s-operators/telemetry-operator-index:latest TELEMETRY_KUTTL_BASEDIR: /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator TELEMETRY_KUTTL_CONF: /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator/kuttl-test.yaml TELEMETRY_KUTTL_NAMESPACE: telemetry-kuttl-tests TELEMETRY_KUTTL_RELPATH: tests/kuttl/suites TELEMETRY_REPO: https://github.com/openstack-k8s-operators/telemetry-operator.git TENANT_HOST_ROUTES: '' TIMEOUT: 300s TLS_ENABLED: 'false' tripleo_deploy: 'export REGISTRY_USER:' 2025-10-13 19:33:08,915 p=28354 u=zuul n=ansible | TASK [install_yamls : Generate make targets install_yamls_path={{ cifmw_install_yamls_repo }}, output_directory={{ cifmw_install_yamls_tasks_out }}] *** 2025-10-13 19:33:08,915 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:08 +0000 (0:00:00.037) 0:00:56.137 ******** 2025-10-13 19:33:09,235 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:09,251 p=28354 u=zuul n=ansible | TASK [install_yamls : Debug generate_make module var=cifmw_generate_makes] ***** 2025-10-13 19:33:09,251 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:09 +0000 (0:00:00.335) 0:00:56.473 ******** 2025-10-13 19:33:09,281 p=28354 u=zuul n=ansible | ok: [localhost] => cifmw_generate_makes: changed: false debug: /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/Makefile: - all - help - cleanup - deploy_cleanup - wait - crc_storage - crc_storage_cleanup - crc_storage_release - crc_storage_with_retries - crc_storage_cleanup_with_retries - operator_namespace - namespace - namespace_cleanup - input - input_cleanup - crc_bmo_setup - crc_bmo_cleanup - openstack_prep - openstack - openstack_wait - openstack_init - openstack_cleanup - openstack_repo - openstack_deploy_prep - openstack_deploy - openstack_wait_deploy - openstack_deploy_cleanup - openstack_update_run - update_services - update_system - openstack_patch_version - edpm_deploy_generate_keys - edpm_patch_ansible_runner_image - edpm_deploy_prep - edpm_deploy_cleanup - edpm_deploy - edpm_deploy_baremetal_prep - edpm_deploy_baremetal - edpm_wait_deploy_baremetal - edpm_wait_deploy - edpm_register_dns - edpm_nova_discover_hosts - openstack_crds - openstack_crds_cleanup - edpm_deploy_networker_prep - edpm_deploy_networker_cleanup - edpm_deploy_networker - infra_prep - infra - infra_cleanup - dns_deploy_prep - dns_deploy - dns_deploy_cleanup - netconfig_deploy_prep - netconfig_deploy - netconfig_deploy_cleanup - memcached_deploy_prep - memcached_deploy - memcached_deploy_cleanup - keystone_prep - keystone - keystone_cleanup - keystone_deploy_prep - keystone_deploy - keystone_deploy_cleanup - barbican_prep - barbican - barbican_cleanup - barbican_deploy_prep - barbican_deploy - barbican_deploy_validate - barbican_deploy_cleanup - mariadb - mariadb_cleanup - mariadb_deploy_prep - mariadb_deploy - mariadb_deploy_cleanup - placement_prep - placement - placement_cleanup - placement_deploy_prep - placement_deploy - placement_deploy_cleanup - glance_prep - glance - glance_cleanup - glance_deploy_prep - glance_deploy - glance_deploy_cleanup - ovn_prep - ovn - ovn_cleanup - ovn_deploy_prep - ovn_deploy - ovn_deploy_cleanup - neutron_prep - neutron - neutron_cleanup - neutron_deploy_prep - neutron_deploy - neutron_deploy_cleanup - cinder_prep - cinder - cinder_cleanup - cinder_deploy_prep - cinder_deploy - cinder_deploy_cleanup - rabbitmq_prep - rabbitmq - rabbitmq_cleanup - rabbitmq_deploy_prep - rabbitmq_deploy - rabbitmq_deploy_cleanup - ironic_prep - ironic - ironic_cleanup - ironic_deploy_prep - ironic_deploy - ironic_deploy_cleanup - octavia_prep - octavia - octavia_cleanup - octavia_deploy_prep - octavia_deploy - octavia_deploy_cleanup - designate_prep - designate - designate_cleanup - designate_deploy_prep - designate_deploy - designate_deploy_cleanup - nova_prep - nova - nova_cleanup - nova_deploy_prep - nova_deploy - nova_deploy_cleanup - mariadb_kuttl_run - mariadb_kuttl - kuttl_db_prep - kuttl_db_cleanup - kuttl_common_prep - kuttl_common_cleanup - keystone_kuttl_run - keystone_kuttl - barbican_kuttl_run - barbican_kuttl - placement_kuttl_run - placement_kuttl - cinder_kuttl_run - cinder_kuttl - neutron_kuttl_run - neutron_kuttl - octavia_kuttl_run - octavia_kuttl - designate_kuttl - designate_kuttl_run - ovn_kuttl_run - ovn_kuttl - infra_kuttl_run - infra_kuttl - ironic_kuttl_run - ironic_kuttl - ironic_kuttl_crc - heat_kuttl_run - heat_kuttl - heat_kuttl_crc - ansibleee_kuttl_run - ansibleee_kuttl_cleanup - ansibleee_kuttl_prep - ansibleee_kuttl - glance_kuttl_run - glance_kuttl - manila_kuttl_run - manila_kuttl - swift_kuttl_run - swift_kuttl - horizon_kuttl_run - horizon_kuttl - openstack_kuttl_run - openstack_kuttl - mariadb_chainsaw_run - mariadb_chainsaw - horizon_prep - horizon - horizon_cleanup - horizon_deploy_prep - horizon_deploy - horizon_deploy_cleanup - heat_prep - heat - heat_cleanup - heat_deploy_prep - heat_deploy - heat_deploy_cleanup - ansibleee_prep - ansibleee - ansibleee_cleanup - baremetal_prep - baremetal - baremetal_cleanup - ceph_help - ceph - ceph_cleanup - rook_prep - rook - rook_deploy_prep - rook_deploy - rook_crc_disk - rook_cleanup - lvms - nmstate - nncp - nncp_cleanup - netattach - netattach_cleanup - metallb - metallb_config - metallb_config_cleanup - metallb_cleanup - loki - loki_cleanup - loki_deploy - loki_deploy_cleanup - netobserv - netobserv_cleanup - netobserv_deploy - netobserv_deploy_cleanup - manila_prep - manila - manila_cleanup - manila_deploy_prep - manila_deploy - manila_deploy_cleanup - telemetry_prep - telemetry - telemetry_cleanup - telemetry_deploy_prep - telemetry_deploy - telemetry_deploy_cleanup - telemetry_kuttl_run - telemetry_kuttl - swift_prep - swift - swift_cleanup - swift_deploy_prep - swift_deploy - swift_deploy_cleanup - certmanager - certmanager_cleanup - validate_marketplace - redis_deploy_prep - redis_deploy - redis_deploy_cleanup - set_slower_etcd_profile /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/devsetup/Makefile: - help - download_tools - nfs - nfs_cleanup - crc - crc_cleanup - crc_scrub - crc_attach_default_interface - crc_attach_default_interface_cleanup - ipv6_lab_network - ipv6_lab_network_cleanup - ipv6_lab_nat64_router - ipv6_lab_nat64_router_cleanup - ipv6_lab_sno - ipv6_lab_sno_cleanup - ipv6_lab - ipv6_lab_cleanup - attach_default_interface - attach_default_interface_cleanup - network_isolation_bridge - network_isolation_bridge_cleanup - edpm_baremetal_compute - edpm_compute - edpm_compute_bootc - edpm_ansible_runner - edpm_computes_bgp - edpm_compute_repos - edpm_compute_cleanup - edpm_networker - edpm_networker_cleanup - edpm_deploy_instance - tripleo_deploy - standalone_deploy - standalone_sync - standalone - standalone_cleanup - standalone_snapshot - standalone_revert - cifmw_prepare - cifmw_cleanup - bmaas_network - bmaas_network_cleanup - bmaas_route_crc_and_crc_bmaas_networks - bmaas_route_crc_and_crc_bmaas_networks_cleanup - bmaas_crc_attach_network - bmaas_crc_attach_network_cleanup - bmaas_crc_baremetal_bridge - bmaas_crc_baremetal_bridge_cleanup - bmaas_baremetal_net_nad - bmaas_baremetal_net_nad_cleanup - bmaas_metallb - bmaas_metallb_cleanup - bmaas_virtual_bms - bmaas_virtual_bms_cleanup - bmaas_sushy_emulator - bmaas_sushy_emulator_cleanup - bmaas_sushy_emulator_wait - bmaas_generate_nodes_yaml - bmaas - bmaas_cleanup failed: false success: true 2025-10-13 19:33:09,295 p=28354 u=zuul n=ansible | TASK [install_yamls : Create the install_yamls parameters file dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/install-yamls-params.yml, content={{ { 'cifmw_install_yamls_environment': cifmw_install_yamls_environment, 'cifmw_install_yamls_defaults': cifmw_install_yamls_defaults } | to_nice_yaml }}, mode=0644] *** 2025-10-13 19:33:09,296 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:09 +0000 (0:00:00.044) 0:00:56.517 ******** 2025-10-13 19:33:09,703 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:09,710 p=28354 u=zuul n=ansible | TASK [install_yamls : Create empty cifmw_install_yamls_environment if needed cifmw_install_yamls_environment={}] *** 2025-10-13 19:33:09,710 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:09 +0000 (0:00:00.414) 0:00:56.932 ******** 2025-10-13 19:33:09,732 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:09,749 p=28354 u=zuul n=ansible | TASK [discover_latest_image : Get latest image url={{ cifmw_discover_latest_image_base_url }}, image_prefix={{ cifmw_discover_latest_image_qcow_prefix }}, images_file={{ cifmw_discover_latest_image_images_file }}] *** 2025-10-13 19:33:09,749 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:09 +0000 (0:00:00.038) 0:00:56.971 ******** 2025-10-13 19:33:10,710 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:10,718 p=28354 u=zuul n=ansible | TASK [discover_latest_image : Export facts accordingly cifmw_discovered_image_name={{ discovered_image['data']['image_name'] }}, cifmw_discovered_image_url={{ discovered_image['data']['image_url'] }}, cifmw_discovered_hash={{ discovered_image['data']['hash'] }}, cifmw_discovered_hash_algorithm={{ discovered_image['data']['hash_algorithm'] }}, cacheable=True] *** 2025-10-13 19:33:10,718 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:10 +0000 (0:00:00.969) 0:00:57.940 ******** 2025-10-13 19:33:10,751 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:10,766 p=28354 u=zuul n=ansible | TASK [cifmw_setup : Create artifacts with custom params mode=0644, dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/custom-params.yml, content={{ ci_framework_params | to_nice_yaml }}] *** 2025-10-13 19:33:10,767 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:10 +0000 (0:00:00.048) 0:00:57.988 ******** 2025-10-13 19:33:11,218 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:11,251 p=28354 u=zuul n=ansible | PLAY [Install deps and prepare for KUTTL run] ********************************** 2025-10-13 19:33:11,269 p=28354 u=zuul n=ansible | TASK [Download install_yamls deps name=install_yamls_makes, tasks_from=make_download_tools] *** 2025-10-13 19:33:11,269 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:11 +0000 (0:00:00.501) 0:00:58.491 ******** 2025-10-13 19:33:11,319 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Debug make_download_tools_env var=make_download_tools_env] *** 2025-10-13 19:33:11,320 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:11 +0000 (0:00:00.050) 0:00:58.541 ******** 2025-10-13 19:33:11,346 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:11,355 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Debug make_download_tools_params var=make_download_tools_params] *** 2025-10-13 19:33:11,355 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:11 +0000 (0:00:00.035) 0:00:58.577 ******** 2025-10-13 19:33:11,381 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:11,391 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Run download_tools output_dir={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts, chdir=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/devsetup, script=make download_tools, dry_run={{ make_download_tools_dryrun|default(false)|bool }}, extra_args={{ dict((make_download_tools_env|default({})), **(make_download_tools_params|default({}))) }}] *** 2025-10-13 19:33:11,391 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:11 +0000 (0:00:00.036) 0:00:58.613 ******** 2025-10-13 19:33:11,447 p=28354 u=zuul n=ansible | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_000_run_download.log 2025-10-13 19:33:45,790 p=28354 u=zuul n=ansible | [WARNING]: conditional statements should not include jinja2 templating delimiters such as {{ }} or {% %}. Found: {{ make_download_tools_until | default(true) }} 2025-10-13 19:33:45,792 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:45,804 p=28354 u=zuul n=ansible | TASK [Login into Openshift cluster name=openshift_login] *********************** 2025-10-13 19:33:45,804 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:45 +0000 (0:00:34.412) 0:01:33.026 ******** 2025-10-13 19:33:45,865 p=28354 u=zuul n=ansible | TASK [openshift_login : Ensure output directory exists path={{ cifmw_openshift_login_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:33:45,866 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:45 +0000 (0:00:00.061) 0:01:33.087 ******** 2025-10-13 19:33:46,064 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:46,073 p=28354 u=zuul n=ansible | TASK [openshift_login : OpenShift login _raw_params=login.yml] ***************** 2025-10-13 19:33:46,073 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.207) 0:01:33.295 ******** 2025-10-13 19:33:46,148 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/openshift_login/tasks/login.yml for localhost 2025-10-13 19:33:46,157 p=28354 u=zuul n=ansible | TASK [openshift_login : Check if the password file is present path={{ cifmw_openshift_login_password_file | default(cifmw_openshift_password_file) }}] *** 2025-10-13 19:33:46,157 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.084) 0:01:33.379 ******** 2025-10-13 19:33:46,182 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:46,190 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch user password content src={{ cifmw_openshift_login_password_file | default(cifmw_openshift_password_file) }}] *** 2025-10-13 19:33:46,190 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.032) 0:01:33.412 ******** 2025-10-13 19:33:46,217 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:46,226 p=28354 u=zuul n=ansible | TASK [openshift_login : Set user password as a fact cifmw_openshift_login_password={{ cifmw_openshift_login_password_file_slurp.content | b64decode }}, cacheable=True] *** 2025-10-13 19:33:46,226 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.036) 0:01:33.448 ******** 2025-10-13 19:33:46,252 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:46,260 p=28354 u=zuul n=ansible | TASK [openshift_login : Set role variables cifmw_openshift_login_kubeconfig={{ cifmw_openshift_login_kubeconfig | default(cifmw_openshift_kubeconfig) | default( ansible_env.KUBECONFIG if 'KUBECONFIG' in ansible_env else cifmw_openshift_login_kubeconfig_default_path ) | trim }}, cifmw_openshift_login_user={{ cifmw_openshift_login_user | default(cifmw_openshift_user) | default(omit) }}, cifmw_openshift_login_password={{ cifmw_openshift_login_password | default(cifmw_openshift_password) | default(omit) }}, cifmw_openshift_login_api={{ cifmw_openshift_login_api | default(cifmw_openshift_api) | default(omit) }}, cifmw_openshift_login_cert_login={{ cifmw_openshift_login_cert_login | default(false)}}, cifmw_openshift_login_provided_token={{ cifmw_openshift_provided_token | default(omit) }}, cacheable=True] *** 2025-10-13 19:33:46,260 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.033) 0:01:33.482 ******** 2025-10-13 19:33:46,297 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:46,305 p=28354 u=zuul n=ansible | TASK [openshift_login : Check if kubeconfig exists path={{ cifmw_openshift_login_kubeconfig }}] *** 2025-10-13 19:33:46,305 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.044) 0:01:33.527 ******** 2025-10-13 19:33:46,474 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:46,491 p=28354 u=zuul n=ansible | TASK [openshift_login : Assert that enough data is provided to log in to OpenShift that=cifmw_openshift_login_kubeconfig_stat.stat.exists or (cifmw_openshift_login_provided_token is defined and cifmw_openshift_login_provided_token != '') or ( (cifmw_openshift_login_user is defined) and (cifmw_openshift_login_password is defined) and (cifmw_openshift_login_api is defined) ), msg=If an existing kubeconfig is not provided user/pwd or provided/initial token and API URL must be given] *** 2025-10-13 19:33:46,491 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.185) 0:01:33.713 ******** 2025-10-13 19:33:46,520 p=28354 u=zuul n=ansible | ok: [localhost] => changed: false msg: All assertions passed 2025-10-13 19:33:46,529 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch kubeconfig content src={{ cifmw_openshift_login_kubeconfig }}] *** 2025-10-13 19:33:46,529 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.037) 0:01:33.751 ******** 2025-10-13 19:33:46,549 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:46,557 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch x509 key based users cifmw_openshift_login_key_based_users={{ ( cifmw_openshift_login_kubeconfig_content_b64.content | b64decode | from_yaml ). users | default([]) | selectattr('user.client-certificate-data', 'defined') | map(attribute="name") | map("split", "/") | map("first") }}, cacheable=True] *** 2025-10-13 19:33:46,558 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.028) 0:01:33.779 ******** 2025-10-13 19:33:46,580 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:46,588 p=28354 u=zuul n=ansible | TASK [openshift_login : Assign key based user if not provided and available cifmw_openshift_login_user={{ (cifmw_openshift_login_assume_cert_system_user | ternary('system:', '')) + (cifmw_openshift_login_key_based_users | map('replace', 'system:', '') | unique | first) }}, cifmw_openshift_login_cert_login=True, cacheable=True] *** 2025-10-13 19:33:46,588 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.030) 0:01:33.810 ******** 2025-10-13 19:33:46,607 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:46,615 p=28354 u=zuul n=ansible | TASK [openshift_login : Set the retry count cifmw_openshift_login_retries_cnt={{ 0 if cifmw_openshift_login_retries_cnt is undefined else cifmw_openshift_login_retries_cnt|int + 1 }}] *** 2025-10-13 19:33:46,615 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.026) 0:01:33.837 ******** 2025-10-13 19:33:46,638 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:46,645 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch token _raw_params=try_login.yml] ***************** 2025-10-13 19:33:46,645 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.030) 0:01:33.867 ******** 2025-10-13 19:33:46,669 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/openshift_login/tasks/try_login.yml for localhost 2025-10-13 19:33:46,678 p=28354 u=zuul n=ansible | TASK [openshift_login : Try get OpenShift access token _raw_params=oc whoami -t] *** 2025-10-13 19:33:46,678 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:46 +0000 (0:00:00.032) 0:01:33.900 ******** 2025-10-13 19:33:47,013 p=28354 u=zuul n=ansible | fatal: [localhost]: FAILED! => changed: true cmd: - oc - whoami - -t delta: '0:00:00.142565' end: '2025-10-13 19:33:46.987813' msg: non-zero return code rc: 1 start: '2025-10-13 19:33:46.845248' stderr: |- error: Missing or incomplete configuration info. Please point to an existing, complete config file: 1. Via the command-line flag --kubeconfig 2. Via the KUBECONFIG environment variable 3. In your home directory as ~/.kube/config To view or setup config directly use the 'config' command. stderr_lines: - 'error: Missing or incomplete configuration info. Please point to an existing, complete config file:' - '' - '' - ' 1. Via the command-line flag --kubeconfig' - ' 2. Via the KUBECONFIG environment variable' - ' 3. In your home directory as ~/.kube/config' - '' - To view or setup config directly use the 'config' command. stdout: '' stdout_lines: [] 2025-10-13 19:33:47,013 p=28354 u=zuul n=ansible | ...ignoring 2025-10-13 19:33:47,026 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch OpenShift token output_dir={{ cifmw_openshift_login_basedir }}/artifacts, script=oc login {%- if cifmw_openshift_login_provided_token is not defined %} {%- if cifmw_openshift_login_user is defined %} -u {{ cifmw_openshift_login_user }} {%- endif %} {%- if cifmw_openshift_login_password is defined %} -p {{ cifmw_openshift_login_password }} {%- endif %} {% else %} --token={{ cifmw_openshift_login_provided_token }} {%- endif %} {%- if cifmw_openshift_login_skip_tls_verify|bool %} --insecure-skip-tls-verify=true {%- endif %} {%- if cifmw_openshift_login_api is defined %} {{ cifmw_openshift_login_api }} {%- endif %}] *** 2025-10-13 19:33:47,026 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:47 +0000 (0:00:00.348) 0:01:34.248 ******** 2025-10-13 19:33:47,076 p=28354 u=zuul n=ansible | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_001_fetch_openshift.log 2025-10-13 19:33:47,437 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:47,445 p=28354 u=zuul n=ansible | TASK [openshift_login : Ensure kubeconfig is provided that=cifmw_openshift_login_kubeconfig != ""] *** 2025-10-13 19:33:47,445 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:47 +0000 (0:00:00.418) 0:01:34.667 ******** 2025-10-13 19:33:47,463 p=28354 u=zuul n=ansible | ok: [localhost] => changed: false msg: All assertions passed 2025-10-13 19:33:47,470 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch new OpenShift access token _raw_params=oc whoami -t] *** 2025-10-13 19:33:47,470 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:47 +0000 (0:00:00.025) 0:01:34.692 ******** 2025-10-13 19:33:47,769 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:47,777 p=28354 u=zuul n=ansible | TASK [openshift_login : Set new OpenShift token cifmw_openshift_login_token={{ (not cifmw_openshift_login_new_token_out.skipped | default(false)) | ternary(cifmw_openshift_login_new_token_out.stdout, cifmw_openshift_login_whoami_out.stdout) }}, cacheable=True] *** 2025-10-13 19:33:47,777 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:47 +0000 (0:00:00.306) 0:01:34.999 ******** 2025-10-13 19:33:47,808 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:47,815 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch OpenShift API URL _raw_params=oc whoami --show-server=true] *** 2025-10-13 19:33:47,815 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:47 +0000 (0:00:00.038) 0:01:35.037 ******** 2025-10-13 19:33:48,132 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:48,140 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch OpenShift kubeconfig context _raw_params=oc whoami -c] *** 2025-10-13 19:33:48,140 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:48 +0000 (0:00:00.324) 0:01:35.362 ******** 2025-10-13 19:33:48,452 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:48,460 p=28354 u=zuul n=ansible | TASK [openshift_login : Fetch OpenShift current user _raw_params=oc whoami] **** 2025-10-13 19:33:48,460 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:48 +0000 (0:00:00.320) 0:01:35.682 ******** 2025-10-13 19:33:48,760 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:48,769 p=28354 u=zuul n=ansible | TASK [openshift_login : Set OpenShift user, context and API facts cifmw_openshift_login_api={{ cifmw_openshift_login_api_out.stdout }}, cifmw_openshift_login_context={{ cifmw_openshift_login_context_out.stdout }}, cifmw_openshift_login_user={{ _oauth_user }}, cifmw_openshift_kubeconfig={{ cifmw_openshift_login_kubeconfig }}, cifmw_openshift_api={{ cifmw_openshift_login_api_out.stdout }}, cifmw_openshift_context={{ cifmw_openshift_login_context_out.stdout }}, cifmw_openshift_user={{ _oauth_user }}, cifmw_openshift_token={{ cifmw_openshift_login_token | default(omit) }}, cifmw_install_yamls_environment={{ ( cifmw_install_yamls_environment | combine({'KUBECONFIG': cifmw_openshift_login_kubeconfig}) ) if cifmw_install_yamls_environment is defined else omit }}, cacheable=True] *** 2025-10-13 19:33:48,769 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:48 +0000 (0:00:00.309) 0:01:35.991 ******** 2025-10-13 19:33:48,806 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:48,813 p=28354 u=zuul n=ansible | TASK [openshift_login : Create the openshift_login parameters file dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/openshift-login-params.yml, content={{ cifmw_openshift_login_params_content | from_yaml | to_nice_yaml }}, mode=0600] *** 2025-10-13 19:33:48,813 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:48 +0000 (0:00:00.044) 0:01:36.035 ******** 2025-10-13 19:33:49,221 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:49,228 p=28354 u=zuul n=ansible | TASK [openshift_login : Read the install yamls parameters file path={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/install-yamls-params.yml] *** 2025-10-13 19:33:49,228 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:49 +0000 (0:00:00.414) 0:01:36.450 ******** 2025-10-13 19:33:49,534 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:49,541 p=28354 u=zuul n=ansible | TASK [openshift_login : Append the KUBECONFIG to the install yamls parameters content={{ cifmw_openshift_login_install_yamls_artifacts_slurp['content'] | b64decode | from_yaml | combine( { 'cifmw_install_yamls_environment': { 'KUBECONFIG': cifmw_openshift_login_kubeconfig } }, recursive=true) | to_nice_yaml }}, dest={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts/parameters/install-yamls-params.yml, mode=0600] *** 2025-10-13 19:33:49,541 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:49 +0000 (0:00:00.312) 0:01:36.763 ******** 2025-10-13 19:33:49,988 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:50,019 p=28354 u=zuul n=ansible | TASK [openshift_setup : Ensure output directory exists path={{ cifmw_openshift_setup_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:33:50,019 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:50 +0000 (0:00:00.477) 0:01:37.241 ******** 2025-10-13 19:33:50,215 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:50,231 p=28354 u=zuul n=ansible | TASK [openshift_setup : Fetch namespaces to create cifmw_openshift_setup_namespaces={{ (( ([cifmw_install_yamls_defaults['NAMESPACE']] + ([cifmw_install_yamls_defaults['OPERATOR_NAMESPACE']] if 'OPERATOR_NAMESPACE' is in cifmw_install_yamls_defaults else []) ) if cifmw_install_yamls_defaults is defined else [] ) + cifmw_openshift_setup_create_namespaces) | unique }}] *** 2025-10-13 19:33:50,231 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:50 +0000 (0:00:00.212) 0:01:37.453 ******** 2025-10-13 19:33:50,260 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:50,272 p=28354 u=zuul n=ansible | TASK [openshift_setup : Create required namespaces kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit) }}, name={{ item }}, kind=Namespace, state=present] *** 2025-10-13 19:33:50,272 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:50 +0000 (0:00:00.040) 0:01:37.494 ******** 2025-10-13 19:33:51,244 p=28354 u=zuul n=ansible | changed: [localhost] => (item=openstack) 2025-10-13 19:33:51,965 p=28354 u=zuul n=ansible | changed: [localhost] => (item=openstack-operators) 2025-10-13 19:33:51,979 p=28354 u=zuul n=ansible | TASK [openshift_setup : Get internal OpenShift registry route kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Route, name=default-route, namespace=openshift-image-registry] *** 2025-10-13 19:33:51,979 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:51 +0000 (0:00:01.707) 0:01:39.201 ******** 2025-10-13 19:33:51,996 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,007 p=28354 u=zuul n=ansible | TASK [openshift_setup : Allow anonymous image-pulls in CRC registry for targeted namespaces state=present, kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, definition={'kind': 'RoleBinding', 'apiVersion': 'rbac.authorization.k8s.io/v1', 'metadata': {'name': 'system:image-puller', 'namespace': '{{ item }}'}, 'subjects': [{'kind': 'User', 'name': 'system:anonymous'}, {'kind': 'User', 'name': 'system:unauthenticated'}], 'roleRef': {'kind': 'ClusterRole', 'name': 'system:image-puller'}}] *** 2025-10-13 19:33:52,007 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.027) 0:01:39.229 ******** 2025-10-13 19:33:52,027 p=28354 u=zuul n=ansible | skipping: [localhost] => (item=openstack) 2025-10-13 19:33:52,028 p=28354 u=zuul n=ansible | skipping: [localhost] => (item=openstack-operators) 2025-10-13 19:33:52,029 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,039 p=28354 u=zuul n=ansible | TASK [openshift_setup : Wait for the image registry to be ready kind=Deployment, name=image-registry, namespace=openshift-image-registry, kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, wait=True, wait_sleep=10, wait_timeout=600, wait_condition={'type': 'Available', 'status': 'True'}] *** 2025-10-13 19:33:52,039 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.032) 0:01:39.261 ******** 2025-10-13 19:33:52,060 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,069 p=28354 u=zuul n=ansible | TASK [openshift_setup : Login into OpenShift internal registry output_dir={{ cifmw_openshift_setup_basedir }}/artifacts, script=podman login -u {{ cifmw_openshift_user }} -p {{ cifmw_openshift_token }} {%- if cifmw_openshift_setup_skip_internal_registry_tls_verify|bool %} --tls-verify=false {%- endif %} {{ cifmw_openshift_setup_registry_default_route.resources[0].spec.host }}] *** 2025-10-13 19:33:52,070 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.030) 0:01:39.291 ******** 2025-10-13 19:33:52,090 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,098 p=28354 u=zuul n=ansible | TASK [Ensure we have custom CA installed on host role=install_ca] ************** 2025-10-13 19:33:52,098 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.028) 0:01:39.320 ******** 2025-10-13 19:33:52,122 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,131 p=28354 u=zuul n=ansible | TASK [openshift_setup : Update ca bundle _raw_params=update-ca-trust extract] *** 2025-10-13 19:33:52,131 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.032) 0:01:39.353 ******** 2025-10-13 19:33:52,154 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,164 p=28354 u=zuul n=ansible | TASK [openshift_setup : Slurp CAs file src={{ cifmw_openshift_setup_ca_bundle_path }}] *** 2025-10-13 19:33:52,164 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.033) 0:01:39.386 ******** 2025-10-13 19:33:52,183 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,190 p=28354 u=zuul n=ansible | TASK [openshift_setup : Create config map with registry CAs kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, definition={'apiVersion': 'v1', 'kind': 'ConfigMap', 'metadata': {'namespace': 'openshift-config', 'name': 'registry-cas'}, 'data': '{{ _config_map_data | items2dict }}'}] *** 2025-10-13 19:33:52,191 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.026) 0:01:39.412 ******** 2025-10-13 19:33:52,212 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,219 p=28354 u=zuul n=ansible | TASK [openshift_setup : Install Red Hat CA for pulling images from internal registry kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, merge_type=merge, definition={'apiVersion': 'config.openshift.io/v1', 'kind': 'Image', 'metadata': {'name': 'cluster'}, 'spec': {'additionalTrustedCA': {'name': 'registry-cas'}}}] *** 2025-10-13 19:33:52,220 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.029) 0:01:39.441 ******** 2025-10-13 19:33:52,244 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,251 p=28354 u=zuul n=ansible | TASK [openshift_setup : Add insecure registry kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, merge_type=merge, definition={'apiVersion': 'config.openshift.io/v1', 'kind': 'Image', 'metadata': {'name': 'cluster'}, 'spec': {'registrySources': {'insecureRegistries': ['{{ cifmw_update_containers_registry }}'], 'allowedRegistries': '{{ all_registries }}'}}}] *** 2025-10-13 19:33:52,251 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.031) 0:01:39.473 ******** 2025-10-13 19:33:52,271 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,277 p=28354 u=zuul n=ansible | TASK [openshift_setup : Create a ICSP with repository digest mirrors kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, definition={'apiVersion': 'operator.openshift.io/v1alpha1', 'kind': 'ImageContentSourcePolicy', 'metadata': {'name': 'registry-digest-mirrors'}, 'spec': {'repositoryDigestMirrors': '{{ cifmw_openshift_setup_digest_mirrors }}'}}] *** 2025-10-13 19:33:52,277 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.026) 0:01:39.499 ******** 2025-10-13 19:33:52,299 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,306 p=28354 u=zuul n=ansible | TASK [openshift_setup : Metal3 tweaks _raw_params=metal3_config.yml] *********** 2025-10-13 19:33:52,306 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.028) 0:01:39.528 ******** 2025-10-13 19:33:52,329 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/openshift_setup/tasks/metal3_config.yml for localhost 2025-10-13 19:33:52,338 p=28354 u=zuul n=ansible | TASK [openshift_setup : Fetch Metal3 configuration name _raw_params=oc get Provisioning -o name] *** 2025-10-13 19:33:52,338 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.032) 0:01:39.560 ******** 2025-10-13 19:33:52,353 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,360 p=28354 u=zuul n=ansible | TASK [openshift_setup : Apply the patch to Metal3 Provisioning _raw_params=oc patch {{ _cifmw_openshift_setup_provisioning_name.stdout }} --type='json' -p='[{"op": "replace", "path": "/spec/watchAllNamespaces", "value": true}]'] *** 2025-10-13 19:33:52,360 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.021) 0:01:39.582 ******** 2025-10-13 19:33:52,376 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:52,385 p=28354 u=zuul n=ansible | TASK [openshift_setup : Gather network.operator info kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, api_version=operator.openshift.io/v1, kind=Network, name=cluster] *** 2025-10-13 19:33:52,385 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:52 +0000 (0:00:00.024) 0:01:39.607 ******** 2025-10-13 19:33:53,342 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:33:53,354 p=28354 u=zuul n=ansible | TASK [openshift_setup : Patch network operator api_version=operator.openshift.io/v1, kubeconfig={{ cifmw_openshift_kubeconfig }}, kind=Network, name=cluster, persist_config=True, patch=[{'path': '/spec/defaultNetwork/ovnKubernetesConfig/gatewayConfig/routingViaHost', 'value': True, 'op': 'replace'}, {'path': '/spec/defaultNetwork/ovnKubernetesConfig/gatewayConfig/ipForwarding', 'value': 'Global', 'op': 'replace'}]] *** 2025-10-13 19:33:53,355 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:53 +0000 (0:00:00.969) 0:01:40.576 ******** 2025-10-13 19:33:54,281 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:54,289 p=28354 u=zuul n=ansible | TASK [openshift_setup : Patch samples registry configuration kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, api_version=samples.operator.openshift.io/v1, kind=Config, name=cluster, patch=[{'op': 'replace', 'path': '/spec/samplesRegistry', 'value': 'registry.redhat.io'}]] *** 2025-10-13 19:33:54,290 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:54 +0000 (0:00:00.934) 0:01:41.512 ******** 2025-10-13 19:33:55,039 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:33:55,057 p=28354 u=zuul n=ansible | TASK [openshift_setup : Delete the pods from openshift-marketplace namespace kind=Pod, state=absent, delete_all=True, kubeconfig={{ cifmw_openshift_kubeconfig }}, namespace=openshift-marketplace] *** 2025-10-13 19:33:55,058 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:55 +0000 (0:00:00.767) 0:01:42.279 ******** 2025-10-13 19:33:55,076 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:55,087 p=28354 u=zuul n=ansible | TASK [openshift_setup : Wait for openshift-marketplace pods to be running _raw_params=oc wait pod --all --for=condition=Ready -n openshift-marketplace --timeout=1m] *** 2025-10-13 19:33:55,088 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:55 +0000 (0:00:00.029) 0:01:42.309 ******** 2025-10-13 19:33:55,104 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:55,124 p=28354 u=zuul n=ansible | TASK [Attach default network to CRC name=install_yamls_makes, tasks_from=make_crc_attach_default_interface] *** 2025-10-13 19:33:55,125 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:55 +0000 (0:00:00.036) 0:01:42.346 ******** 2025-10-13 19:33:55,198 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Debug make_crc_attach_default_interface_env var=make_crc_attach_default_interface_env] *** 2025-10-13 19:33:55,198 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:55 +0000 (0:00:00.073) 0:01:42.420 ******** 2025-10-13 19:33:55,233 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:55,241 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Debug make_crc_attach_default_interface_params var=make_crc_attach_default_interface_params] *** 2025-10-13 19:33:55,241 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:55 +0000 (0:00:00.043) 0:01:42.463 ******** 2025-10-13 19:33:55,261 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:33:55,274 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Run crc_attach_default_interface output_dir={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts, chdir=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/devsetup, script=make crc_attach_default_interface, dry_run={{ make_crc_attach_default_interface_dryrun|default(false)|bool }}, extra_args={{ dict((make_crc_attach_default_interface_env|default({})), **(make_crc_attach_default_interface_params|default({}))) }}] *** 2025-10-13 19:33:55,274 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:33:55 +0000 (0:00:00.032) 0:01:42.496 ******** 2025-10-13 19:33:55,314 p=28354 u=zuul n=ansible | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_002_run_crc_attach_default.log 2025-10-13 19:34:00,457 p=28354 u=zuul n=ansible | [WARNING]: conditional statements should not include jinja2 templating delimiters such as {{ }} or {% %}. Found: {{ make_crc_attach_default_interface_until | default(true) }} 2025-10-13 19:34:00,459 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:00,477 p=28354 u=zuul n=ansible | TASK [run_hook : Assert parameters are valid quiet=True, that=['_list_hooks is not string', '_list_hooks is not mapping', '_list_hooks is iterable', '(hooks | default([])) is not string', '(hooks | default([])) is not mapping', '(hooks | default([])) is iterable']] *** 2025-10-13 19:34:00,477 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:00 +0000 (0:00:05.202) 0:01:47.699 ******** 2025-10-13 19:34:00,547 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:00,557 p=28354 u=zuul n=ansible | TASK [run_hook : Assert single hooks are all mappings quiet=True, that=['_not_mapping_hooks | length == 0'], msg=All single hooks must be a list of mappings or a mapping.] *** 2025-10-13 19:34:00,557 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:00 +0000 (0:00:00.080) 0:01:47.779 ******** 2025-10-13 19:34:00,662 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:00,671 p=28354 u=zuul n=ansible | TASK [run_hook : Loop on hooks for pre_kuttl _raw_params={{ hook.type }}.yml] *** 2025-10-13 19:34:00,672 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:00 +0000 (0:00:00.114) 0:01:47.893 ******** 2025-10-13 19:34:00,821 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/run_hook/tasks/playbook.yml for localhost => (item={'name': 'Fetch crc facts and save them as parameters for kuttl jobs', 'type': 'playbook', 'inventory': '/home/zuul/ci-framework-data/artifacts/zuul_inventory.yml', 'source': 'kuttl_openstack_prep.yml'}) 2025-10-13 19:34:00,828 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/run_hook/tasks/playbook.yml for localhost => (item={'name': 'Fetch crc facts and save them as parameters for kuttl jobs', 'type': 'playbook', 'inventory': '/home/zuul/ci-framework-data/artifacts/zuul_inventory.yml', 'source': 'kuttl_openstack_prep.yml'}) 2025-10-13 19:34:00,837 p=28354 u=zuul n=ansible | TASK [run_hook : Set playbook path for Fetch crc facts and save them as parameters for kuttl jobs cifmw_basedir={{ _bdir }}, hook_name={{ _hook_name }}, playbook_path={{ _play | realpath }}, log_path={{ _bdir }}/logs/{{ step }}_{{ _hook_name }}.log, extra_vars=-e operator_namespace={{ _operator_namespace }} -e namespace={{ _namespace}} {%- if hook.extra_vars is defined and hook.extra_vars|length > 0 -%} {% for key,value in hook.extra_vars.items() -%} {%- if key == 'file' %} -e "@{{ value }}" {%- else %} -e "{{ key }}={{ value }}" {%- endif %} {%- endfor %} {%- endif %}] *** 2025-10-13 19:34:00,837 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:00 +0000 (0:00:00.165) 0:01:48.059 ******** 2025-10-13 19:34:00,882 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:00,893 p=28354 u=zuul n=ansible | TASK [run_hook : Get file stat path={{ playbook_path }}] *********************** 2025-10-13 19:34:00,893 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:00 +0000 (0:00:00.055) 0:01:48.115 ******** 2025-10-13 19:34:01,085 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:01,092 p=28354 u=zuul n=ansible | TASK [run_hook : Fail if playbook doesn't exist msg=Playbook {{ playbook_path }} doesn't seem to exist.] *** 2025-10-13 19:34:01,092 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:01 +0000 (0:00:00.198) 0:01:48.314 ******** 2025-10-13 19:34:01,107 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:01,115 p=28354 u=zuul n=ansible | TASK [run_hook : Get parameters files paths={{ (cifmw_basedir, 'artifacts/parameters') | path_join }}, file_type=file, patterns=*.yml] *** 2025-10-13 19:34:01,115 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:01 +0000 (0:00:00.023) 0:01:48.337 ******** 2025-10-13 19:34:01,290 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:01,298 p=28354 u=zuul n=ansible | TASK [run_hook : Add parameters artifacts as extra variables extra_vars={{ extra_vars }} {% for file in cifmw_run_hook_parameters_files.files %} -e "@{{ file.path }}" {%- endfor %}] *** 2025-10-13 19:34:01,298 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:01 +0000 (0:00:00.182) 0:01:48.520 ******** 2025-10-13 19:34:01,315 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:01,323 p=28354 u=zuul n=ansible | TASK [run_hook : Ensure log directory exists path={{ log_path | dirname }}, state=directory, mode=0755] *** 2025-10-13 19:34:01,323 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:01 +0000 (0:00:00.025) 0:01:48.545 ******** 2025-10-13 19:34:01,500 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:01,508 p=28354 u=zuul n=ansible | TASK [run_hook : Ensure artifacts directory exists path={{ cifmw_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:34:01,508 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:01 +0000 (0:00:00.185) 0:01:48.730 ******** 2025-10-13 19:34:01,683 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:01,702 p=28354 u=zuul n=ansible | TASK [run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:01,702 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:01 +0000 (0:00:00.193) 0:01:48.924 ******** 2025-10-13 19:34:01,761 p=28354 u=zuul n=ansible | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_003_run_hook_without_retry_fetch.log 2025-10-13 19:34:03,436 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:03,445 p=28354 u=zuul n=ansible | TASK [run_hook : Run hook with retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:03,445 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:03 +0000 (0:00:01.743) 0:01:50.667 ******** 2025-10-13 19:34:03,462 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:03,471 p=28354 u=zuul n=ansible | TASK [run_hook : Check if we have a file path={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:03,472 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:03 +0000 (0:00:00.026) 0:01:50.693 ******** 2025-10-13 19:34:03,650 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:03,657 p=28354 u=zuul n=ansible | TASK [run_hook : Load generated content in main playbook file={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:03,657 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:03 +0000 (0:00:00.185) 0:01:50.879 ******** 2025-10-13 19:34:03,671 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:03,679 p=28354 u=zuul n=ansible | TASK [run_hook : Set playbook path for Fetch crc facts and save them as parameters for kuttl jobs cifmw_basedir={{ _bdir }}, hook_name={{ _hook_name }}, playbook_path={{ _play | realpath }}, log_path={{ _bdir }}/logs/{{ step }}_{{ _hook_name }}.log, extra_vars=-e operator_namespace={{ _operator_namespace }} -e namespace={{ _namespace}} {%- if hook.extra_vars is defined and hook.extra_vars|length > 0 -%} {% for key,value in hook.extra_vars.items() -%} {%- if key == 'file' %} -e "@{{ value }}" {%- else %} -e "{{ key }}={{ value }}" {%- endif %} {%- endfor %} {%- endif %}] *** 2025-10-13 19:34:03,679 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:03 +0000 (0:00:00.022) 0:01:50.901 ******** 2025-10-13 19:34:03,725 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:03,733 p=28354 u=zuul n=ansible | TASK [run_hook : Get file stat path={{ playbook_path }}] *********************** 2025-10-13 19:34:03,733 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:03 +0000 (0:00:00.053) 0:01:50.954 ******** 2025-10-13 19:34:03,929 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:03,941 p=28354 u=zuul n=ansible | TASK [run_hook : Fail if playbook doesn't exist msg=Playbook {{ playbook_path }} doesn't seem to exist.] *** 2025-10-13 19:34:03,941 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:03 +0000 (0:00:00.208) 0:01:51.163 ******** 2025-10-13 19:34:03,956 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:03,964 p=28354 u=zuul n=ansible | TASK [run_hook : Get parameters files paths={{ (cifmw_basedir, 'artifacts/parameters') | path_join }}, file_type=file, patterns=*.yml] *** 2025-10-13 19:34:03,964 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:03 +0000 (0:00:00.022) 0:01:51.186 ******** 2025-10-13 19:34:04,134 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:04,142 p=28354 u=zuul n=ansible | TASK [run_hook : Add parameters artifacts as extra variables extra_vars={{ extra_vars }} {% for file in cifmw_run_hook_parameters_files.files %} -e "@{{ file.path }}" {%- endfor %}] *** 2025-10-13 19:34:04,142 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:04 +0000 (0:00:00.178) 0:01:51.364 ******** 2025-10-13 19:34:04,160 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:04,168 p=28354 u=zuul n=ansible | TASK [run_hook : Ensure log directory exists path={{ log_path | dirname }}, state=directory, mode=0755] *** 2025-10-13 19:34:04,168 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:04 +0000 (0:00:00.025) 0:01:51.390 ******** 2025-10-13 19:34:04,341 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:04,351 p=28354 u=zuul n=ansible | TASK [run_hook : Ensure artifacts directory exists path={{ cifmw_basedir }}/artifacts, state=directory, mode=0755] *** 2025-10-13 19:34:04,351 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:04 +0000 (0:00:00.183) 0:01:51.573 ******** 2025-10-13 19:34:04,532 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:04,541 p=28354 u=zuul n=ansible | TASK [run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:04,541 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:04 +0000 (0:00:00.189) 0:01:51.763 ******** 2025-10-13 19:34:04,594 p=28354 u=zuul n=ansible | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_004_run_hook_without_retry_fetch.log 2025-10-13 19:34:06,289 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:06,308 p=28354 u=zuul n=ansible | TASK [run_hook : Run hook with retry - Fetch crc facts and save them as parameters for kuttl jobs] *** 2025-10-13 19:34:06,308 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:01.767) 0:01:53.530 ******** 2025-10-13 19:34:06,327 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:06,339 p=28354 u=zuul n=ansible | TASK [run_hook : Check if we have a file path={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:06,339 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.030) 0:01:53.561 ******** 2025-10-13 19:34:06,504 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:06,515 p=28354 u=zuul n=ansible | TASK [run_hook : Load generated content in main playbook file={{ cifmw_basedir }}/artifacts/{{ step }}_{{ hook_name }}.yml] *** 2025-10-13 19:34:06,515 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.175) 0:01:53.737 ******** 2025-10-13 19:34:06,530 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:06,547 p=28354 u=zuul n=ansible | TASK [Run kuttl tests _raw_params=run-kuttl-tests.yml] ************************* 2025-10-13 19:34:06,548 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.032) 0:01:53.769 ******** 2025-10-13 19:34:06,587 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=openstack) 2025-10-13 19:34:06,593 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=barbican) 2025-10-13 19:34:06,599 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=keystone) 2025-10-13 19:34:06,605 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/ci/playbooks/kuttl/run-kuttl-tests.yml for localhost => (item=horizon) 2025-10-13 19:34:06,627 p=28354 u=zuul n=ansible | TASK [Load parameters dir={{ cifmw_basedir }}/artifacts/parameters] ************ 2025-10-13 19:34:06,628 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.079) 0:01:53.849 ******** 2025-10-13 19:34:06,679 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:06,686 p=28354 u=zuul n=ansible | TASK [Use the locally built operators if any _local_operators_indexes={{ _local_operators_indexes|default({}) | combine({ item.key.split('-')[0]|upper+'_IMG': cifmw_operator_build_output['operators'][item.key].image_catalog}) }}] *** 2025-10-13 19:34:06,686 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.058) 0:01:53.908 ******** 2025-10-13 19:34:06,711 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:06,718 p=28354 u=zuul n=ansible | TASK [Set environment vars for kuttl test cifmw_kuttl_tests_env={{ _local_operators_indexes | default({}) | combine(cifmw_install_yamls_environment) | combine(cifmw_kuttl_tests_env_vars | default({})) | combine(cifmw_kuttl_openstack_prep_vars | default({})) | combine({'PATH': cifmw_path}) }}] *** 2025-10-13 19:34:06,718 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.031) 0:01:53.940 ******** 2025-10-13 19:34:06,742 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:06,749 p=28354 u=zuul n=ansible | TASK [Clean storage beforehand name=ci_local_storage, tasks_from=cleanup.yml] *** 2025-10-13 19:34:06,749 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.031) 0:01:53.971 ******** 2025-10-13 19:34:06,789 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Get all pvs kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=PersistentVolume, label_selectors=['provisioned-by={{ cifmw_cls_storage_provisioner }}']] *** 2025-10-13 19:34:06,789 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:06 +0000 (0:00:00.039) 0:01:54.011 ******** 2025-10-13 19:34:07,520 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:07,528 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Export PVs as facts cifmw_cls_pvs={{ _pv_info.resources | selectattr("metadata.name", "defined") | map(attribute="metadata.name") }}] *** 2025-10-13 19:34:07,528 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:07 +0000 (0:00:00.739) 0:01:54.750 ******** 2025-10-13 19:34:07,561 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:07,570 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Delete all pvs kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=PersistentVolume, state=absent, api_version=v1, namespace={{ cifmw_cls_namespace }}, name={{ item }}] *** 2025-10-13 19:34:07,570 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:07 +0000 (0:00:00.041) 0:01:54.792 ******** 2025-10-13 19:34:07,587 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:07,595 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Get k8s nodes kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Node] *** 2025-10-13 19:34:07,595 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:07 +0000 (0:00:00.024) 0:01:54.817 ******** 2025-10-13 19:34:08,371 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:08,380 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Fetch hostnames for all hosts _raw_params=hostname] *** 2025-10-13 19:34:08,381 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:08 +0000 (0:00:00.785) 0:01:55.602 ******** 2025-10-13 19:34:09,247 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=crc) 2025-10-13 19:34:09,797 p=28354 u=zuul n=ansible | changed: [localhost -> controller(38.102.83.182)] => (item=controller) 2025-10-13 19:34:10,005 p=28354 u=zuul n=ansible | changed: [localhost] => (item=localhost) 2025-10-13 19:34:10,006 p=28354 u=zuul n=ansible | [WARNING]: Platform linux on host localhost is using the discovered Python interpreter at /usr/bin/python3.9, but future installation of another Python interpreter could change the meaning of that path. See https://docs.ansible.com/ansible- core/2.15/reference_appendices/interpreter_discovery.html for more information. 2025-10-13 19:34:10,013 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Set the hosts k8s ansible hosts cifmw_ci_local_storage_k8s_hosts={{ _host_map | selectattr("key", "in", k8s_nodes_hostnames) | map(attribute="value") | list }}, cifmw_ci_local_storage_k8s_hostnames={{ k8s_nodes_hostnames }}] *** 2025-10-13 19:34:10,014 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:10 +0000 (0:00:01.632) 0:01:57.235 ******** 2025-10-13 19:34:10,049 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:10,056 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Delete directories on worker node _raw_params=worker_node_dirs.yml] *** 2025-10-13 19:34:10,056 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:10 +0000 (0:00:00.042) 0:01:57.278 ******** 2025-10-13 19:34:10,082 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_local_storage/tasks/worker_node_dirs.yml for localhost => (item=crc) 2025-10-13 19:34:10,092 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Perform action in the PV directory path={{ [ cifmw_cls_local_storage_name, 'pv'+ ("%02d" | format(item | int)) ] | path_join }}, state={{ 'directory' if cifmw_cls_action == 'create' else 'absent' }}, mode=0775] *** 2025-10-13 19:34:10,092 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:10 +0000 (0:00:00.035) 0:01:57.314 ******** 2025-10-13 19:34:10,546 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=1) 2025-10-13 19:34:11,043 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=2) 2025-10-13 19:34:11,563 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=3) 2025-10-13 19:34:12,035 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=4) 2025-10-13 19:34:12,528 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=5) 2025-10-13 19:34:12,967 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=6) 2025-10-13 19:34:13,443 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=7) 2025-10-13 19:34:13,889 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=8) 2025-10-13 19:34:14,473 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=9) 2025-10-13 19:34:14,974 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=10) 2025-10-13 19:34:15,447 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=11) 2025-10-13 19:34:15,853 p=28354 u=zuul n=ansible | ok: [localhost -> crc(38.102.83.181)] => (item=12) 2025-10-13 19:34:15,876 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Remove the cifmw_cls_namespace namespace state=absent, kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Namespace, name={{ cifmw_cls_namespace }}, wait=True, wait_timeout=300] *** 2025-10-13 19:34:15,876 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:15 +0000 (0:00:05.784) 0:02:03.098 ******** 2025-10-13 19:34:26,636 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:26,649 p=28354 u=zuul n=ansible | TASK [Create storage name=ci_local_storage] ************************************ 2025-10-13 19:34:26,649 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:26 +0000 (0:00:10.773) 0:02:13.871 ******** 2025-10-13 19:34:26,704 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Create role needed directories path={{ cifmw_cls_manifests_dir }}, state=directory, mode=0755] *** 2025-10-13 19:34:26,704 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:26 +0000 (0:00:00.055) 0:02:13.926 ******** 2025-10-13 19:34:26,897 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:26,907 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Create the cifmw_cls_namespace namespace" kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit) }}, name={{ cifmw_cls_namespace }}, kind=Namespace, state=present] *** 2025-10-13 19:34:26,908 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:26 +0000 (0:00:00.203) 0:02:14.130 ******** 2025-10-13 19:34:27,636 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:27,643 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Save storage manifests as artifacts dest={{ cifmw_cls_manifests_dir }}/storage-class.yaml, content={{ cifmw_cls_storage_manifest | to_nice_yaml }}, mode=0644] *** 2025-10-13 19:34:27,643 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:27 +0000 (0:00:00.735) 0:02:14.865 ******** 2025-10-13 19:34:28,050 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:28,063 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Get k8s nodes kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit)}}, context={{ cifmw_openshift_context | default(omit)}}, kind=Node] *** 2025-10-13 19:34:28,063 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:28 +0000 (0:00:00.419) 0:02:15.285 ******** 2025-10-13 19:34:28,819 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:28,839 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Fetch hostnames for all hosts _raw_params=hostname] *** 2025-10-13 19:34:28,840 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:28 +0000 (0:00:00.776) 0:02:16.061 ******** 2025-10-13 19:34:29,277 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=crc) 2025-10-13 19:34:29,640 p=28354 u=zuul n=ansible | changed: [localhost -> controller(38.102.83.182)] => (item=controller) 2025-10-13 19:34:29,821 p=28354 u=zuul n=ansible | changed: [localhost] => (item=localhost) 2025-10-13 19:34:29,831 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Set the hosts k8s ansible hosts cifmw_ci_local_storage_k8s_hosts={{ _host_map | selectattr("key", "in", k8s_nodes_hostnames) | map(attribute="value") | list }}, cifmw_ci_local_storage_k8s_hostnames={{ k8s_nodes_hostnames }}] *** 2025-10-13 19:34:29,831 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:29 +0000 (0:00:00.991) 0:02:17.053 ******** 2025-10-13 19:34:29,863 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:29,873 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Apply the storage class manifests kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit) }}, context={{ cifmw_openshift_context | default(omit) }}, state=present, src={{ cifmw_cls_manifests_dir }}/storage-class.yaml] *** 2025-10-13 19:34:29,873 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:29 +0000 (0:00:00.041) 0:02:17.095 ******** 2025-10-13 19:34:30,560 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:30,567 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Create directories on worker node _raw_params=worker_node_dirs.yml] *** 2025-10-13 19:34:30,568 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:30 +0000 (0:00:00.694) 0:02:17.789 ******** 2025-10-13 19:34:30,591 p=28354 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/ci-framework/roles/ci_local_storage/tasks/worker_node_dirs.yml for localhost => (item=crc) 2025-10-13 19:34:30,602 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Perform action in the PV directory path={{ [ cifmw_cls_local_storage_name, 'pv'+ ("%02d" | format(item | int)) ] | path_join }}, state={{ 'directory' if cifmw_cls_action == 'create' else 'absent' }}, mode=0775] *** 2025-10-13 19:34:30,602 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:30 +0000 (0:00:00.034) 0:02:17.824 ******** 2025-10-13 19:34:31,083 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=1) 2025-10-13 19:34:31,633 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=2) 2025-10-13 19:34:32,107 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=3) 2025-10-13 19:34:32,569 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=4) 2025-10-13 19:34:33,063 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=5) 2025-10-13 19:34:33,546 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=6) 2025-10-13 19:34:33,981 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=7) 2025-10-13 19:34:34,472 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=8) 2025-10-13 19:34:34,940 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=9) 2025-10-13 19:34:35,416 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=10) 2025-10-13 19:34:35,887 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=11) 2025-10-13 19:34:36,362 p=28354 u=zuul n=ansible | changed: [localhost -> crc(38.102.83.181)] => (item=12) 2025-10-13 19:34:36,375 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Generate pv related storage manifest file src=storage.yaml.j2, dest={{ cifmw_cls_manifests_dir }}/storage.yaml, mode=0644] *** 2025-10-13 19:34:36,375 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:36 +0000 (0:00:05.772) 0:02:23.597 ******** 2025-10-13 19:34:36,787 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:36,798 p=28354 u=zuul n=ansible | TASK [ci_local_storage : Apply pv related storage manifest file kubeconfig={{ cifmw_openshift_kubeconfig }}, api_key={{ cifmw_openshift_token | default(omit) }}, context={{ cifmw_openshift_context | default(omit) }}, state=present, src={{ cifmw_cls_manifests_dir }}/storage.yaml] *** 2025-10-13 19:34:36,799 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:36 +0000 (0:00:00.423) 0:02:24.020 ******** 2025-10-13 19:34:37,635 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 19:34:37,667 p=28354 u=zuul n=ansible | TASK [Get resource status before openstack_kuttl run _raw_params={{ item }} >> {{ cifmw_artifacts_basedir }}/logs/cmd_before_{{ operator }}_kuttl.log ] *** 2025-10-13 19:34:37,667 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:37 +0000 (0:00:00.868) 0:02:24.889 ******** 2025-10-13 19:34:37,993 p=28354 u=zuul n=ansible | changed: [localhost] => (item=oc get pv) 2025-10-13 19:34:38,444 p=28354 u=zuul n=ansible | changed: [localhost] => (item=oc get all) 2025-10-13 19:34:38,452 p=28354 u=zuul n=ansible | TASK [Set make_openstack_kuttl_env vars make_{{ operator }}_kuttl_env={{ cifmw_kuttl_tests_env }}] *** 2025-10-13 19:34:38,452 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:38 +0000 (0:00:00.785) 0:02:25.674 ******** 2025-10-13 19:34:38,469 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 19:34:38,480 p=28354 u=zuul n=ansible | TASK [Run make_openstack_kuttl name=install_yamls_makes, tasks_from=make_{{ operator }}_kuttl.yml, apply={'ignore_errors': True}] *** 2025-10-13 19:34:38,480 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:38 +0000 (0:00:00.027) 0:02:25.702 ******** 2025-10-13 19:34:38,541 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Debug make_openstack_kuttl_env var=make_openstack_kuttl_env] *** 2025-10-13 19:34:38,541 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:38 +0000 (0:00:00.060) 0:02:25.763 ******** 2025-10-13 19:34:38,563 p=28354 u=zuul n=ansible | ok: [localhost] => make_openstack_kuttl_env: BMO_SETUP: false CHECKOUT_FROM_OPENSTACK_REF: 'true' KUBECONFIG: /home/zuul/.crc/machines/crc/kubeconfig NETWORK_MTU: 1500 NNCP_DNS_SERVER: 192.168.122.10 NNCP_INTERFACE: ens7 OPENSTACK_K8S_BRANCH: main OUT: /home/zuul/ci-framework-data/artifacts/manifests OUTPUT_DIR: /home/zuul/ci-framework-data/artifacts/edpm PATH: /home/zuul/.crc/bin:/home/zuul/.crc/bin/oc:/home/zuul/bin:/home/zuul/.local/bin:/home/zuul/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin PV_NUM: 20 2025-10-13 19:34:38,570 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Debug make_openstack_kuttl_params var=make_openstack_kuttl_params] *** 2025-10-13 19:34:38,570 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:38 +0000 (0:00:00.029) 0:02:25.792 ******** 2025-10-13 19:34:38,588 p=28354 u=zuul n=ansible | skipping: [localhost] 2025-10-13 19:34:38,595 p=28354 u=zuul n=ansible | TASK [install_yamls_makes : Run openstack_kuttl output_dir={{ cifmw_basedir|default(ansible_user_dir ~ '/ci-framework-data') }}/artifacts, chdir=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls, script=make openstack_kuttl, dry_run={{ make_openstack_kuttl_dryrun|default(false)|bool }}, extra_args={{ dict((make_openstack_kuttl_env|default({})), **(make_openstack_kuttl_params|default({}))) }}] *** 2025-10-13 19:34:38,595 p=28354 u=zuul n=ansible | Monday 13 October 2025 19:34:38 +0000 (0:00:00.025) 0:02:25.817 ******** 2025-10-13 19:34:38,637 p=28354 u=zuul n=ansible | Follow script's output here: /home/zuul/ci-framework-data/logs/ci_script_005_run_openstack.log 2025-10-13 20:41:19,911 p=28354 u=zuul n=ansible | [WARNING]: conditional statements should not include jinja2 templating delimiters such as {{ }} or {% %}. Found: {{ make_openstack_kuttl_until | default(true) }} 2025-10-13 20:41:19,980 p=28354 u=zuul n=ansible | An exception occurred during task execution. To see the full traceback, use -vvv. The error was: NoneType: None 2025-10-13 20:41:20,350 p=28354 u=zuul n=ansible | fatal: [localhost]: FAILED! => attempts: 1 changed: true msg: non-zero return code rc: 2 stderr: '' stderr_lines: [] stdout: "~/src/github.com/openstack-k8s-operators/install_yamls ~/ci-framework-data/artifacts\nerror: the server doesn't have a resource type \"openstackversion\"\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z openstack-kuttl-tests ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/namespace.yaml\nnamespace/openstack-kuttl-tests created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io openstack-kuttl-tests); do sleep 1; done\"\nNAME DISPLAY NAME \ STATUS\nopenstack-kuttl-tests Active\noc project openstack-kuttl-tests\nNow using project \"openstack-kuttl-tests\" on server \"https://api.crc.testing:6443\".\nbash scripts/gen-input-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z openstack-kuttl-tests ']'\n+ '[' -z osp-secret ']'\n+ '[' -z 12345678 ']'\n+ '[' -z 1234567842 ']'\n+ '[' -z 767c3ed056cbaa3b9dfedb8c6f825bf0 ']'\n+ '[' -z sEFmdFjDUqRM2VemYslV5yGNWjokioJXsg8Nrlc3drU= ']'\n+ '[' -z COX8bmlKAWn56XCGMrKQJj7dgHNAOl6f ']'\n+ '[' -z openstack ']'\n+ '[' -z libvirt-secret ']'\n+ DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input\n+ pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input\n~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input ~/src/github.com/openstack-k8s-operators/install_yamls\n+ cat\noc get secret/osp-secret || oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input | oc apply -f -\nError from server (NotFound): secrets \"osp-secret\" not found\nsecret/libvirt-secret created\nsecret/octavia-ca-passphrase created\nsecret/osp-secret created\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists manila;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/nova-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr\noc rsh openstack-galera-0 mysql -u root --password=12345678 -ss -e \"show databases like 'nova_%';\" | xargs -I '{}' oc rsh openstack-galera-0 mysql -u root --password=12345678 -ss -e \"flush tables; drop database if exists {};\"\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator-redis /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists octavia;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists designate;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists neutron;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists ironic;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists ironic_inspector;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists cinder;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists glance;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists placement;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift: no such file or directory\nNo resources found\nrm -Rf -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists barbican;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists keystone;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ceilometer-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr\noc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e \"flush tables; drop database if exists aodh;\" || true\nError from server (NotFound): pods \"openstack-galera-0\" not found\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr\nif oc get RabbitmqCluster; then oc delete --ignore-not-found=true RabbitmqCluster --all; fi\nerror: the server doesn't have a resource type \"RabbitmqCluster\"\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/rabbitmq-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/rabbitmq/cr\nbash scripts/validate-marketplace.sh\n+ '[' -z 500s ']'\n+ OPERATOR_NAMESPACE=openshift-marketplace\n++ oc get pods --no-headers -n openshift-marketplace\n++ grep -viE 'running|completed'\n+ not_running_pods=\n+ '[' -z '' ']'\n+ echo 'All openshift-marketplace pods seems to me fine'\nAll openshift-marketplace pods seems to me fine\n+ OPERATORS='openshift-cert-manager-operator kubernetes-nmstate-operator metallb-operator'\n+ for operator in $OPERATORS\n+ n=0\n+ retries=20\n+ true\n+ grep openshift-cert-manager-operator\n+ oc get packagemanifests -n openshift-marketplace\nopenshift-cert-manager-operator Red Hat Operators 232d\n+ '[' 0 -eq 0 ']'\n+ break\n+ for operator in $OPERATORS\n+ n=0\n+ retries=20\n+ true\n+ oc get packagemanifests -n openshift-marketplace\n+ grep kubernetes-nmstate-operator\nkubernetes-nmstate-operator Red Hat Operators 232d\n+ '[' 0 -eq 0 ']'\n+ break\n+ for operator in $OPERATORS\n+ n=0\n+ retries=20\n+ true\n+ grep metallb-operator\n+ oc get packagemanifests -n openshift-marketplace\nmetallb-operator Red Hat Operators 232d\n+ '[' 0 -eq 0 ']'\n+ break\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z openshift-nmstate ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/namespace.yaml\nnamespace/openshift-nmstate created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io openshift-nmstate); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\nopenshift-nmstate \ Active\nbash scripts/gen-olm-nmstate.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\n+ echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\nOPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\n+ echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\nDEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\n+ cat\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op\noperatorgroup.operators.coreos.com/openshift-nmstate-tn6k8 created\nsubscription.operators.coreos.com/kubernetes-nmstate-operator created\ntimeout 500s bash -c \"while ! (oc get deployments/nmstate-operator -n openshift-nmstate); do sleep 10; done\"\nError from server (NotFound): deployments.apps \"nmstate-operator\" not found\nError from server (NotFound): deployments.apps \"nmstate-operator\" not found\nNAME READY UP-TO-DATE AVAILABLE AGE\nnmstate-operator \ 1/1 1 1 7s\noc wait deployments/nmstate-operator -n openshift-nmstate --for condition=Available --timeout=500s\ndeployment.apps/nmstate-operator condition met\ntimeout 500s bash -c \"while ! (oc wait pod -n openshift-apiserver -l apiserver=true --for condition=Ready); do sleep 10; done\"\npod/apiserver-76f77b778f-h75w4 condition met\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr\nnmstate.nmstate.io/nmstate created\ntimeout 500s bash -c \"while ! (oc get pod --no-headers=true -l component=kubernetes-nmstate-handler -n openshift-nmstate| grep nmstate-handler); do sleep 10; done\"\nNo resources found in openshift-nmstate namespace.\nnmstate-handler-bdw24 0/1 Running 0 10s\noc wait pod -n openshift-nmstate -l component=kubernetes-nmstate-handler --for condition=Ready --timeout=500s\npod/nmstate-handler-bdw24 condition met\ntimeout 500s bash -c \"while ! (oc get deployments/nmstate-webhook -n openshift-nmstate); do sleep 10; done\"\nNAME \ READY UP-TO-DATE AVAILABLE AGE\nnmstate-webhook 0/1 1 \ 0 11s\noc wait deployments/nmstate-webhook -n openshift-nmstate --for condition=Available --timeout=500s\ndeployment.apps/nmstate-webhook condition met\nWORKERS='crc' \\\nbash scripts/gen-nncp.sh\n+ check_var_set DEPLOY_DIR\n+ [[ ! -v DEPLOY_DIR ]]\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr\n+ check_var_set WORKERS\n+ [[ ! -v WORKERS ]]\n+ check_var_set INTERFACE\n+ [[ ! -v INTERFACE ]]\n+ check_var_set BRIDGE_NAME\n+ [[ ! -v BRIDGE_NAME ]]\n+ check_var_set INTERFACE_MTU\n+ [[ ! -v INTERFACE_MTU ]]\n+ check_var_set VLAN_START\n+ [[ ! -v VLAN_START ]]\n+ check_var_set VLAN_STEP\n+ [[ ! -v VLAN_STEP ]]\n+ check_var_set VLAN_STEP\n+ [[ ! -v VLAN_STEP ]]\n+ check_var_set INTERNALAPI_PREFIX\n+ [[ ! -v INTERNALAPI_PREFIX ]]\n+ check_var_set STORAGE_PREFIX\n+ [[ ! -v STORAGE_PREFIX ]]\n+ check_var_set STORAGEMGMT_PREFIX\n+ [[ ! -v STORAGEMGMT_PREFIX ]]\n+ check_var_set TENANT_PREFIX\n+ [[ ! -v TENANT_PREFIX ]]\n+ check_var_set DESIGNATE_PREFIX\n+ [[ ! -v DESIGNATE_PREFIX ]]\n+ check_var_set DESIGNATE_EXT_PREFIX\n+ [[ ! -v DESIGNATE_EXT_PREFIX ]]\n+ '[' -n '' ']'\n+ echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr\nDEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr\n+ echo WORKERS crc\nWORKERS crc\n+ echo INTERFACE ens7\nINTERFACE ens7\n+ echo BRIDGE_NAME ospbr\nBRIDGE_NAME ospbr\n+ echo INTERFACE_BGP_1\nINTERFACE_BGP_1\n+ echo INTERFACE_BGP_2\nINTERFACE_BGP_2\n+ echo INTERFACE_MTU 1500\nINTERFACE_MTU 1500\n+ echo VLAN_START 20\nVLAN_START 20\n+ echo VLAN_STEP 1\nVLAN_STEP 1\n+ echo STORAGE_MACVLAN\nSTORAGE_MACVLAN\n+ '[' -n true ']'\n+ echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122\nCTLPLANE_IP_ADDRESS_PREFIX 192.168.122\n+ echo CTLPLANE_IP_ADDRESS_SUFFIX 10\nCTLPLANE_IP_ADDRESS_SUFFIX 10\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ IP_ADDRESS_SUFFIX=5\n+ IPV6_ADDRESS_SUFFIX=5\n+ rm --force '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/*_nncp.yaml'\n+ internalapi_vlan_id=20\n+ storage_vlan_id=21\n+ tenant_vlan_id=22\n+ storagemgmt_vlan_id=23\n+ octavia_vlan_id=24\n+ designate_vlan_id=25\n+ designate_ext_vlan_id=26\n+ for WORKER in ${WORKERS}\n+ cat\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n '' ']'\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ IP_ADDRESS_SUFFIX=6\n+ IPV6_ADDRESS_SUFFIX=6\n+ CTLPLANE_IP_ADDRESS_SUFFIX=11\n+ CTLPLANE_IPV6_ADDRESS_SUFFIX=1\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/\nnodenetworkconfigurationpolicy.nmstate.io/ens7-crc created\ntimeout 240s bash -c \"while ! (oc wait nncp -l osp/interface=ens7 --for jsonpath='{.status.conditions[0].reason}'=SuccessfullyConfigured); do sleep 10; done\"\nnodenetworkconfigurationpolicy.nmstate.io/ens7-crc condition met\nif test -n \"192.168.122.10\"; then oc patch dns.operator/default --type merge -p '{\"spec\":{\"upstreamResolvers\":{\"policy\":\"Sequential\",\"upstreams\":[{\"type\":\"Network\",\"address\":\"'192.168.122.10'\",\"port\":53},{\"type\":\"SystemResolvConf\"}]}}}'; fi\ndns.operator.openshift.io/default patched\ntimeout 240s bash -c \"while ! (oc wait dns.operator/default --for condition=available); do sleep 10; done\"\ndns.operator.openshift.io/default condition met\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z metallb-system ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/metallb-system\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/namespace.yaml\nnamespace/metallb-system created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io metallb-system); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\nmetallb-system \ Active\nbash scripts/gen-olm-metallb.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\n+ echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\nOPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\n+ echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\nDEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\n+ echo INTERFACE\nINTERFACE\n+ cat\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op\noperatorgroup.operators.coreos.com/metallb-operator created\nsubscription.operators.coreos.com/metallb-operator-sub created\ntimeout 500s bash -c \"while ! (oc get pod --no-headers=true -l control-plane=controller-manager -n metallb-system| grep metallb-operator-controller); do sleep 10; done\"\nNo resources found in metallb-system namespace.\nNo resources found in metallb-system namespace.\nmetallb-operator-controller-manager-b7789ff7f-4dz47 \ 0/1 ContainerCreating 0 3s\noc wait pod -n metallb-system --for condition=Ready -l control-plane=controller-manager --timeout=500s\npod/metallb-operator-controller-manager-b7789ff7f-4dz47 condition met\ntimeout 500s bash -c \"while ! (oc get pod --no-headers=true -l component=webhook-server -n metallb-system| grep metallb-operator-webhook); do sleep 10; done\"\nmetallb-operator-webhook-server-86869d57c5-28vf7 \ 1/1 Running 0 41s\noc wait pod -n metallb-system --for condition=Ready -l component=webhook-server --timeout=500s\npod/metallb-operator-webhook-server-86869d57c5-28vf7 condition met\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/deploy_operator.yaml\nmetallb.metallb.io/metallb created\ntimeout 500s bash -c \"while ! (oc get pod --no-headers=true -l component=speaker -n metallb-system | grep speaker); do sleep 10; done\"\nNo resources found in metallb-system namespace.\nspeaker-lqgwl 1/2 Running 0 10s\noc wait pod -n metallb-system -l component=speaker --for condition=Ready --timeout=500s\npod/speaker-lqgwl condition met\nmake operator_namespace\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nerror: the server doesn't have a resource type \"openstackversion\"\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z cert-manager-operator ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/namespace.yaml\nnamespace/cert-manager-operator created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io cert-manager-operator); do sleep 1; done\"\nNAME DISPLAY NAME \ STATUS\ncert-manager-operator Active\noc project cert-manager-operator\nNow using project \"cert-manager-operator\" on server \"https://api.crc.testing:6443\".\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-olm-cert-manager.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op ']'\n+ '[' -z cert-manager-operator ']'\n+ '[' -z stable-v1 ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\n+ echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\nOPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\n+ echo OPERATOR_NAMESPACE cert-manager-operator\nOPERATOR_NAMESPACE cert-manager-operator\n+ echo CHANNEL stable-v1\nCHANNEL stable-v1\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op\noperatorgroup.operators.coreos.com/cert-manager-operator-bccwx created\nsubscription.operators.coreos.com/openshift-cert-manager-operator created\nwhile ! (oc get pod --no-headers=true -l name=cert-manager-operator -n cert-manager-operator| grep \"cert-manager-operator\"); do sleep 10; done\nNo resources found in cert-manager-operator namespace.\nNo resources found in cert-manager-operator namespace.\ncert-manager-operator-controller-manager-57cd46d6d-t9wrm \ 0/1 ContainerCreating 0 6s\noc wait pod -n cert-manager-operator --for condition=Ready -l name=cert-manager-operator --timeout=300s\npod/cert-manager-operator-controller-manager-57cd46d6d-t9wrm condition met\nwhile ! (oc get pod --no-headers=true -l app=cainjector -n cert-manager | grep \"cert-manager-cainjector\"); do sleep 10; done\nNo resources found in cert-manager namespace.\ncert-manager-cainjector-7d9f95dbf-866gz 1/1 Running 0 4s\noc wait pod -n cert-manager -l app=cainjector --for condition=Ready --timeout=300s\npod/cert-manager-cainjector-7d9f95dbf-866gz condition met\nwhile ! (oc get pod --no-headers=true -l app=webhook -n cert-manager | grep \"cert-manager-webhook\"); do sleep 10; done\ncert-manager-webhook-d969966f-qjpx9 \ 0/1 Running 0 8s\noc wait pod -n cert-manager -l app=webhook --for condition=Ready --timeout=300s\npod/cert-manager-webhook-d969966f-qjpx9 condition met\nwhile ! (oc get pod --no-headers=true -l app=cert-manager -n cert-manager | grep \"cert-manager\"); do sleep 10; done\nNo resources found in cert-manager namespace.\ncert-manager-7d4cc89fcb-452pc \ 1/1 Running 0 2s\noc wait pod -n cert-manager -l app=cert-manager --for condition=Ready --timeout=300s\npod/cert-manager-7d4cc89fcb-452pc condition met\nbash scripts/gen-netatt.sh\n+ check_var_set DEPLOY_DIR\n+ [[ ! -v DEPLOY_DIR ]]\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr\n+ check_var_set INTERFACE\n+ [[ ! -v INTERFACE ]]\n+ check_var_set BRIDGE_NAME\n+ [[ ! -v BRIDGE_NAME ]]\n+ check_var_set VLAN_START\n+ [[ ! -v VLAN_START ]]\n+ check_var_set VLAN_STEP\n+ [[ ! -v VLAN_STEP ]]\n+ '[' -z true ']'\n+ '[' -n true ']'\n+ '[' -n '' ']'\n+ '[' -n true ']'\n+ check_var_set INTERNALAPI_PREFIX\n+ [[ ! -v INTERNALAPI_PREFIX ]]\n+ check_var_set STORAGE_PREFIX\n+ [[ ! -v STORAGE_PREFIX ]]\n+ check_var_set STORAGEMGMT_PREFIX\n+ [[ ! -v STORAGEMGMT_PREFIX ]]\n+ check_var_set TENANT_PREFIX\n+ [[ ! -v TENANT_PREFIX ]]\n+ check_var_set DESIGNATE_PREFIX\n+ [[ ! -v DESIGNATE_PREFIX ]]\n+ check_var_set DESIGNATE_EXT_PREFIX\n+ [[ ! -v DESIGNATE_EXT_PREFIX ]]\n+ echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr\nDEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr\n+ echo INTERFACE ens7\nINTERFACE ens7\n+ echo VLAN_START 20\nVLAN_START 20\n+ echo VLAN_STEP 1\nVLAN_STEP 1\n+ '[' -n true ']'\n+ echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122\nCTLPLANE_IP_ADDRESS_PREFIX 192.168.122\n+ echo CTLPLANE_IP_ADDRESS_SUFFIX 10\nCTLPLANE_IP_ADDRESS_SUFFIX 10\n+ echo 'INTERNALAPI_PREFIX 172.17.0'\nINTERNALAPI_PREFIX 172.17.0\n+ echo 'STORAGE_PREFIX 172.18.0'\nSTORAGE_PREFIX 172.18.0\n+ echo 'STORAGEMGMT_PREFIX 172.20.0'\nSTORAGEMGMT_PREFIX 172.20.0\n+ echo 'TENANT_PREFIX 172.19.0'\nTENANT_PREFIX 172.19.0\n+ echo 'DESIGNATE_PREFIX 172.28.0'\nDESIGNATE_PREFIX 172.28.0\n+ echo 'DESIGNATE_PREFIX 172.50.0'\nDESIGNATE_PREFIX 172.50.0\n+ '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ '[' -n true ']'\n+ cat\n+ cat\n+ cat\n+ cat\n+ '[' -n '' ']'\n+ '[' -n '' ']'\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/\nnetworkattachmentdefinition.k8s.cni.cncf.io/ctlplane created\nnetworkattachmentdefinition.k8s.cni.cncf.io/datacentre created\nnetworkattachmentdefinition.k8s.cni.cncf.io/designate created\nnetworkattachmentdefinition.k8s.cni.cncf.io/designateext created\nnetworkattachmentdefinition.k8s.cni.cncf.io/internalapi created\nnetworkattachmentdefinition.k8s.cni.cncf.io/octavia created\nnetworkattachmentdefinition.k8s.cni.cncf.io/storage created\nnetworkattachmentdefinition.k8s.cni.cncf.io/storagemgmt created\nnetworkattachmentdefinition.k8s.cni.cncf.io/tenant created\noc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml\nerror: the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml\" does not exist\nmake: [Makefile:2546: metallb_config_cleanup] Error 1 (ignored)\noc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml\nerror: the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml\" does not exist\nmake: [Makefile:2547: metallb_config_cleanup] Error 1 (ignored)\noc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml\nerror: the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml\" does not exist\nmake: [Makefile:2548: metallb_config_cleanup] Error 1 (ignored)\noc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml\nerror: the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml\" does not exist\nmake: [Makefile:2549: metallb_config_cleanup] Error 1 (ignored)\noc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml\nerror: the path \"/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml\" does not exist\nmake: [Makefile:2550: metallb_config_cleanup] Error 1 (ignored)\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml\nbash scripts/gen-metallb-config.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']'\n+ '[' -z ens7 ']'\n+ '[' -z ospbr ']'\n+ '[' -z 64999 ']'\n+ '[' -z 64999 ']'\n+ '[' -z 100.65.4.1 ']'\n+ '[' -z 100.64.4.1 ']'\n+ '[' -z 172.30.4.2 ']'\n+ '[' -z true ']'\n+ echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\nDEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr\n+ echo INTERFACE ens7\nINTERFACE ens7\n+ echo CTLPLANE_METALLB_POOL 192.168.122.80-192.168.122.90\nCTLPLANE_METALLB_POOL 192.168.122.80-192.168.122.90\n+ echo CTLPLANE_METALLB_IPV6_POOL fd00:aaaa::80-fd00:aaaa::90\nCTLPLANE_METALLB_IPV6_POOL fd00:aaaa::80-fd00:aaaa::90\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ '[' -n true ']'\n+ cat\n+ '[' -n '' ']'\n+ cat\n+ cat\n+ cat\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml\nipaddresspool.metallb.io/ctlplane created\nipaddresspool.metallb.io/internalapi created\nipaddresspool.metallb.io/storage created\nipaddresspool.metallb.io/tenant created\nipaddresspool.metallb.io/designateext created\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml\nl2advertisement.metallb.io/ctlplane created\nl2advertisement.metallb.io/internalapi created\nl2advertisement.metallb.io/storage created\nl2advertisement.metallb.io/tenant created\nl2advertisement.metallb.io/designateext created\nbash scripts/gen-olm.sh\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' -z quay.io/openstack-k8s-operators/openstack-operator-index:latest ']'\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\n+ OPERATOR_CHANNEL=alpha\n+ OPERATOR_SOURCE=openstack-operator-index\n+ OPERATOR_SOURCE_NAMESPACE=openstack-operators\n+ echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\nOPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\n+ echo OPERATOR_CHANNEL alpha\nOPERATOR_CHANNEL alpha\n+ echo OPERATOR_SOURCE openstack-operator-index\nOPERATOR_SOURCE openstack-operator-index\n+ echo OPERATOR_SOURCE_NAMESPACE openstack-operators\nOPERATOR_SOURCE_NAMESPACE openstack-operators\n+ cat\n+ cat\n+ cat\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z openstack-operators ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-operators\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/namespace.yaml\nWarning: resource namespaces/openstack-operators is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\nnamespace/openstack-operators configured\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io openstack-operators); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\nopenstack-operators \ Active\noc project openstack-operators\nNow using project \"openstack-operators\" on server \"https://api.crc.testing:6443\".\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op\ncatalogsource.operators.coreos.com/openstack-operator-index created\noperatorgroup.operators.coreos.com/openstack created\nsubscription.operators.coreos.com/openstack-operator created\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr | oc delete --ignore-not-found=true -f -\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr\noc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr | oc delete --ignore-not-found=true -f - || true\nerror: must build at directory: not a valid directory: evalsymlink failure on '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack: no such file or directory\nNo resources found\nrm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\nmkdir -p /home/zuul/ci-framework-data/artifacts/manifests/operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\nbash -c \"test -d /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator || CHECKOUT_FROM_OPENSTACK_REF=false scripts/clone-operator-repo.sh\"\nCloning repo: git clone -b main https://github.com/openstack-k8s-operators/openstack-operator.git openstack-operator\nCloning into 'openstack-operator'...\ncp /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\nbash scripts/gen-service-kustomize.sh\n+++ dirname scripts/gen-service-kustomize.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/common.sh --source-only\n++ set -e\n+ '[' -z openstack-kuttl-tests ']'\n+ '[' -z OpenStackControlPlane ']'\n+ '[' -z osp-secret ']'\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr ']'\n+ '[' -n '' ']'\n+ REPLACEMENTS=\n+ IMAGE=unused\n+ IMAGE_PATH=containerImage\n+ STORAGE_REQUEST=10G\n+ INTERFACE_MTU=1500\n+ VLAN_START=20\n+ VLAN_STEP=1\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr ']'\n+ pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr\n~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr ~/src/github.com/openstack-k8s-operators/install_yamls\n+ cat\n+ [[ OpenStackControlPlane == \\O\\p\\e\\n\\S\\t\\a\\c\\k\\C\\o\\n\\t\\r\\o\\l\\P\\l\\a\\n\\e ]]\n+ [[ '' != '' ]]\n+ IFS=,\n+ read -ra IMAGES\n+ IFS=,\n+ read -ra IMAGE_PATHS\n+ '[' 1 '!=' 1 ']'\n+ (( i=0 ))\n+ (( i < 1 ))\n+ SPEC_PATH=containerImage\n+ SPEC_VALUE=unused\n+ '[' unused '!=' unused ']'\n+ (( i++ ))\n+ (( i < 1 ))\n+ '[' -n '' ']'\n+ '[' OpenStackControlPlane == OpenStackControlPlane ']'\n+ cat\n+ '[' OpenStackControlPlane == Galera ']'\n+ '[' OpenStackControlPlane == NetConfig ']'\n+ '[' -n '' ']'\n+ [[ OpenStackControlPlane == \\O\\p\\e\\n\\S\\t\\a\\c\\k\\C\\o\\n\\t\\r\\o\\l\\P\\l\\a\\n\\e ]]\n+ [[ true == \\t\\r\\u\\e ]]\n+ cat\n+ [[ OpenStackControlPlane == \\O\\p\\e\\n\\S\\t\\a\\c\\k\\C\\o\\n\\t\\r\\o\\l\\P\\l\\a\\n\\e ]]\n+ '[' -z true ']'\n+ '[' -n '' ']'\n+ '[' -z true ']'\n+ '[' -n true ']'\n+ '[' -n '' ']'\n+ '[' -n '' ']'\n+ kustomization_add_resources\n+ echo merge config dir\nmerge config dir\n++ find . -type f -name '*.yaml'\n++ grep -v kustomization\n+ yamls=./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml\n+ for y in ${yamls[@]}\n+ kustomize edit add resource ./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n# Wait until OLM installs openstack CRDs\ntimeout 500s bash -c \"while ! (oc get crd openstacks.operator.openstack.org); do sleep 1; done\"\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nError from server (NotFound): customresourcedefinitions.apiextensions.k8s.io \"openstacks.operator.openstack.org\" not found\nNAME CREATED AT\nopenstacks.operator.openstack.org 2025-10-13T19:38:15Z\nmake openstack_init\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nerror: the server doesn't have a resource type \"openstackversion\"\n# call make_openstack if it isn't already\nbash -c '(oc get subscription -n openstack-operators openstack-operator || make openstack) || true'\nNAME PACKAGE SOURCE CHANNEL\nopenstack-operator \ openstack-operator openstack-operator-index alpha\ntimeout 500s bash -c 'until $(oc get csv -l operators.coreos.com/openstack-operator.openstack-operators -n openstack-operators | grep -q Succeeded); do sleep 1; done'\nNo resources found in openstack-operators namespace.\nbash -c 'test -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml || make openstack_repo'\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml\nopenstack.operator.openstack.org/openstack created\n# FIXME: Ugly hack to prevent OpenStack Baremetal operator from crashing when BMO is not installed\nif ! echo \"\" | grep -q \"baremetalhosts.metal3.io\"; then \\\n\tcurl -o /tmp/bmh_crd.yaml --retry-all-errors --retry 5 --retry-delay 10 https://raw.githubusercontent.com/metal3-io/baremetal-operator/refs/heads/main/config/base/crds/bases/metal3.io_baremetalhosts.yaml; \\\n\toc apply -f /tmp/bmh_crd.yaml; \\\n\trm -f /tmp/bmh_crd.yaml; \\\nfi\n % Total % Received % Xferd Average Speed Time Time Time Current\n Dload \ Upload Total Spent Left Speed\n\r 0 0 0 0 0 0 0 \ 0 --:--:-- --:--:-- --:--:-- 0\r100 61353 100 61353 0 0 624k \ 0 --:--:-- --:--:-- --:--:-- 624k\ncustomresourcedefinition.apiextensions.k8s.io/baremetalhosts.metal3.io created\noc wait openstack/openstack -n openstack-operators --for condition=Ready --timeout=500s\nopenstack.operator.openstack.org/openstack condition met\ntimeout 500s bash -c \"while ! (oc get services -n openstack-operators | grep -E '^(openstack|openstack-baremetal|infra)-operator-webhook-service' | wc -l | grep -q -e 3); do sleep 5; done\"\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake wait\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/operator-wait.sh\n+ TIMEOUT=500s\n+++ dirname scripts/operator-wait.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq ']'\n+ pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls\n+ timeout 500s bash -c 'until [ \"$(bash ./get-operator-status.sh)\" == \"Succeeded\" ]; do sleep 5; done'\n+ '[' -z openstack-operators ']'\n+ '[' -z openstack ']'\n+ '[' openstack = rabbitmq-cluster ']'\n+ DEPL_NAME=openstack-operator-controller-manager\n++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json\n++ jq -e .status.availableReplicas\n+ REPLICAS=1\n+ '[' 1 '!=' 1 ']'\n+ echo Succeeded\n+ exit 0\n+ rc=0\n+ popd\n~/src/github.com/openstack-k8s-operators/install_yamls\n+ exit 0\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake openstack_kuttl_run\nmake[1]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nset -e; \\\nfor test_dir in ctlplane-basic-deployment ctlplane-basic-deployment-with-nicMappings ctlplane-collapsed ctlplane-galera-3replicas ctlplane-galera-basic ctlplane-nodeselectors ctlplane-tls-cert-rotation ctlplane-tls-custom-issuers ctlplane-tls-custom-route dataplane-create-test dataplane-deploy-global-service-test dataplane-deploy-multiple-secrets dataplane-deploy-no-nodes-test dataplane-deploy-tls-test dataplane-extramounts dataplane-multinode-nodeset-create-test dataplane-service-config dataplane-service-custom-image dataplane-service-failure; do \\\n oc delete osctlplane --all --namespace openstack-kuttl-tests; \\\n\tmake crc_storage_cleanup_with_retries; \\\n\tmake crc_storage_with_retries; \\\n\tkubectl-kuttl test --config /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/kuttl-test.yaml /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests --test ${test_dir}; \\\ndone\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage created\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nNow using project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ grep Bound\nNo resources found\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $1}'\nNo resources found\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner \ Delete WaitForFirstConsumer true 5m7s\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage created\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage created\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role created\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding created\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/crc\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage created\nWarning: resource persistentvolumes/local-storage01-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage01-crc configured\nWarning: resource persistentvolumes/local-storage02-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage02-crc configured\nWarning: resource persistentvolumes/local-storage03-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage03-crc configured\nWarning: resource persistentvolumes/local-storage04-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage04-crc configured\nWarning: resource persistentvolumes/local-storage05-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage05-crc configured\nWarning: resource persistentvolumes/local-storage06-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage06-crc configured\nWarning: resource persistentvolumes/local-storage07-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage07-crc configured\nWarning: resource persistentvolumes/local-storage08-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage08-crc configured\nWarning: resource persistentvolumes/local-storage09-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage09-crc configured\nWarning: resource persistentvolumes/local-storage10-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage10-crc configured\nWarning: resource persistentvolumes/local-storage11-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage11-crc configured\nWarning: resource persistentvolumes/local-storage12-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.\npersistentvolume/local-storage12-crc configured\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc created\npersistentvolumeclaim/ansible-ee-logs created\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 19:39:52 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running tests using configured kubeconfig.\n harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443\n logger.go:42: 19:39:52 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n \ logger.go:42: 19:39:52 | | netconfig.network.openstack.org/netconfig created\n \ logger.go:42: 19:39:52 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n \ logger.go:42: 19:39:52 | | dnsmasq.network.openstack.org/dnsmasq created\n \ logger.go:42: 19:39:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply -f -\n ]\n logger.go:42: 19:39:53 | | Generating public/private rsa key pair.\n logger.go:42: 19:39:53 | | Your identification has been saved in ansibleee-ssh-key-id_rsa\n \ logger.go:42: 19:39:53 | | Your public key has been saved in ansibleee-ssh-key-id_rsa.pub\n \ logger.go:42: 19:39:53 | | The key fingerprint is:\n logger.go:42: 19:39:53 | | SHA256:VCJuwoD6YMCqjIbrmfxGP1cc3DBS1brr9CZYa6fIhnQ zuul@controller\n logger.go:42: 19:39:53 | | The key's randomart image is:\n logger.go:42: 19:39:53 | | +---[RSA 4096]----+\n logger.go:42: 19:39:53 | | |... . o.o.. |\n logger.go:42: 19:39:53 | | |o. o . o = . |\n logger.go:42: 19:39:53 | | |+ o o + + . |\n logger.go:42: 19:39:53 | | |+. o . o o |\n logger.go:42: 19:39:53 | | |*o S . . |\n logger.go:42: 19:39:53 | | |+o.. . E o |\n \ logger.go:42: 19:39:53 | | |... . . + o.o |\n logger.go:42: 19:39:53 | | |o o. o o.oo=.o |\n logger.go:42: 19:39:53 | | |.=o. o .ooo=. |\n \ logger.go:42: 19:39:53 | | +----[SHA256]-----+\n logger.go:42: 19:39:53 | | secret/dataplane-ansible-ssh-private-key-secret created\n harness.go:363: running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-basic-deployment\n=== PAUSE kuttl/harness/ctlplane-basic-deployment\n=== RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== CONT kuttl/harness/ctlplane-basic-deployment\n \ logger.go:42: 19:39:53 | ctlplane-basic-deployment | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack | starting test step 1-deploy-openstack\n logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 19:44:54 | ctlplane-basic-deployment/1-deploy-openstack | test step completed 1-deploy-openstack\n \ logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | starting test step 2-deploy-custom-cacert-secret\n logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | running command: [sh -c oc apply -n $NAMESPACE -f ../../common/custom-ca.yaml\n ]\n logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | secret/ca-custom-kuttl created\n logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | test step completed 2-deploy-custom-cacert-secret\n logger.go:42: 19:44:54 | ctlplane-basic-deployment/3-deploy-custom-cacert | starting test step 3-deploy-custom-cacert\n \ logger.go:42: 19:44:54 | ctlplane-basic-deployment/3-deploy-custom-cacert | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_ca | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert | openstackcontrolplane.core.openstack.org/openstack configured\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert | test step completed 3-deploy-custom-cacert\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | starting test step 4-\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | running command: [sh -c echo \"Checking ca-custom-kuttl.pem is present in combined-ca-bundle...\"\n \ CUSTOM_CERT_CONTENT=$(oc get secret ca-custom-kuttl -n $NAMESPACE -o jsonpath=\"{.data['ca-custom-kuttl\\.pem']}\" | base64 --decode | tr -d '\\n')\n TLS_BUNDLE_CONTENT=$(oc get secret combined-ca-bundle -n $NAMESPACE -o jsonpath=\"{.data['tls-ca-bundle\\.pem']}\" | base64 --decode | tr -d '\\n')\n if [[ \"$TLS_BUNDLE_CONTENT\" == *\"$CUSTOM_CERT_CONTENT\"* ]]; then\n echo \"OK\"\n exit 0\n else\n echo \"Not present\"\n exit 1\n fi\n ]\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | Checking ca-custom-kuttl.pem is present in combined-ca-bundle...\n \ logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | OK\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | test step completed 4-\n logger.go:42: 19:44:59 | ctlplane-basic-deployment/5-cleanup | starting test step 5-cleanup\n \ logger.go:42: 19:45:01 | ctlplane-basic-deployment/5-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n srv-swift-storage-0\n \ oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n \ oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-cinder-internal-svc\" deleted\n \ logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-galera-openstack-svc\" deleted\n \ logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-glance-default-public-route\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-keystone-internal-svc\" deleted\n \ logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-memcached-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-nova-public-route\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-placement-public-route\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-swift-public-route\" deleted\n logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret \"rootca-internal\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret \"rootca-libvirt\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret \"rootca-ovn\" deleted\n logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret \"rootca-public\" deleted\n logger.go:42: 19:45:42 | ctlplane-basic-deployment/5-cleanup | test step completed 5-cleanup\n logger.go:42: 19:45:42 | ctlplane-basic-deployment | skipping kubernetes event logging\n=== CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n \ logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | starting test step 1-create-nic-mappings\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml\n \ ]\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | networkattachmentdefinition.k8s.cni.cncf.io/datacentre configured\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | test step completed 1-create-nic-mappings\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | starting test step 2-deploy-openstack\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | test step completed 2-deploy-openstack\n logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | starting test step 3-add-ovn-nic-mappings\n logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack --type='json' -p='[{\n \"op\": \"replace\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n \ \"value\":{\"datacentre\":\"ospbr\"}\n }]'\n ]\n logger.go:42: 19:50:08 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | test step completed 3-add-ovn-nic-mappings\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | starting test step 4-remove-ovn-nic-mappings\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack --type='json' -p='[{\n \"op\": \"remove\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n \ }]'\n ]\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched\n logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:16 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:17 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:18 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:20 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:21 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:22 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:24 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:25 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:27 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:28 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:29 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:31 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:32 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:33 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:35 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:36 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:37 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:39 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:40 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:41 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:43 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:44 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:45 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:47 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | test step completed 4-remove-ovn-nic-mappings\n logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | starting test step 5-cleanup\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n \ srv-swift-storage-0\n oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-internal-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-galera-openstack-svc\" deleted\n logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-memcached-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovncontroller-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-placement-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-swift-public-route\" deleted\n logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-internal\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-libvirt\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-ovn\" deleted\n logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-public\" deleted\n logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | test step completed 5-cleanup\n logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- PASS: kuttl (689.89s)\n --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-basic-deployment (348.38s)\n --- PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings (340.23s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ cut -d / -f 2\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-cell1-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ cut -d / -f 1\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n++ awk '{print $1}'\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner \ Delete WaitForFirstConsumer true 11m\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ tr '\\n' ' '\n++ sed -e 's|node/||'\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 19:51:44 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running tests using configured kubeconfig.\n harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443\n logger.go:42: 19:51:44 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n \ logger.go:42: 19:51:44 | | netconfig.network.openstack.org/netconfig configured\n \ logger.go:42: 19:51:44 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n \ logger.go:42: 19:51:45 | | dnsmasq.network.openstack.org/dnsmasq configured\n \ logger.go:42: 19:51:45 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply -f -\n ]\n logger.go:42: 19:51:45 | | secret/dataplane-ansible-ssh-private-key-secret configured\n harness.go:363: running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n=== CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings\n \ logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | starting test step 1-create-nic-mappings\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml\n \ ]\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | networkattachmentdefinition.k8s.cni.cncf.io/datacentre unchanged\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | test step completed 1-create-nic-mappings\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | starting test step 2-deploy-openstack\n logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | test step completed 2-deploy-openstack\n logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | starting test step 3-add-ovn-nic-mappings\n logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack --type='json' -p='[{\n \"op\": \"replace\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n \ \"value\":{\"datacentre\":\"ospbr\"}\n }]'\n ]\n logger.go:42: 19:55:58 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | test step completed 3-add-ovn-nic-mappings\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | starting test step 4-remove-ovn-nic-mappings\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack --type='json' -p='[{\n \"op\": \"remove\",\n \"path\": \"/spec/ovn/template/ovnController/nicMappings\",\n \ }]'\n ]\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched\n logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:56:04 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:56:06 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)\n \ ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)\n if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then\n exit 0\n fi\n \ exit 1\n ]\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | Unable to connect to the server: dial tcp: lookup api.crc.testing on 199.204.44.24:53: no such host\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | test step completed 4-remove-ovn-nic-mappings\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | starting test step 5-cleanup\n logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n \ srv-swift-storage-0\n oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-galera-openstack-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-memcached-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovncontroller-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-placement-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-swift-public-route\" deleted\n logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-internal\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-libvirt\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-ovn\" deleted\n logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret \"rootca-public\" deleted\n logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | test step completed 5-cleanup\n logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- PASS: kuttl (301.64s)\n --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings (300.23s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-cell1-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" deleted\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner \ Delete WaitForFirstConsumer true 5m11s\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 19:57:08 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running tests using configured kubeconfig.\n harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443\n logger.go:42: 19:57:08 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n \ logger.go:42: 19:57:08 | | netconfig.network.openstack.org/netconfig configured\n \ logger.go:42: 19:57:08 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n \ logger.go:42: 19:57:09 | | dnsmasq.network.openstack.org/dnsmasq configured\n \ logger.go:42: 19:57:09 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply -f -\n ]\n logger.go:42: 19:57:09 | | secret/dataplane-ansible-ssh-private-key-secret configured\n harness.go:363: running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-collapsed\n=== PAUSE kuttl/harness/ctlplane-collapsed\n=== CONT kuttl/harness/ctlplane-collapsed\n \ logger.go:42: 19:57:09 | ctlplane-collapsed | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | starting test step 0-deps\n logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | running command: [sh -c oc apply -f ../../common/rhobs.yaml\n until oc api-resources | grep -q rhobs; do sleep 1; done\n ]\n logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | subscription.operators.coreos.com/cluster-observability-operator created\n logger.go:42: 19:57:25 | ctlplane-collapsed/0-deps | test step completed 0-deps\n logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | starting test step 1-deploy-openstack-collapsed-cell\n logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_collapsed_cell.yaml\n \ ]\n logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | openstackcontrolplane.core.openstack.org/openstack-collapsed-cell created\n logger.go:42: 20:01:51 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | test step completed 1-deploy-openstack-collapsed-cell\n logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | starting test step 2-cleanup\n logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | running command: [sh -c oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-cinder-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-galera-openstack-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-glance-default-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-keystone-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-memcached-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-metric-storage-prometheus-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-placement-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-swift-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-watcher-internal-svc\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-watcher-public-route\" deleted\n logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret \"cert-watcher-public-svc\" deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-internal\" deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-libvirt\" deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-ovn\" deleted\n logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret \"rootca-public\" deleted\n logger.go:42: 20:02:25 | ctlplane-collapsed/2-cleanup | test step completed 2-cleanup\n logger.go:42: 20:02:25 | ctlplane-collapsed | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- PASS: kuttl (317.74s)\n \ --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-collapsed (316.26s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME \ PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION \ AGE\nlocal-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer \ true 5m26s\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ oc apply -f -\n++ cat\nserviceaccount/crc-storage unchanged\n++ oc apply -f -\n++ cat\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 20:02:47 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running tests using configured kubeconfig.\n harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443\n logger.go:42: 20:02:47 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n \ logger.go:42: 20:02:51 | | netconfig.network.openstack.org/netconfig configured\n \ logger.go:42: 20:02:51 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n \ logger.go:42: 20:02:52 | | dnsmasq.network.openstack.org/dnsmasq configured\n \ logger.go:42: 20:02:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply -f -\n ]\n logger.go:42: 20:02:52 | | secret/dataplane-ansible-ssh-private-key-secret configured\n harness.go:363: running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-galera-3replicas\n=== PAUSE kuttl/harness/ctlplane-galera-3replicas\n=== CONT kuttl/harness/ctlplane-galera-3replicas\n \ logger.go:42: 20:02:52 | ctlplane-galera-3replicas | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | starting test step 1-deploy-galera-3replicas\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera_3replicas.yaml\n \ ]\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | openstackcontrolplane.core.openstack.org/openstack-galera-3replicas created\n \ logger.go:42: 20:07:10 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | test step completed 1-deploy-galera-3replicas\n logger.go:42: 20:07:10 | ctlplane-galera-3replicas/2-cleanup | starting test step 2-cleanup\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n \ mysql-db-openstack-galera-0 \\\n mysql-db-openstack-galera-1 \\\n \ mysql-db-openstack-galera-2 \\\n mysql-db-openstack-cell1-galera-0 \\\n mysql-db-openstack-cell1-galera-1 \\\n mysql-db-openstack-cell1-galera-2\n \ oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n \ oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-galera-1\" deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-galera-2\" deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-cell1-galera-1\" deleted\n logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-cell1-galera-2\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-cinder-internal-svc\" deleted\n \ logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-galera-openstack-svc\" deleted\n \ logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-glance-default-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-keystone-internal-svc\" deleted\n \ logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-memcached-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-nova-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-placement-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-swift-public-route\" deleted\n logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret \"rootca-internal\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret \"rootca-libvirt\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret \"rootca-ovn\" deleted\n logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret \"rootca-public\" deleted\n logger.go:42: 20:07:44 | ctlplane-galera-3replicas/2-cleanup | test step completed 2-cleanup\n logger.go:42: 20:07:44 | ctlplane-galera-3replicas | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- PASS: kuttl (297.42s)\n --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-galera-3replicas (292.40s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ cut -d / -f 1\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-external-api-0\" deleted\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner \ Delete WaitForFirstConsumer true 5m6s\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ oc apply -f -\n++ cat\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ tr '\\n' ' '\n++ sed -e 's|node/||'\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 20:08:06 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running tests using configured kubeconfig.\n harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443\n logger.go:42: 20:08:06 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n \ logger.go:42: 20:08:07 | | netconfig.network.openstack.org/netconfig configured\n \ logger.go:42: 20:08:07 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n \ logger.go:42: 20:08:07 | | dnsmasq.network.openstack.org/dnsmasq configured\n \ logger.go:42: 20:08:07 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply -f -\n ]\n logger.go:42: 20:08:07 | | secret/dataplane-ansible-ssh-private-key-secret configured\n harness.go:363: running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-galera-basic\n=== PAUSE kuttl/harness/ctlplane-galera-basic\n=== CONT kuttl/harness/ctlplane-galera-basic\n \ logger.go:42: 20:08:07 | ctlplane-galera-basic | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera | starting test step 1-deploy-galera\n logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera.yaml\n \ ]\n logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | openstackcontrolplane.core.openstack.org/openstack-galera created\n logger.go:42: 20:12:05 | ctlplane-galera-basic/1-deploy-galera | test step completed 1-deploy-galera\n \ logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | starting test step 2-cleanup\n logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n mysql-db-openstack-galera-0 \\\n mysql-db-openstack-cell1-galera-0 \\\n srv-swift-storage-0\n \ oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n \ oc delete secret -l service-cert -n $NAMESPACE\n oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | persistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-cinder-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-galera-openstack-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-glance-default-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-keystone-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-memcached-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-placement-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-swift-public-route\" deleted\n logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-internal\" deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-libvirt\" deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-ovn\" deleted\n logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret \"rootca-public\" deleted\n logger.go:42: 20:12:39 | ctlplane-galera-basic/2-cleanup | test step completed 2-cleanup\n logger.go:42: 20:12:39 | ctlplane-galera-basic | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n \ harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- PASS: kuttl (272.65s)\n --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-galera-basic (271.12s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $6}'\n++ grep Bound\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-external-api-0\" deleted\n++ awk '{print $1}'\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner \ Delete WaitForFirstConsumer true 4m41s\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 20:13:01 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running tests using configured kubeconfig.\n harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443\n logger.go:42: 20:13:01 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n \ logger.go:42: 20:13:02 | | netconfig.network.openstack.org/netconfig configured\n \ logger.go:42: 20:13:02 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n \ logger.go:42: 20:13:03 | | dnsmasq.network.openstack.org/dnsmasq configured\n \ logger.go:42: 20:13:03 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply -f -\n ]\n logger.go:42: 20:13:03 | | secret/dataplane-ansible-ssh-private-key-secret configured\n harness.go:363: running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-nodeselectors\n=== PAUSE kuttl/harness/ctlplane-nodeselectors\n=== CONT kuttl/harness/ctlplane-nodeselectors\n \ logger.go:42: 20:13:03 | ctlplane-nodeselectors | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | starting test step 1-deploy-openstack\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | running command: [sh -c oc annotate namespace $NAMESPACE openshift.io/node-selector=\"beta.kubernetes.io/os=linux\"\n \ ]\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | namespace/openstack-kuttl-tests annotated\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/nodeselectors/global | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/1-deploy-openstack | test step completed 1-deploy-openstack\n \ logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | starting test step 2-\n \ logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | running command: [sh -c echo \"Checking all pods have expected nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all pods have expected nodeselector\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | running command: [sh -c echo \"Checking all cronjobs have expected nodeselector\"\n \ EXPECTED_NODE_SELECTOR=\"node-role.kubernetes.io/worker:\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get cronjobs -n $NAMESPACE -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.jobTemplate.spec.template.spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all cronjobs have expected nodeselector\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | test step completed 2-\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector | starting test step 3-update-nodeselector\n logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack --type='json' -p='[{\n \"op\": \"replace\",\n \"path\": \"/spec/nodeSelector\",\n \ \"value\": {\"kubernetes.io/os\":\"linux\"}\n }]'\n ]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector | openstackcontrolplane.core.openstack.org/openstack patched\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector | test step completed 3-update-nodeselector\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | starting test step 4-\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | Found 28 pods with bad or missing nodeselector:\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | Found 28 pods with bad or missing nodeselector:\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:22 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:22 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | Found 25 pods with bad or missing nodeselector:\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | Found 23 pods with bad or missing nodeselector:\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | Found 21 pods with bad or missing nodeselector:\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | Found 20 pods with bad or missing nodeselector:\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:27 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:27 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | Found 20 pods with bad or missing nodeselector:\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:32 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:32 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | Found 18 pods with bad or missing nodeselector:\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:36 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:36 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:40 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:40 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:44 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:44 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | Found 15 pods with bad or missing nodeselector:\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | Found 11 pods with bad or missing nodeselector:\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | Found 11 pods with bad or missing nodeselector:\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | Found 10 pods with bad or missing nodeselector:\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | Found 9 pods with bad or missing nodeselector:\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | Found 9 pods with bad or missing nodeselector:\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:52 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:52 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:17:56 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:56 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | Found 5 pods with bad or missing nodeselector:\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | Found 3 pods with bad or missing nodeselector:\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n \ EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n \ BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n \ echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n exit 1\n fi\n \ ]\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | Found 3 pods with bad or missing nodeselector:\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | Found 2 pods with bad or missing nodeselector:\n logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n \ logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]\n logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands\n \ logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all running pods have new nodeselector\"\n EXPECTED_NODE_SELECTOR=\"beta.kubernetes.io/os:linux kubernetes.io/os:linux\"\n BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector\n logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | running command: [sh -c echo \"Checking all cronjobs have expected nodeselector\"\n EXPECTED_NODE_SELECTOR=\"kubernetes.io/os:linux\"\n \ BAD_OR_MISSING_NODE_SELECTOR=$(oc get cronjobs -n $NAMESPACE -o=go-template --template='{{ range .items }}{{ .metadata.name}}: {{ .spec.jobTemplate.spec.template.spec.nodeSelector }}{{\"\\n\"}}{{ end }}' | grep -v 'ovn-controller-.*-config' | grep -v 'crc-storage-*' | sed -e '\\!map\\['\"$EXPECTED_NODE_SELECTOR\"'\\]$!d')\n BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n \"$BAD_OR_MISSING_NODE_SELECTOR\" | wc -l)\n if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then\n echo \"Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs with bad or missing nodeselector:\"\n echo \"$BAD_OR_MISSING_NODE_SELECTOR\"\n \ exit 1\n fi\n ]\n logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | Checking all cronjobs have expected nodeselector\n logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | test step completed 4-\n logger.go:42: 20:18:28 | ctlplane-nodeselectors/5-cleanup | starting test step 5-cleanup\n logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | running command: [sh -c oc annotate namespace $NAMESPACE openshift.io/node-selector-\n oc delete --ignore-not-found=true -n $NAMESPACE pvc \\\n srv-swift-storage-0\n oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE\n oc delete secret -l service-cert -n $NAMESPACE\n \ oc delete secret -l ca-cert -n $NAMESPACE\n ]\n logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | namespace/openstack-kuttl-tests annotated\n \ logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret \"combined-ca-bundle\" deleted\n logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret \"cert-barbican-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-barbican-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-barbican-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-ceilometer-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-cinder-internal-svc\" deleted\n \ logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-cinder-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-cinder-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-galera-openstack-cell1-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-galera-openstack-svc\" deleted\n \ logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-glance-default-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-glance-default-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-glance-default-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-keystone-internal-svc\" deleted\n \ logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-keystone-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-keystone-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-kube-state-metrics-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-memcached-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-neutron-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-neutron-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-neutron-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-neutron-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-nova-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-nova-novncproxy-cell1-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-nova-novncproxy-cell1-vencrypt\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-nova-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-nova-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-ovn-metrics\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-ovndbcluster-nb-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-ovndbcluster-sb-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-ovnnorthd-ovndbs\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-placement-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-placement-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-placement-public-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-rabbitmq-cell1-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-rabbitmq-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-swift-internal-svc\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-swift-public-route\" deleted\n logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret \"cert-swift-public-svc\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret \"rootca-internal\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret \"rootca-libvirt\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret \"rootca-ovn\" deleted\n logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret \"rootca-public\" deleted\n logger.go:42: 20:19:03 | ctlplane-nodeselectors/5-cleanup | test step completed 5-cleanup\n logger.go:42: 20:19:03 | ctlplane-nodeselectors | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- PASS: kuttl (361.27s)\n --- PASS: kuttl/harness (0.00s)\n --- PASS: kuttl/harness/ctlplane-nodeselectors (359.74s)\nPASS\nNo resources found\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage_cleanup.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/cleanup-crc-pv.sh\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ grep Bound\n++ awk '{print $6}'\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/swift-swift-storage-0\n++ cut -d / -f 2\n+ NAME=swift-swift-storage-0\n+ oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found\npersistentvolumeclaim \"swift-swift-storage-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-cell1-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-cell1-galera-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-internal-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-internal-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/glance-glance-default-external-api-0\n++ cut -d / -f 2\n+ NAME=glance-glance-default-external-api-0\n+ oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found\npersistentvolumeclaim \"glance-glance-default-external-api-0\" deleted\n+ for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'`\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 1\n+ NS=openstack-kuttl-tests\n++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0\n++ cut -d / -f 2\n+ NAME=mysql-db-openstack-galera-0\n+ oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found\npersistentvolumeclaim \"mysql-db-openstack-galera-0\" deleted\n++ oc get pv --selector provisioned-by=crc-devsetup --no-headers\n++ awk '{print $1}'\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage01-crc\npersistentvolume \"local-storage01-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage02-crc\npersistentvolume \"local-storage02-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage03-crc\npersistentvolume \"local-storage03-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage04-crc\npersistentvolume \"local-storage04-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage05-crc\npersistentvolume \"local-storage05-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage06-crc\npersistentvolume \"local-storage06-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage07-crc\npersistentvolume \"local-storage07-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage08-crc\npersistentvolume \"local-storage08-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage09-crc\npersistentvolume \"local-storage09-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage10-crc\npersistentvolume \"local-storage10-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage11-crc\npersistentvolume \"local-storage11-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage12-crc\npersistentvolume \"local-storage12-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage13-crc\npersistentvolume \"local-storage13-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage14-crc\npersistentvolume \"local-storage14-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage15-crc\npersistentvolume \"local-storage15-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage16-crc\npersistentvolume \"local-storage16-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage17-crc\npersistentvolume \"local-storage17-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage18-crc\npersistentvolume \"local-storage18-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage19-crc\npersistentvolume \"local-storage19-crc\" deleted\n+ for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'`\n+ oc delete pv/local-storage20-crc\npersistentvolume \"local-storage20-crc\" deleted\nif oc get sc \"local-storage\"; then oc delete sc \"local-storage\"; fi\nNAME PROVISIONER RECLAIMPOLICY \ VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE\nlocal-storage kubernetes.io/no-provisioner \ Delete WaitForFirstConsumer true 6m10s\nstorageclass.storage.k8s.io \"local-storage\" deleted\nbash scripts/delete-pv.sh\n+++ dirname scripts/delete-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete\n++ set -ex\n++ NODE=crc\n++ OPERATION=delete\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/retry_make_crc_storage.sh 3\nmake[3]: Entering directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nbash scripts/gen-namespace.sh\n+ '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']'\n+ '[' -z crc-storage ']'\n+ OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml\nnamespace/crc-storage unchanged\ntimeout 500s bash -c \"while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done\"\nNAME DISPLAY NAME STATUS\ncrc-storage \ Active\noc project crc-storage\nAlready on project \"crc-storage\" on server \"https://api.crc.testing:6443\".\nbash scripts/create-pv.sh\n+++ dirname scripts/create-pv.sh\n++ cd scripts\n++ pwd -P\n+ SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh\n++ set -ex\n++ OPERATION=create\n++ cat\n++ oc apply -f -\nconfigmap/crc-storage unchanged\n++ cat\n++ oc apply -f -\nserviceaccount/crc-storage unchanged\n++ cat\n++ oc apply -f -\nrole.rbac.authorization.k8s.io/crc-storage-role unchanged\n++ cat\n++ oc apply -f -\nrolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged\n+ PV_NUM=20\n+ TIMEOUT=500s\n++ oc get pv -o json\n++ jq -r '.items[] | select(.status.phase | test(\"Released\")).metadata.name'\n+ released=\n++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{\"\\n\"}}{{end}}' -l node-role.kubernetes.io/worker\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ for node in $NODE_NAMES\n+ . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create\n++ set -ex\n++ NODE=crc\n++ OPERATION=create\n++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found\njob.batch \"crc-storage-crc\" deleted\n++ cat\n++ oc apply -f -\nWarning: would violate PodSecurity \"restricted:latest\": privileged (container \"storage\" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container \"storage\" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container \"storage\" must set securityContext.capabilities.drop=[\"ALL\"]), restricted volume types (volume \"node-mnt\" uses restricted volume type \"hostPath\"), runAsNonRoot != true (pod or container \"storage\" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container \"storage\" must not set runAsUser=0)\njob.batch/crc-storage-crc created\n+ oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s\njob.batch/crc-storage-crc condition met\nbash scripts/gen-crc-pv-kustomize.sh\n+ OUT=/home/zuul/ci-framework-data/artifacts/manifests\n+ '[' -z '\"local-storage\"' ']'\n+ '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']'\n+ PV_NUM=20\n+ STORAGE_CAPACITY=10\n++ oc get node -o name -l node-role.kubernetes.io/worker\n++ head -c-1\n++ sed -e 's|node/||'\n++ tr '\\n' ' '\n+ NODE_NAMES=crc\n+ '[' -z crc ']'\n+ cat\n+ for node in $NODE_NAMES\n++ seq -w 20\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ for i in `seq -w $PV_NUM`\n+ cat\n++ sed -e 's/^\"//' -e 's/\"$//'\n+ cat\noc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml\nstorageclass.storage.k8s.io/local-storage created\npersistentvolume/local-storage01-crc created\npersistentvolume/local-storage02-crc created\npersistentvolume/local-storage03-crc created\npersistentvolume/local-storage04-crc created\npersistentvolume/local-storage05-crc created\npersistentvolume/local-storage06-crc created\npersistentvolume/local-storage07-crc created\npersistentvolume/local-storage08-crc created\npersistentvolume/local-storage09-crc created\npersistentvolume/local-storage10-crc created\npersistentvolume/local-storage11-crc created\npersistentvolume/local-storage12-crc created\npersistentvolume/local-storage13-crc created\npersistentvolume/local-storage14-crc created\npersistentvolume/local-storage15-crc created\npersistentvolume/local-storage16-crc created\npersistentvolume/local-storage17-crc created\npersistentvolume/local-storage18-crc created\npersistentvolume/local-storage19-crc created\npersistentvolume/local-storage20-crc created\npersistentvolumeclaim/ansible-ee-logs unchanged\nmake[3]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake[2]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\n2025/10/13 20:19:25 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]\n=== RUN kuttl\n harness.go:463: starting setup\n harness.go:255: running tests using configured kubeconfig.\n harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443\n logger.go:42: 20:19:25 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]\n \ logger.go:42: 20:19:26 | | netconfig.network.openstack.org/netconfig configured\n \ logger.go:42: 20:19:26 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]\n \ logger.go:42: 20:19:26 | | dnsmasq.network.openstack.org/dnsmasq configured\n \ logger.go:42: 20:19:26 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then\n ssh-keygen -f ansibleee-ssh-key-id_rsa -N \"\" -t rsa -b 4096\n \ fi\n oc create secret generic dataplane-ansible-ssh-private-key-secret \\\n --save-config \\\n --dry-run=client \\\n --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \\\n --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \\\n --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \\\n -n openstack-kuttl-tests \\\n -o yaml | \\\n oc apply -f -\n ]\n logger.go:42: 20:19:27 | | secret/dataplane-ansible-ssh-private-key-secret configured\n harness.go:363: running tests\n harness.go:75: going to run test suite with timeout of 1380 seconds for each step\n harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests\n=== RUN kuttl/harness\n=== RUN kuttl/harness/ctlplane-tls-cert-rotation\n=== PAUSE kuttl/harness/ctlplane-tls-cert-rotation\n=== CONT kuttl/harness/ctlplane-tls-cert-rotation\n \ logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation | Skipping creation of user-supplied namespace: openstack-kuttl-tests\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | starting test step 0-deploy-openstack-tls-ingress-only\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c oc kustomize ../../../../config/samples/tls/tls_ingress | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | openstackcontrolplane.core.openstack.org/openstack created\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"Waiting for OpenStack control plane to be ready...\"\n oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l core.openstack.org/openstackcontrolplane\n ]\n logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Waiting for OpenStack control plane to be ready...\n logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | openstackcontrolplane.core.openstack.org/openstack condition met\n logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"Fail if internal https endpoints are registered\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -c \"openstack endpoint list --interface internal -f value -c URL\" | grep 'https:' && exit 1\n exit 0\n ]\n \ logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Fail if internal https endpoints are registered\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check ovn sb internalDbAddress use tcp\"\n oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q tcp\n \ ]\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb internalDbAddress use tcp\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check ovn sb DB connection use tcp\"\n oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c \"ovn-sbctl --no-leader-only get-connection | grep -q ptcp\"\n ]\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb DB connection use tcp\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container \"ovsdbserver-sb\" out of: ovsdbserver-sb, openstack-network-exporter\n \ logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check nova transport_url use tcp\"\n oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c \"grep transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q 'ssl=0'\"\n ]\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check nova transport_url use tcp\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check neutron ovn_sb_connection url tcp address\"\n \ oc exec -i deployment/neutron -n $NAMESPACE -- bash -c \"grep ovn_sb_connection /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp\"\n ]\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check neutron ovn_sb_connection url tcp address\n logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container \"neutron-api\" out of: neutron-api, neutron-httpd\n logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"Waiting for OpenStack control plane to be ready...\"\n oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l core.openstack.org/openstackcontrolplane\n ]\n logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Waiting for OpenStack control plane to be ready...\n logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | openstackcontrolplane.core.openstack.org/openstack condition met\n logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"Fail if internal https endpoints are registered\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -c \"openstack endpoint list --interface internal -f value -c URL\" | grep 'https:' && exit 1\n exit 0\n ]\n \ logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Fail if internal https endpoints are registered\n logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check ovn sb internalDbAddress use tcp\"\n oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q tcp\n \ ]\n logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb internalDbAddress use tcp\n logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check ovn sb DB connection use tcp\"\n oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c \"ovn-sbctl --no-leader-only get-connection | grep -q ptcp\"\n ]\n logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb DB connection use tcp\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container \"ovsdbserver-sb\" out of: ovsdbserver-sb, openstack-network-exporter\n \ logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check nova transport_url use tcp\"\n oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c \"grep transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q 'ssl=0'\"\n ]\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check nova transport_url use tcp\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo \"check neutron ovn_sb_connection url tcp address\"\n \ oc exec -i deployment/neutron -n $NAMESPACE -- bash -c \"grep ovn_sb_connection /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp\"\n ]\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check neutron ovn_sb_connection url tcp address\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container \"neutron-api\" out of: neutron-api, neutron-httpd\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | test step completed 0-deploy-openstack-tls-ingress-only\n logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/1-deploy-openstack | starting test step 1-deploy-openstack\n \ logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/1-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 20:23:26 | ctlplane-tls-cert-rotation/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack configured\n logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/1-deploy-openstack | test step completed 1-deploy-openstack\n \ logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | starting test step 2-get-endpoints-certs\n logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_before\n ]\n logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Get fingerprints of all service certs\n logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openstack endpoint list -c URL -f value\n logger.go:42: 20:26:11 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ awk -F/ '{print $3}'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo nova-internal.openstack-kuttl-tests.svc:8774\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=nova-internal.openstack-kuttl-tests.svc:8774\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! nova-internal.openstack-kuttl-tests.svc:8774 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect nova-internal.openstack-kuttl-tests.svc:8774\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'nova-internal.openstack-kuttl-tests.svc:8774 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo glance-default-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! glance-default-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing:443\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect glance-default-public-openstack-kuttl-tests.apps-crc.testing:443\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'glance-default-public-openstack-kuttl-tests.apps-crc.testing:443 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo swift-public-openstack-kuttl-tests.apps-crc.testing\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! swift-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect swift-public-openstack-kuttl-tests.apps-crc.testing:443\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'swift-public-openstack-kuttl-tests.apps-crc.testing:443 FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo glance-default-internal.openstack-kuttl-tests.svc:9292\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=glance-default-internal.openstack-kuttl-tests.svc:9292\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! glance-default-internal.openstack-kuttl-tests.svc:9292 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect glance-default-internal.openstack-kuttl-tests.svc:9292\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'glance-default-internal.openstack-kuttl-tests.svc:9292 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo cinder-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! cinder-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect cinder-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'cinder-public-openstack-kuttl-tests.apps-crc.testing:443 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo placement-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! placement-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect placement-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'placement-public-openstack-kuttl-tests.apps-crc.testing:443 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo neutron-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! neutron-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect neutron-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'neutron-public-openstack-kuttl-tests.apps-crc.testing:443 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo cinder-internal.openstack-kuttl-tests.svc:8776\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=cinder-internal.openstack-kuttl-tests.svc:8776\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! cinder-internal.openstack-kuttl-tests.svc:8776 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect cinder-internal.openstack-kuttl-tests.svc:8776\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'cinder-internal.openstack-kuttl-tests.svc:8776 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo barbican-internal.openstack-kuttl-tests.svc:9311\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=barbican-internal.openstack-kuttl-tests.svc:9311\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! barbican-internal.openstack-kuttl-tests.svc:9311 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect barbican-internal.openstack-kuttl-tests.svc:9311\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'barbican-internal.openstack-kuttl-tests.svc:9311 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo swift-internal.openstack-kuttl-tests.svc:8080\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=swift-internal.openstack-kuttl-tests.svc:8080\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! swift-internal.openstack-kuttl-tests.svc:8080 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect swift-internal.openstack-kuttl-tests.svc:8080\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'swift-internal.openstack-kuttl-tests.svc:8080 F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo keystone-internal.openstack-kuttl-tests.svc:5000\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=keystone-internal.openstack-kuttl-tests.svc:5000\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! keystone-internal.openstack-kuttl-tests.svc:5000 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect keystone-internal.openstack-kuttl-tests.svc:5000\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'keystone-internal.openstack-kuttl-tests.svc:5000 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo barbican-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! barbican-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect barbican-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'barbican-public-openstack-kuttl-tests.apps-crc.testing:443 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo nova-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! nova-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect nova-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'nova-public-openstack-kuttl-tests.apps-crc.testing:443 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo placement-internal.openstack-kuttl-tests.svc:8778\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=placement-internal.openstack-kuttl-tests.svc:8778\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! placement-internal.openstack-kuttl-tests.svc:8778 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect placement-internal.openstack-kuttl-tests.svc:8778\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'placement-internal.openstack-kuttl-tests.svc:8778 CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo keystone-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! keystone-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect keystone-public-openstack-kuttl-tests.apps-crc.testing:443\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'keystone-public-openstack-kuttl-tests.apps-crc.testing:443 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ '{print $3}')\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo neutron-internal.openstack-kuttl-tests.svc:9696\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E 's|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\\1:\\3|'\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=neutron-internal.openstack-kuttl-tests.svc:9696\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! neutron-internal.openstack-kuttl-tests.svc:9696 =~ :[0-9]+$ ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect neutron-internal.openstack-kuttl-tests.svc:9696\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed 's/.* Fingerprint=//'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83\n \ logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83 ]]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo 'neutron-internal.openstack-kuttl-tests.svc:9696 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83'\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo \"Waiting for OpenStack control plane to be ready...\"\n oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l core.openstack.org/openstackcontrolplane\n \ ]\n logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Waiting for OpenStack control plane to be ready...\n logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | openstackcontrolplane.core.openstack.org/openstack condition met\n logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo \"Fail if internal http endpoints are registered\"\n \ oc exec -i openstackclient -n $NAMESPACE -- bash -c \"openstack endpoint list --interface internal -f value -c URL\" | grep 'http:' && exit 1\n exit 0\n ]\n logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Fail if internal http endpoints are registered\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo \"check ovn sb internalDbAddress use ssl\"\n oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q ssl\n ]\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check ovn sb internalDbAddress use ssl\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo \"check ovn sb DB connection use ssl\"\n oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c \"ovn-sbctl --no-leader-only get-connection | grep -q pssl\"\n ]\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check ovn sb DB connection use ssl\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Defaulted container \"ovsdbserver-sb\" out of: ovsdbserver-sb, openstack-network-exporter\n \ logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo \"check nova transport_url use ssl\"\n oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c \"grep transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q 'ssl=1'\"\n ]\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check nova transport_url use ssl\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo \"check neutron ovn_sb_connection url ssl\"\n oc exec -i deployment/neutron -n $NAMESPACE -- bash -c \"grep ovn_sb_connection /etc/neutron/neutron.conf.d/01-neutron.conf| grep -q ssl\"\n ]\n logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check neutron ovn_sb_connection url ssl\n logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Defaulted container \"neutron-api\" out of: neutron-api, neutron-httpd\n logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | test step completed 2-get-endpoints-certs\n logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration | starting test step 3-change-cert-duration\n logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_duration | oc apply -n $NAMESPACE -f -\n ]\n logger.go:42: 20:26:18 | ctlplane-tls-cert-rotation/3-change-cert-duration | openstackcontrolplane.core.openstack.org/openstack configured\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/3-change-cert-duration | test step completed 3-change-cert-duration\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | starting test step 4-\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 match the secret.\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:26:36 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:26:36 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:26:53 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:26:53 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:27:04 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:27:04 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:27:15 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:27:15 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:27:21 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:27:21 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods \"openstackclient\" not found\n logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n ]\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n \ logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.\n logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n \ logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.\n logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.\n logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.\n logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Get fingerprints of all service certs\"\n oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after\n \ ]\n logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs\n logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- | error: unable to upgrade connection: container not found (\"openstackclient\")\n \ logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.\n logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691\n logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691\n logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691\n logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.\n logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.\n logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691\n logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n \ logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:28:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691\n logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:29:08 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:30:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:30:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:31:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:32:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:32:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo \"Checking rotation of non API service certificates...\"\n \ NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh\n \ ]\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)\n \ logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.\n logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...\n logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.\n logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...\n logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.\n logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)\n \ logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...\n logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.\n logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...\n \ logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.\n logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...\n logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.\n logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...\n \ logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.\n logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)\n \ logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.\n logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...\n logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.\n logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...\n \ logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.\n logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)\n logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:\n \ logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981\n logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands\n logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation/4- | test step failed 4-\n case.go:396: failed in step 4-\n case.go:398: command \"echo \\\"Checking rotation of non API service certificates...\\\"\\\\n NAMES...\" failed, exit status 1\n logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation | skipping kubernetes event logging\n=== NAME kuttl\n harness.go:406: run tests finished\n harness.go:514: cleaning up\n harness.go:571: removing temp folder: \"\"\n--- FAIL: kuttl (1314.18s)\n --- FAIL: kuttl/harness (0.00s)\n --- FAIL: kuttl/harness/ctlplane-tls-cert-rotation (1312.57s)\nFAIL\nmake[1]: *** [Makefile:2080: openstack_kuttl_run] Error 1\nmake[1]: Leaving directory '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls'\nmake: *** [Makefile:2102: openstack_kuttl] Error 2\n" stdout_lines: - ~/src/github.com/openstack-k8s-operators/install_yamls ~/ci-framework-data/artifacts - 'error: the server doesn''t have a resource type "openstackversion"' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z openstack-kuttl-tests ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/namespace.yaml - namespace/openstack-kuttl-tests created - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io openstack-kuttl-tests); do sleep 1; done" - NAME DISPLAY NAME STATUS - openstack-kuttl-tests Active - oc project openstack-kuttl-tests - Now using project "openstack-kuttl-tests" on server "https://api.crc.testing:6443". - bash scripts/gen-input-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z openstack-kuttl-tests ']' - + '[' -z osp-secret ']' - + '[' -z 12345678 ']' - + '[' -z 1234567842 ']' - + '[' -z 767c3ed056cbaa3b9dfedb8c6f825bf0 ']' - + '[' -z sEFmdFjDUqRM2VemYslV5yGNWjokioJXsg8Nrlc3drU= ']' - + '[' -z COX8bmlKAWn56XCGMrKQJj7dgHNAOl6f ']' - + '[' -z openstack ']' - + '[' -z libvirt-secret ']' - + DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input - + pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input - ~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input ~/src/github.com/openstack-k8s-operators/install_yamls - + cat - oc get secret/osp-secret || oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/input | oc apply -f - - 'Error from server (NotFound): secrets "osp-secret" not found' - secret/libvirt-secret created - secret/octavia-ca-passphrase created - secret/osp-secret created - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/manila-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/manila/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists manila;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/heat-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/heat/cr - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/horizon-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/horizon/cr - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/nova-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nova/cr - oc rsh openstack-galera-0 mysql -u root --password=12345678 -ss -e "show databases like 'nova_%';" | xargs -I '{}' oc rsh openstack-galera-0 mysql -u root --password=12345678 -ss -e "flush tables; drop database if exists {};" - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator-redis /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra-redis/cr - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/octavia-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/octavia/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists octavia;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/designate-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/designate/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists designate;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/neutron-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/neutron/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists neutron;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ovn-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ovn/cr - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ironic-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/ironic/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists ironic;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists ironic_inspector;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/cinder-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/cinder/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists cinder;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/glance-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/glance/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists glance;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/placement-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/placement/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists placement;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift: no such file or directory' - No resources found - rm -Rf -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/swift-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/swift/cr - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/barbican-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/barbican/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists barbican;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/keystone-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/keystone/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists keystone;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/mariadb-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/mariadb/cr - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/telemetry-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/ceilometer-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/telemetry/cr - oc rsh -t openstack-galera-0 mysql -u root --password=12345678 -e "flush tables; drop database if exists aodh;" || true - 'Error from server (NotFound): pods "openstack-galera-0" not found' - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr - if oc get RabbitmqCluster; then oc delete --ignore-not-found=true RabbitmqCluster --all; fi - 'error: the server doesn''t have a resource type "RabbitmqCluster"' - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/rabbitmq-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/rabbitmq/cr - bash scripts/validate-marketplace.sh - + '[' -z 500s ']' - + OPERATOR_NAMESPACE=openshift-marketplace - ++ oc get pods --no-headers -n openshift-marketplace - ++ grep -viE 'running|completed' - + not_running_pods= - + '[' -z '' ']' - + echo 'All openshift-marketplace pods seems to me fine' - All openshift-marketplace pods seems to me fine - + OPERATORS='openshift-cert-manager-operator kubernetes-nmstate-operator metallb-operator' - + for operator in $OPERATORS - + n=0 - + retries=20 - + true - + grep openshift-cert-manager-operator - + oc get packagemanifests -n openshift-marketplace - openshift-cert-manager-operator Red Hat Operators 232d - + '[' 0 -eq 0 ']' - + break - + for operator in $OPERATORS - + n=0 - + retries=20 - + true - + oc get packagemanifests -n openshift-marketplace - + grep kubernetes-nmstate-operator - kubernetes-nmstate-operator Red Hat Operators 232d - + '[' 0 -eq 0 ']' - + break - + for operator in $OPERATORS - + n=0 - + retries=20 - + true - + grep metallb-operator - + oc get packagemanifests -n openshift-marketplace - metallb-operator Red Hat Operators 232d - + '[' 0 -eq 0 ']' - + break - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z openshift-nmstate ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/namespace.yaml - namespace/openshift-nmstate created - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io openshift-nmstate); do sleep 1; done" - NAME DISPLAY NAME STATUS - openshift-nmstate Active - bash scripts/gen-olm-nmstate.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr - + cat - + cat - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/nmstate/op - operatorgroup.operators.coreos.com/openshift-nmstate-tn6k8 created - subscription.operators.coreos.com/kubernetes-nmstate-operator created - timeout 500s bash -c "while ! (oc get deployments/nmstate-operator -n openshift-nmstate); do sleep 10; done" - 'Error from server (NotFound): deployments.apps "nmstate-operator" not found' - 'Error from server (NotFound): deployments.apps "nmstate-operator" not found' - NAME READY UP-TO-DATE AVAILABLE AGE - nmstate-operator 1/1 1 1 7s - oc wait deployments/nmstate-operator -n openshift-nmstate --for condition=Available --timeout=500s - deployment.apps/nmstate-operator condition met - timeout 500s bash -c "while ! (oc wait pod -n openshift-apiserver -l apiserver=true --for condition=Ready); do sleep 10; done" - pod/apiserver-76f77b778f-h75w4 condition met - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openshift-nmstate/nmstate/cr - nmstate.nmstate.io/nmstate created - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l component=kubernetes-nmstate-handler -n openshift-nmstate| grep nmstate-handler); do sleep 10; done" - No resources found in openshift-nmstate namespace. - nmstate-handler-bdw24 0/1 Running 0 10s - oc wait pod -n openshift-nmstate -l component=kubernetes-nmstate-handler --for condition=Ready --timeout=500s - pod/nmstate-handler-bdw24 condition met - timeout 500s bash -c "while ! (oc get deployments/nmstate-webhook -n openshift-nmstate); do sleep 10; done" - NAME READY UP-TO-DATE AVAILABLE AGE - nmstate-webhook 0/1 1 0 11s - oc wait deployments/nmstate-webhook -n openshift-nmstate --for condition=Available --timeout=500s - deployment.apps/nmstate-webhook condition met - WORKERS='crc' \ - bash scripts/gen-nncp.sh - + check_var_set DEPLOY_DIR - + [[ ! -v DEPLOY_DIR ]] - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr - + check_var_set WORKERS - + [[ ! -v WORKERS ]] - + check_var_set INTERFACE - + [[ ! -v INTERFACE ]] - + check_var_set BRIDGE_NAME - + [[ ! -v BRIDGE_NAME ]] - + check_var_set INTERFACE_MTU - + [[ ! -v INTERFACE_MTU ]] - + check_var_set VLAN_START - + [[ ! -v VLAN_START ]] - + check_var_set VLAN_STEP - + [[ ! -v VLAN_STEP ]] - + check_var_set VLAN_STEP - + [[ ! -v VLAN_STEP ]] - + check_var_set INTERNALAPI_PREFIX - + [[ ! -v INTERNALAPI_PREFIX ]] - + check_var_set STORAGE_PREFIX - + [[ ! -v STORAGE_PREFIX ]] - + check_var_set STORAGEMGMT_PREFIX - + [[ ! -v STORAGEMGMT_PREFIX ]] - + check_var_set TENANT_PREFIX - + [[ ! -v TENANT_PREFIX ]] - + check_var_set DESIGNATE_PREFIX - + [[ ! -v DESIGNATE_PREFIX ]] - + check_var_set DESIGNATE_EXT_PREFIX - + [[ ! -v DESIGNATE_EXT_PREFIX ]] - + '[' -n '' ']' - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr - + echo WORKERS crc - WORKERS crc - + echo INTERFACE ens7 - INTERFACE ens7 - + echo BRIDGE_NAME ospbr - BRIDGE_NAME ospbr - + echo INTERFACE_BGP_1 - INTERFACE_BGP_1 - + echo INTERFACE_BGP_2 - INTERFACE_BGP_2 - + echo INTERFACE_MTU 1500 - INTERFACE_MTU 1500 - + echo VLAN_START 20 - VLAN_START 20 - + echo VLAN_STEP 1 - VLAN_STEP 1 - + echo STORAGE_MACVLAN - STORAGE_MACVLAN - + '[' -n true ']' - + echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 - CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 - + echo CTLPLANE_IP_ADDRESS_SUFFIX 10 - CTLPLANE_IP_ADDRESS_SUFFIX 10 - + '[' -n '' ']' - + '[' -n '' ']' - + IP_ADDRESS_SUFFIX=5 - + IPV6_ADDRESS_SUFFIX=5 - + rm --force '/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/*_nncp.yaml' - + internalapi_vlan_id=20 - + storage_vlan_id=21 - + tenant_vlan_id=22 - + storagemgmt_vlan_id=23 - + octavia_vlan_id=24 - + designate_vlan_id=25 - + designate_ext_vlan_id=26 - + for WORKER in ${WORKERS} - + cat - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + '[' -n '' ']' - + cat - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + cat - + '[' -n '' ']' - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + cat - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + '[' -n '' ']' - + cat - + IP_ADDRESS_SUFFIX=6 - + IPV6_ADDRESS_SUFFIX=6 - + CTLPLANE_IP_ADDRESS_SUFFIX=11 - + CTLPLANE_IPV6_ADDRESS_SUFFIX=1 - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/nncp/cr/ - nodenetworkconfigurationpolicy.nmstate.io/ens7-crc created - timeout 240s bash -c "while ! (oc wait nncp -l osp/interface=ens7 --for jsonpath='{.status.conditions[0].reason}'=SuccessfullyConfigured); do sleep 10; done" - nodenetworkconfigurationpolicy.nmstate.io/ens7-crc condition met - if test -n "192.168.122.10"; then oc patch dns.operator/default --type merge -p '{"spec":{"upstreamResolvers":{"policy":"Sequential","upstreams":[{"type":"Network","address":"'192.168.122.10'","port":53},{"type":"SystemResolvConf"}]}}}'; fi - dns.operator.openshift.io/default patched - timeout 240s bash -c "while ! (oc wait dns.operator/default --for condition=available); do sleep 10; done" - dns.operator.openshift.io/default condition met - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z metallb-system ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/metallb-system - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/namespace.yaml - namespace/metallb-system created - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io metallb-system); do sleep 1; done" - NAME DISPLAY NAME STATUS - metallb-system Active - bash scripts/gen-olm-metallb.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr - + echo INTERFACE - INTERFACE - + cat - + cat - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/metallb/op - operatorgroup.operators.coreos.com/metallb-operator created - subscription.operators.coreos.com/metallb-operator-sub created - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l control-plane=controller-manager -n metallb-system| grep metallb-operator-controller); do sleep 10; done" - No resources found in metallb-system namespace. - No resources found in metallb-system namespace. - metallb-operator-controller-manager-b7789ff7f-4dz47 0/1 ContainerCreating 0 3s - oc wait pod -n metallb-system --for condition=Ready -l control-plane=controller-manager --timeout=500s - pod/metallb-operator-controller-manager-b7789ff7f-4dz47 condition met - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l component=webhook-server -n metallb-system| grep metallb-operator-webhook); do sleep 10; done" - metallb-operator-webhook-server-86869d57c5-28vf7 1/1 Running 0 41s - oc wait pod -n metallb-system --for condition=Ready -l component=webhook-server --timeout=500s - pod/metallb-operator-webhook-server-86869d57c5-28vf7 condition met - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/deploy_operator.yaml - metallb.metallb.io/metallb created - timeout 500s bash -c "while ! (oc get pod --no-headers=true -l component=speaker -n metallb-system | grep speaker); do sleep 10; done" - No resources found in metallb-system namespace. - speaker-lqgwl 1/2 Running 0 10s - oc wait pod -n metallb-system -l component=speaker --for condition=Ready --timeout=500s - pod/speaker-lqgwl condition met - make operator_namespace - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'error: the server doesn''t have a resource type "openstackversion"' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z cert-manager-operator ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/namespace.yaml - namespace/cert-manager-operator created - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io cert-manager-operator); do sleep 1; done" - NAME DISPLAY NAME STATUS - cert-manager-operator Active - oc project cert-manager-operator - Now using project "cert-manager-operator" on server "https://api.crc.testing:6443". - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-olm-cert-manager.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op ']' - + '[' -z cert-manager-operator ']' - + '[' -z stable-v1 ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op - + echo OPERATOR_NAMESPACE cert-manager-operator - OPERATOR_NAMESPACE cert-manager-operator - + echo CHANNEL stable-v1 - CHANNEL stable-v1 - + cat - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/cert-manager-operator/cert-manager/op - operatorgroup.operators.coreos.com/cert-manager-operator-bccwx created - subscription.operators.coreos.com/openshift-cert-manager-operator created - while ! (oc get pod --no-headers=true -l name=cert-manager-operator -n cert-manager-operator| grep "cert-manager-operator"); do sleep 10; done - No resources found in cert-manager-operator namespace. - No resources found in cert-manager-operator namespace. - cert-manager-operator-controller-manager-57cd46d6d-t9wrm 0/1 ContainerCreating 0 6s - oc wait pod -n cert-manager-operator --for condition=Ready -l name=cert-manager-operator --timeout=300s - pod/cert-manager-operator-controller-manager-57cd46d6d-t9wrm condition met - while ! (oc get pod --no-headers=true -l app=cainjector -n cert-manager | grep "cert-manager-cainjector"); do sleep 10; done - No resources found in cert-manager namespace. - cert-manager-cainjector-7d9f95dbf-866gz 1/1 Running 0 4s - oc wait pod -n cert-manager -l app=cainjector --for condition=Ready --timeout=300s - pod/cert-manager-cainjector-7d9f95dbf-866gz condition met - while ! (oc get pod --no-headers=true -l app=webhook -n cert-manager | grep "cert-manager-webhook"); do sleep 10; done - cert-manager-webhook-d969966f-qjpx9 0/1 Running 0 8s - oc wait pod -n cert-manager -l app=webhook --for condition=Ready --timeout=300s - pod/cert-manager-webhook-d969966f-qjpx9 condition met - while ! (oc get pod --no-headers=true -l app=cert-manager -n cert-manager | grep "cert-manager"); do sleep 10; done - No resources found in cert-manager namespace. - cert-manager-7d4cc89fcb-452pc 1/1 Running 0 2s - oc wait pod -n cert-manager -l app=cert-manager --for condition=Ready --timeout=300s - pod/cert-manager-7d4cc89fcb-452pc condition met - bash scripts/gen-netatt.sh - + check_var_set DEPLOY_DIR - + [[ ! -v DEPLOY_DIR ]] - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr - + check_var_set INTERFACE - + [[ ! -v INTERFACE ]] - + check_var_set BRIDGE_NAME - + [[ ! -v BRIDGE_NAME ]] - + check_var_set VLAN_START - + [[ ! -v VLAN_START ]] - + check_var_set VLAN_STEP - + [[ ! -v VLAN_STEP ]] - + '[' -z true ']' - + '[' -n true ']' - + '[' -n '' ']' - + '[' -n true ']' - + check_var_set INTERNALAPI_PREFIX - + [[ ! -v INTERNALAPI_PREFIX ]] - + check_var_set STORAGE_PREFIX - + [[ ! -v STORAGE_PREFIX ]] - + check_var_set STORAGEMGMT_PREFIX - + [[ ! -v STORAGEMGMT_PREFIX ]] - + check_var_set TENANT_PREFIX - + [[ ! -v TENANT_PREFIX ]] - + check_var_set DESIGNATE_PREFIX - + [[ ! -v DESIGNATE_PREFIX ]] - + check_var_set DESIGNATE_EXT_PREFIX - + [[ ! -v DESIGNATE_EXT_PREFIX ]] - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr - + echo INTERFACE ens7 - INTERFACE ens7 - + echo VLAN_START 20 - VLAN_START 20 - + echo VLAN_STEP 1 - VLAN_STEP 1 - + '[' -n true ']' - + echo CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 - CTLPLANE_IP_ADDRESS_PREFIX 192.168.122 - + echo CTLPLANE_IP_ADDRESS_SUFFIX 10 - CTLPLANE_IP_ADDRESS_SUFFIX 10 - + echo 'INTERNALAPI_PREFIX 172.17.0' - INTERNALAPI_PREFIX 172.17.0 - + echo 'STORAGE_PREFIX 172.18.0' - STORAGE_PREFIX 172.18.0 - + echo 'STORAGEMGMT_PREFIX 172.20.0' - STORAGEMGMT_PREFIX 172.20.0 - + echo 'TENANT_PREFIX 172.19.0' - TENANT_PREFIX 172.19.0 - + echo 'DESIGNATE_PREFIX 172.28.0' - DESIGNATE_PREFIX 172.28.0 - + echo 'DESIGNATE_PREFIX 172.50.0' - DESIGNATE_PREFIX 172.50.0 - + '[' -n '' ']' - + cat - + '[' -n true ']' - + cat - + cat - + cat - + '[' -n true ']' - + cat - + cat - + cat - + '[' -n true ']' - + cat - + cat - + cat - + '[' -n true ']' - + cat - + cat - + cat - + cat - + '[' -n true ']' - + cat - + cat - + cat - + '[' -n true ']' - + cat - + cat - + cat - + cat - + '[' -n '' ']' - + '[' -n '' ']' - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/netattach/cr/ - networkattachmentdefinition.k8s.cni.cncf.io/ctlplane created - networkattachmentdefinition.k8s.cni.cncf.io/datacentre created - networkattachmentdefinition.k8s.cni.cncf.io/designate created - networkattachmentdefinition.k8s.cni.cncf.io/designateext created - networkattachmentdefinition.k8s.cni.cncf.io/internalapi created - networkattachmentdefinition.k8s.cni.cncf.io/octavia created - networkattachmentdefinition.k8s.cni.cncf.io/storage created - networkattachmentdefinition.k8s.cni.cncf.io/storagemgmt created - networkattachmentdefinition.k8s.cni.cncf.io/tenant created - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml" does not exist' - 'make: [Makefile:2546: metallb_config_cleanup] Error 1 (ignored)' - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml" does not exist' - 'make: [Makefile:2547: metallb_config_cleanup] Error 1 (ignored)' - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml" does not exist' - 'make: [Makefile:2548: metallb_config_cleanup] Error 1 (ignored)' - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml" does not exist' - 'make: [Makefile:2549: metallb_config_cleanup] Error 1 (ignored)' - oc delete --ignore-not-found=true -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml - 'error: the path "/home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml" does not exist' - 'make: [Makefile:2550: metallb_config_cleanup] Error 1 (ignored)' - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgppeers.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpadvertisement.yaml /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/bgpextras.yaml - bash scripts/gen-metallb-config.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr ']' - + '[' -z ens7 ']' - + '[' -z ospbr ']' - + '[' -z 64999 ']' - + '[' -z 64999 ']' - + '[' -z 100.65.4.1 ']' - + '[' -z 100.64.4.1 ']' - + '[' -z 172.30.4.2 ']' - + '[' -z true ']' - + echo DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr - DEPLOY_DIR /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr - + echo INTERFACE ens7 - INTERFACE ens7 - + echo CTLPLANE_METALLB_POOL 192.168.122.80-192.168.122.90 - CTLPLANE_METALLB_POOL 192.168.122.80-192.168.122.90 - + echo CTLPLANE_METALLB_IPV6_POOL fd00:aaaa::80-fd00:aaaa::90 - CTLPLANE_METALLB_IPV6_POOL fd00:aaaa::80-fd00:aaaa::90 - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + '[' -n true ']' - + cat - + '[' -n '' ']' - + cat - + cat - + cat - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/ipaddresspools.yaml - ipaddresspool.metallb.io/ctlplane created - ipaddresspool.metallb.io/internalapi created - ipaddresspool.metallb.io/storage created - ipaddresspool.metallb.io/tenant created - ipaddresspool.metallb.io/designateext created - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/metallb-system/metallb/cr/l2advertisement.yaml - l2advertisement.metallb.io/ctlplane created - l2advertisement.metallb.io/internalapi created - l2advertisement.metallb.io/storage created - l2advertisement.metallb.io/tenant created - l2advertisement.metallb.io/designateext created - bash scripts/gen-olm.sh - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' -z quay.io/openstack-k8s-operators/openstack-operator-index:latest ']' - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op - + OPERATOR_CHANNEL=alpha - + OPERATOR_SOURCE=openstack-operator-index - + OPERATOR_SOURCE_NAMESPACE=openstack-operators - + echo OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op - OPERATOR_DIR /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op - + echo OPERATOR_CHANNEL alpha - OPERATOR_CHANNEL alpha - + echo OPERATOR_SOURCE openstack-operator-index - OPERATOR_SOURCE openstack-operator-index - + echo OPERATOR_SOURCE_NAMESPACE openstack-operators - OPERATOR_SOURCE_NAMESPACE openstack-operators - + cat - + cat - + cat - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z openstack-operators ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/openstack-operators - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/namespace.yaml - 'Warning: resource namespaces/openstack-operators is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - namespace/openstack-operators configured - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io openstack-operators); do sleep 1; done" - NAME DISPLAY NAME STATUS - openstack-operators Active - oc project openstack-operators - Now using project "openstack-operators" on server "https://api.crc.testing:6443". - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op - catalogsource.operators.coreos.com/openstack-operator-index created - operatorgroup.operators.coreos.com/openstack created - subscription.operators.coreos.com/openstack-operator created - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr | oc delete --ignore-not-found=true -f - - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/infra-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/infra/cr - oc kustomize /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr | oc delete --ignore-not-found=true -f - || true - 'error: must build at directory: not a valid directory: evalsymlink failure on ''/home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr'' : lstat /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack: no such file or directory' - No resources found - rm -Rf /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr - mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/operator /home/zuul/ci-framework-data/artifacts/manifests/openstack-operators/openstack/op /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr - bash -c "test -d /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator || CHECKOUT_FROM_OPENSTACK_REF=false scripts/clone-operator-repo.sh" - 'Cloning repo: git clone -b main https://github.com/openstack-k8s-operators/openstack-operator.git openstack-operator' - Cloning into 'openstack-operator'... - cp /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr - bash scripts/gen-service-kustomize.sh - +++ dirname scripts/gen-service-kustomize.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/common.sh --source-only - ++ set -e - + '[' -z openstack-kuttl-tests ']' - + '[' -z OpenStackControlPlane ']' - + '[' -z osp-secret ']' - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr ']' - + '[' -n '' ']' - + REPLACEMENTS= - + IMAGE=unused - + IMAGE_PATH=containerImage - + STORAGE_REQUEST=10G - + INTERFACE_MTU=1500 - + VLAN_START=20 - + VLAN_STEP=1 - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr ']' - + pushd /home/zuul/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr - ~/ci-framework-data/artifacts/manifests/openstack-kuttl-tests/openstack/cr ~/src/github.com/openstack-k8s-operators/install_yamls - + cat - + [[ OpenStackControlPlane == \O\p\e\n\S\t\a\c\k\C\o\n\t\r\o\l\P\l\a\n\e ]] - + [[ '' != '' ]] - + IFS=, - + read -ra IMAGES - + IFS=, - + read -ra IMAGE_PATHS - + '[' 1 '!=' 1 ']' - + (( i=0 )) - + (( i < 1 )) - + SPEC_PATH=containerImage - + SPEC_VALUE=unused - + '[' unused '!=' unused ']' - + (( i++ )) - + (( i < 1 )) - + '[' -n '' ']' - + '[' OpenStackControlPlane == OpenStackControlPlane ']' - + cat - + '[' OpenStackControlPlane == Galera ']' - + '[' OpenStackControlPlane == NetConfig ']' - + '[' -n '' ']' - + [[ OpenStackControlPlane == \O\p\e\n\S\t\a\c\k\C\o\n\t\r\o\l\P\l\a\n\e ]] - + [[ true == \t\r\u\e ]] - + cat - + [[ OpenStackControlPlane == \O\p\e\n\S\t\a\c\k\C\o\n\t\r\o\l\P\l\a\n\e ]] - + '[' -z true ']' - + '[' -n '' ']' - + '[' -z true ']' - + '[' -n true ']' - + '[' -n '' ']' - + '[' -n '' ']' - + kustomization_add_resources - + echo merge config dir - merge config dir - ++ find . -type f -name '*.yaml' - ++ grep -v kustomization - + yamls=./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml - + for y in ${yamls[@]} - + kustomize edit add resource ./core_v1beta1_openstackcontrolplane_galera_network_isolation.yaml - + popd - ~/src/github.com/openstack-k8s-operators/install_yamls - '# Wait until OLM installs openstack CRDs' - timeout 500s bash -c "while ! (oc get crd openstacks.operator.openstack.org); do sleep 1; done" - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - 'Error from server (NotFound): customresourcedefinitions.apiextensions.k8s.io "openstacks.operator.openstack.org" not found' - NAME CREATED AT - openstacks.operator.openstack.org 2025-10-13T19:38:15Z - make openstack_init - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'error: the server doesn''t have a resource type "openstackversion"' - '# call make_openstack if it isn''t already' - bash -c '(oc get subscription -n openstack-operators openstack-operator || make openstack) || true' - NAME PACKAGE SOURCE CHANNEL - openstack-operator openstack-operator openstack-operator-index alpha - timeout 500s bash -c 'until $(oc get csv -l operators.coreos.com/openstack-operator.openstack-operators -n openstack-operators | grep -q Succeeded); do sleep 1; done' - No resources found in openstack-operators namespace. - bash -c 'test -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml || make openstack_repo' - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/config/samples/operator_v1beta1_openstack.yaml - openstack.operator.openstack.org/openstack created - '# FIXME: Ugly hack to prevent OpenStack Baremetal operator from crashing when BMO is not installed' - if ! echo "" | grep -q "baremetalhosts.metal3.io"; then \ - "\tcurl -o /tmp/bmh_crd.yaml --retry-all-errors --retry 5 --retry-delay 10 https://raw.githubusercontent.com/metal3-io/baremetal-operator/refs/heads/main/config/base/crds/bases/metal3.io_baremetalhosts.yaml; \\" - "\toc apply -f /tmp/bmh_crd.yaml; \\" - "\trm -f /tmp/bmh_crd.yaml; \\" - fi - ' % Total % Received % Xferd Average Speed Time Time Time Current' - ' Dload Upload Total Spent Left Speed' - '' - ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0' - 100 61353 100 61353 0 0 624k 0 --:--:-- --:--:-- --:--:-- 624k - customresourcedefinition.apiextensions.k8s.io/baremetalhosts.metal3.io created - oc wait openstack/openstack -n openstack-operators --for condition=Ready --timeout=500s - openstack.operator.openstack.org/openstack condition met - timeout 500s bash -c "while ! (oc get services -n openstack-operators | grep -E '^(openstack|openstack-baremetal|infra)-operator-webhook-service' | wc -l | grep -q -e 3); do sleep 5; done" - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - make wait - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/operator-wait.sh - + TIMEOUT=500s - +++ dirname scripts/operator-wait.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq ']' - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" ]; do sleep 5; done' - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq-cluster ']' - + DEPL_NAME=openstack-operator-controller-manager - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json - ++ jq -e .status.availableReplicas - + REPLICAS=1 - + '[' 1 '!=' 1 ']' - + echo Succeeded - + exit 0 - + rc=0 - + popd - ~/src/github.com/openstack-k8s-operators/install_yamls - + exit 0 - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - make wait - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/operator-wait.sh - + TIMEOUT=500s - +++ dirname scripts/operator-wait.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq ']' - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" ]; do sleep 5; done' - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq-cluster ']' - + DEPL_NAME=openstack-operator-controller-manager - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json - ++ jq -e .status.availableReplicas - + REPLICAS=1 - + '[' 1 '!=' 1 ']' - + echo Succeeded - + exit 0 - + rc=0 - + popd - ~/src/github.com/openstack-k8s-operators/install_yamls - + exit 0 - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - make wait - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/operator-wait.sh - + TIMEOUT=500s - +++ dirname scripts/operator-wait.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq ']' - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" ]; do sleep 5; done' - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq-cluster ']' - + DEPL_NAME=openstack-operator-controller-manager - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json - ++ jq -e .status.availableReplicas - + REPLICAS=1 - + '[' 1 '!=' 1 ']' - + echo Succeeded - + exit 0 - + rc=0 - + popd - ~/src/github.com/openstack-k8s-operators/install_yamls - + exit 0 - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - make wait - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/operator-wait.sh - + TIMEOUT=500s - +++ dirname scripts/operator-wait.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq ']' - + pushd /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - ~/src/github.com/openstack-k8s-operators/install_yamls/scripts ~/src/github.com/openstack-k8s-operators/install_yamls - + timeout 500s bash -c 'until [ "$(bash ./get-operator-status.sh)" == "Succeeded" ]; do sleep 5; done' - + '[' -z openstack-operators ']' - + '[' -z openstack ']' - + '[' openstack = rabbitmq-cluster ']' - + DEPL_NAME=openstack-operator-controller-manager - ++ oc get -n openstack-operators deployment openstack-operator-controller-manager -o json - ++ jq -e .status.availableReplicas - + REPLICAS=1 - + '[' 1 '!=' 1 ']' - + echo Succeeded - + exit 0 - + rc=0 - + popd - ~/src/github.com/openstack-k8s-operators/install_yamls - + exit 0 - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - make openstack_kuttl_run - 'make[1]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - set -e; \ - for test_dir in ctlplane-basic-deployment ctlplane-basic-deployment-with-nicMappings ctlplane-collapsed ctlplane-galera-3replicas ctlplane-galera-basic ctlplane-nodeselectors ctlplane-tls-cert-rotation ctlplane-tls-custom-issuers ctlplane-tls-custom-route dataplane-create-test dataplane-deploy-global-service-test dataplane-deploy-multiple-secrets dataplane-deploy-no-nodes-test dataplane-deploy-tls-test dataplane-extramounts dataplane-multinode-nodeset-create-test dataplane-service-config dataplane-service-custom-image dataplane-service-failure; do \ - ' oc delete osctlplane --all --namespace openstack-kuttl-tests; \' - "\tmake crc_storage_cleanup_with_retries; \\" - "\tmake crc_storage_with_retries; \\" - "\tkubectl-kuttl test --config /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/kuttl-test.yaml /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests --test ${test_dir}; \\" - done - No resources found - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage_cleanup.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage created - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Now using project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/cleanup-crc-pv.sh - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $6}' - ++ grep Bound - No resources found - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $1}' - No resources found - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m7s - storageclass.storage.k8s.io "local-storage" deleted - bash scripts/delete-pv.sh - +++ dirname scripts/delete-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage created - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage created - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role created - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding created - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete - ++ set -ex - ++ NODE=crc - ++ OPERATION=delete - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/create-pv.sh - +++ dirname scripts/create-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get pv -o json - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' - + released= - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create - ++ set -ex - ++ NODE=crc - ++ OPERATION=create - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - bash scripts/gen-crc-pv-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z '"local-storage"' ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' - + mkdir -p /home/zuul/ci-framework-data/artifacts/manifests/crc - + PV_NUM=20 - + STORAGE_CAPACITY=10 - ++ oc get node -o name -l node-role.kubernetes.io/worker - ++ head -c-1 - ++ sed -e 's|node/||' - ++ tr '\n' ' ' - + NODE_NAMES=crc - + '[' -z crc ']' - + cat - + for node in $NODE_NAMES - ++ seq -w 20 - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml - storageclass.storage.k8s.io/local-storage created - 'Warning: resource persistentvolumes/local-storage01-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage01-crc configured - 'Warning: resource persistentvolumes/local-storage02-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage02-crc configured - 'Warning: resource persistentvolumes/local-storage03-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage03-crc configured - 'Warning: resource persistentvolumes/local-storage04-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage04-crc configured - 'Warning: resource persistentvolumes/local-storage05-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage05-crc configured - 'Warning: resource persistentvolumes/local-storage06-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage06-crc configured - 'Warning: resource persistentvolumes/local-storage07-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage07-crc configured - 'Warning: resource persistentvolumes/local-storage08-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage08-crc configured - 'Warning: resource persistentvolumes/local-storage09-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage09-crc configured - 'Warning: resource persistentvolumes/local-storage10-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage10-crc configured - 'Warning: resource persistentvolumes/local-storage11-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage11-crc configured - 'Warning: resource persistentvolumes/local-storage12-crc is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by oc apply. oc apply should only be used on resources created declaratively by either oc create --save-config or oc apply. The missing annotation will be patched automatically.' - persistentvolume/local-storage12-crc configured - persistentvolume/local-storage13-crc created - persistentvolume/local-storage14-crc created - persistentvolume/local-storage15-crc created - persistentvolume/local-storage16-crc created - persistentvolume/local-storage17-crc created - persistentvolume/local-storage18-crc created - persistentvolume/local-storage19-crc created - persistentvolume/local-storage20-crc created - persistentvolumeclaim/ansible-ee-logs created - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - '2025/10/13 19:39:52 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]' - === RUN kuttl - ' harness.go:463: starting setup' - ' harness.go:255: running tests using configured kubeconfig.' - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' - ' logger.go:42: 19:39:52 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' - ' logger.go:42: 19:39:52 | | netconfig.network.openstack.org/netconfig created' - ' logger.go:42: 19:39:52 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' - ' logger.go:42: 19:39:52 | | dnsmasq.network.openstack.org/dnsmasq created' - ' logger.go:42: 19:39:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then' - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' - ' fi' - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' - ' --save-config \' - ' --dry-run=client \' - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' - ' -n openstack-kuttl-tests \' - ' -o yaml | \' - ' oc apply -f -' - ' ]' - ' logger.go:42: 19:39:53 | | Generating public/private rsa key pair.' - ' logger.go:42: 19:39:53 | | Your identification has been saved in ansibleee-ssh-key-id_rsa' - ' logger.go:42: 19:39:53 | | Your public key has been saved in ansibleee-ssh-key-id_rsa.pub' - ' logger.go:42: 19:39:53 | | The key fingerprint is:' - ' logger.go:42: 19:39:53 | | SHA256:VCJuwoD6YMCqjIbrmfxGP1cc3DBS1brr9CZYa6fIhnQ zuul@controller' - ' logger.go:42: 19:39:53 | | The key''s randomart image is:' - ' logger.go:42: 19:39:53 | | +---[RSA 4096]----+' - ' logger.go:42: 19:39:53 | | |... . o.o.. |' - ' logger.go:42: 19:39:53 | | |o. o . o = . |' - ' logger.go:42: 19:39:53 | | |+ o o + + . |' - ' logger.go:42: 19:39:53 | | |+. o . o o |' - ' logger.go:42: 19:39:53 | | |*o S . . |' - ' logger.go:42: 19:39:53 | | |+o.. . E o |' - ' logger.go:42: 19:39:53 | | |... . . + o.o |' - ' logger.go:42: 19:39:53 | | |o o. o o.oo=.o |' - ' logger.go:42: 19:39:53 | | |.=o. o .ooo=. |' - ' logger.go:42: 19:39:53 | | +----[SHA256]-----+' - ' logger.go:42: 19:39:53 | | secret/dataplane-ansible-ssh-private-key-secret created' - ' harness.go:363: running tests' - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each step' - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests' - === RUN kuttl/harness - === RUN kuttl/harness/ctlplane-basic-deployment - === PAUSE kuttl/harness/ctlplane-basic-deployment - === RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings - === PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings - === CONT kuttl/harness/ctlplane-basic-deployment - ' logger.go:42: 19:39:53 | ctlplane-basic-deployment | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack | starting test step 1-deploy-openstack' - ' logger.go:42: 19:39:53 | ctlplane-basic-deployment/1-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 19:39:54 | ctlplane-basic-deployment/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created' - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/1-deploy-openstack | test step completed 1-deploy-openstack' - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | starting test step 2-deploy-custom-cacert-secret' - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | running command: [sh -c oc apply -n $NAMESPACE -f ../../common/custom-ca.yaml' - ' ]' - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | secret/ca-custom-kuttl created' - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/2-deploy-custom-cacert-secret | test step completed 2-deploy-custom-cacert-secret' - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/3-deploy-custom-cacert | starting test step 3-deploy-custom-cacert' - ' logger.go:42: 19:44:54 | ctlplane-basic-deployment/3-deploy-custom-cacert | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_ca | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert | openstackcontrolplane.core.openstack.org/openstack configured' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/3-deploy-custom-cacert | test step completed 3-deploy-custom-cacert' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | starting test step 4-' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | running command: [sh -c echo "Checking ca-custom-kuttl.pem is present in combined-ca-bundle..."' - ' CUSTOM_CERT_CONTENT=$(oc get secret ca-custom-kuttl -n $NAMESPACE -o jsonpath="{.data[''ca-custom-kuttl\.pem'']}" | base64 --decode | tr -d ''\n'')' - ' TLS_BUNDLE_CONTENT=$(oc get secret combined-ca-bundle -n $NAMESPACE -o jsonpath="{.data[''tls-ca-bundle\.pem'']}" | base64 --decode | tr -d ''\n'')' - ' if [[ "$TLS_BUNDLE_CONTENT" == *"$CUSTOM_CERT_CONTENT"* ]]; then' - ' echo "OK"' - ' exit 0' - ' else' - ' echo "Not present"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | Checking ca-custom-kuttl.pem is present in combined-ca-bundle...' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | OK' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/4- | test step completed 4-' - ' logger.go:42: 19:44:59 | ctlplane-basic-deployment/5-cleanup | starting test step 5-cleanup' - ' logger.go:42: 19:45:01 | ctlplane-basic-deployment/5-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' - ' srv-swift-storage-0' - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' - ' oc delete secret -l service-cert -n $NAMESPACE' - ' oc delete secret -l ca-cert -n $NAMESPACE' - ' ]' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "combined-ca-bundle" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-barbican-internal-svc" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-barbican-public-route" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-barbican-public-svc" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-ceilometer-internal-svc" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-cinder-internal-svc" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-cinder-public-route" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-cinder-public-svc" deleted' - ' logger.go:42: 19:45:02 | ctlplane-basic-deployment/5-cleanup | secret "cert-galera-openstack-cell1-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-galera-openstack-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-glance-default-internal-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-glance-default-public-route" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-glance-default-public-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-keystone-internal-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-keystone-public-route" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-keystone-public-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-kube-state-metrics-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-memcached-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-internal-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-ovndbs" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-public-route" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-neutron-public-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-internal-svc" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-novncproxy-cell1-public-route" deleted' - ' logger.go:42: 19:45:03 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-public-route" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-nova-public-svc" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovn-metrics" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovndbcluster-nb-ovndbs" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovndbcluster-sb-ovndbs" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-ovnnorthd-ovndbs" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-placement-internal-svc" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-placement-public-route" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-placement-public-svc" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-rabbitmq-cell1-svc" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-rabbitmq-svc" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-swift-internal-svc" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-swift-public-route" deleted' - ' logger.go:42: 19:45:04 | ctlplane-basic-deployment/5-cleanup | secret "cert-swift-public-svc" deleted' - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-internal" deleted' - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-libvirt" deleted' - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-ovn" deleted' - ' logger.go:42: 19:45:10 | ctlplane-basic-deployment/5-cleanup | secret "rootca-public" deleted' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment/5-cleanup | test step completed 5-cleanup' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment | skipping kubernetes event logging' - === CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | starting test step 1-create-nic-mappings' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml' - ' ]' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | networkattachmentdefinition.k8s.cni.cncf.io/datacentre configured' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | test step completed 1-create-nic-mappings' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | starting test step 2-deploy-openstack' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 19:45:42 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created' - ' logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | test step completed 2-deploy-openstack' - ' logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | starting test step 3-add-ovn-nic-mappings' - ' logger.go:42: 19:50:07 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack --type=''json'' -p=''[{' - ' "op": "replace",' - ' "path": "/spec/ovn/template/ovnController/nicMappings",' - ' "value":{"datacentre":"ospbr"}' - ' }]''' - ' ]' - ' logger.go:42: 19:50:08 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched' - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | test step completed 3-add-ovn-nic-mappings' - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | starting test step 4-remove-ovn-nic-mappings' - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack --type=''json'' -p=''[{' - ' "op": "remove",' - ' "path": "/spec/ovn/template/ovnController/nicMappings",' - ' }]''' - ' ]' - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched' - ' logger.go:42: 19:50:14 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:16 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:17 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:18 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:20 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:21 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:22 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:24 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:25 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:27 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:28 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:29 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:31 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:32 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:33 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:35 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:36 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:37 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:39 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:40 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:41 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:43 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:44 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:45 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:47 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | test step completed 4-remove-ovn-nic-mappings' - ' logger.go:42: 19:50:48 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | starting test step 5-cleanup' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' - ' srv-swift-storage-0' - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' - ' oc delete secret -l service-cert -n $NAMESPACE' - ' oc delete secret -l ca-cert -n $NAMESPACE' - ' ]' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "combined-ca-bundle" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-barbican-internal-svc" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-barbican-public-route" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-barbican-public-svc" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ceilometer-internal-svc" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-cinder-internal-svc" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-cinder-public-route" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-cinder-public-svc" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-galera-openstack-cell1-svc" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-galera-openstack-svc" deleted' - ' logger.go:42: 19:50:49 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-glance-default-internal-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-glance-default-public-route" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-glance-default-public-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-keystone-internal-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-keystone-public-route" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-keystone-public-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-kube-state-metrics-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-memcached-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-internal-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-ovndbs" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-public-route" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-public-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-internal-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-novncproxy-cell1-public-route" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-public-route" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-public-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovn-metrics" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovncontroller-ovndbs" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovndbcluster-nb-ovndbs" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovndbcluster-sb-ovndbs" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovnnorthd-ovndbs" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-placement-internal-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-placement-public-route" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-placement-public-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-rabbitmq-cell1-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-rabbitmq-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-swift-internal-svc" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-swift-public-route" deleted' - ' logger.go:42: 19:50:50 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-swift-public-svc" deleted' - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-internal" deleted' - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-libvirt" deleted' - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-ovn" deleted' - ' logger.go:42: 19:50:56 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-public" deleted' - ' logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | test step completed 5-cleanup' - ' logger.go:42: 19:51:22 | ctlplane-basic-deployment-with-nicMappings | skipping kubernetes event logging' - === NAME kuttl - ' harness.go:406: run tests finished' - ' harness.go:514: cleaning up' - ' harness.go:571: removing temp folder: ""' - '--- PASS: kuttl (689.89s)' - ' --- PASS: kuttl/harness (0.00s)' - ' --- PASS: kuttl/harness/ctlplane-basic-deployment (348.38s)' - ' --- PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings (340.23s)' - PASS - No resources found - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage_cleanup.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/cleanup-crc-pv.sh - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $6}' - ++ grep Bound - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 2 - + NAME=swift-swift-storage-0 - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found - persistentvolumeclaim "swift-swift-storage-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ cut -d / -f 2 - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - + NAME=glance-glance-default-internal-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 - ++ cut -d / -f 2 - + NAME=mysql-db-openstack-cell1-galera-0 - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found - persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ cut -d / -f 1 - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-external-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-external-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 2 - + NAME=mysql-db-openstack-galera-0 - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted - ++ awk '{print $1}' - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage01-crc - persistentvolume "local-storage01-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage02-crc - persistentvolume "local-storage02-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage03-crc - persistentvolume "local-storage03-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage04-crc - persistentvolume "local-storage04-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage05-crc - persistentvolume "local-storage05-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage06-crc - persistentvolume "local-storage06-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage07-crc - persistentvolume "local-storage07-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage08-crc - persistentvolume "local-storage08-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage09-crc - persistentvolume "local-storage09-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage10-crc - persistentvolume "local-storage10-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage11-crc - persistentvolume "local-storage11-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage12-crc - persistentvolume "local-storage12-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage13-crc - persistentvolume "local-storage13-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage14-crc - persistentvolume "local-storage14-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage15-crc - persistentvolume "local-storage15-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage16-crc - persistentvolume "local-storage16-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage17-crc - persistentvolume "local-storage17-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage18-crc - persistentvolume "local-storage18-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage19-crc - persistentvolume "local-storage19-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage20-crc - persistentvolume "local-storage20-crc" deleted - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 11m - storageclass.storage.k8s.io "local-storage" deleted - bash scripts/delete-pv.sh - +++ dirname scripts/delete-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete - ++ set -ex - ++ NODE=crc - ++ OPERATION=delete - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/create-pv.sh - +++ dirname scripts/create-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get pv -o json - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' - + released= - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create - ++ set -ex - ++ NODE=crc - ++ OPERATION=create - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - bash scripts/gen-crc-pv-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z '"local-storage"' ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' - + PV_NUM=20 - + STORAGE_CAPACITY=10 - ++ oc get node -o name -l node-role.kubernetes.io/worker - ++ head -c-1 - ++ tr '\n' ' ' - ++ sed -e 's|node/||' - + NODE_NAMES=crc - + '[' -z crc ']' - + cat - + for node in $NODE_NAMES - ++ seq -w 20 - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml - storageclass.storage.k8s.io/local-storage created - persistentvolume/local-storage01-crc created - persistentvolume/local-storage02-crc created - persistentvolume/local-storage03-crc created - persistentvolume/local-storage04-crc created - persistentvolume/local-storage05-crc created - persistentvolume/local-storage06-crc created - persistentvolume/local-storage07-crc created - persistentvolume/local-storage08-crc created - persistentvolume/local-storage09-crc created - persistentvolume/local-storage10-crc created - persistentvolume/local-storage11-crc created - persistentvolume/local-storage12-crc created - persistentvolume/local-storage13-crc created - persistentvolume/local-storage14-crc created - persistentvolume/local-storage15-crc created - persistentvolume/local-storage16-crc created - persistentvolume/local-storage17-crc created - persistentvolume/local-storage18-crc created - persistentvolume/local-storage19-crc created - persistentvolume/local-storage20-crc created - persistentvolumeclaim/ansible-ee-logs unchanged - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - '2025/10/13 19:51:44 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]' - === RUN kuttl - ' harness.go:463: starting setup' - ' harness.go:255: running tests using configured kubeconfig.' - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' - ' logger.go:42: 19:51:44 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' - ' logger.go:42: 19:51:44 | | netconfig.network.openstack.org/netconfig configured' - ' logger.go:42: 19:51:44 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' - ' logger.go:42: 19:51:45 | | dnsmasq.network.openstack.org/dnsmasq configured' - ' logger.go:42: 19:51:45 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then' - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' - ' fi' - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' - ' --save-config \' - ' --dry-run=client \' - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' - ' -n openstack-kuttl-tests \' - ' -o yaml | \' - ' oc apply -f -' - ' ]' - ' logger.go:42: 19:51:45 | | secret/dataplane-ansible-ssh-private-key-secret configured' - ' harness.go:363: running tests' - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each step' - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests' - === RUN kuttl/harness - === RUN kuttl/harness/ctlplane-basic-deployment-with-nicMappings - === PAUSE kuttl/harness/ctlplane-basic-deployment-with-nicMappings - === CONT kuttl/harness/ctlplane-basic-deployment-with-nicMappings - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | starting test step 1-create-nic-mappings' - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/nad_datacentre.yaml' - ' ]' - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | networkattachmentdefinition.k8s.cni.cncf.io/datacentre unchanged' - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/1-create-nic-mappings | test step completed 1-create-nic-mappings' - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | starting test step 2-deploy-openstack' - ' logger.go:42: 19:51:45 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 19:51:46 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created' - ' logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/2-deploy-openstack | test step completed 2-deploy-openstack' - ' logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | starting test step 3-add-ovn-nic-mappings' - ' logger.go:42: 19:55:57 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack --type=''json'' -p=''[{' - ' "op": "replace",' - ' "path": "/spec/ovn/template/ovnController/nicMappings",' - ' "value":{"datacentre":"ospbr"}' - ' }]''' - ' ]' - ' logger.go:42: 19:55:58 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched' - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/3-add-ovn-nic-mappings | test step completed 3-add-ovn-nic-mappings' - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | starting test step 4-remove-ovn-nic-mappings' - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c oc patch OpenStackControlPlane -n $NAMESPACE openstack --type=''json'' -p=''[{' - ' "op": "remove",' - ' "path": "/spec/ovn/template/ovnController/nicMappings",' - ' }]''' - ' ]' - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | openstackcontrolplane.core.openstack.org/openstack patched' - ' logger.go:42: 19:56:03 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:56:04 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:56:06 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | running command: [sh -c ovs_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller-ovs --no-headers=true --ignore-not-found=true | wc -l)' - ' ovn_controller_pod_count=$(oc get pod -n $NAMESPACE -l service=ovn-controller --no-headers=true --ignore-not-found=true | wc -l)' - ' if [ $ovs_controller_pod_count -eq 0 ] && [ $ovn_controller_pod_count -eq 0 ]; then' - ' exit 0' - ' fi' - ' exit 1' - ' ]' - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | Unable to connect to the server: dial tcp: lookup api.crc.testing on 199.204.44.24:53: no such host' - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/4-remove-ovn-nic-mappings | test step completed 4-remove-ovn-nic-mappings' - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | starting test step 5-cleanup' - ' logger.go:42: 19:56:11 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' - ' srv-swift-storage-0' - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' - ' oc delete secret -l service-cert -n $NAMESPACE' - ' oc delete secret -l ca-cert -n $NAMESPACE' - ' ]' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "combined-ca-bundle" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-barbican-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-barbican-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-barbican-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ceilometer-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-cinder-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-cinder-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-cinder-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-galera-openstack-cell1-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-galera-openstack-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-glance-default-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-glance-default-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-glance-default-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-keystone-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-keystone-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-keystone-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-kube-state-metrics-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-memcached-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-ovndbs" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-neutron-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-novncproxy-cell1-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-nova-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovn-metrics" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovncontroller-ovndbs" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovndbcluster-nb-ovndbs" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovndbcluster-sb-ovndbs" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-ovnnorthd-ovndbs" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-placement-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-placement-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-placement-public-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-rabbitmq-cell1-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-rabbitmq-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-swift-internal-svc" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-swift-public-route" deleted' - ' logger.go:42: 19:56:12 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "cert-swift-public-svc" deleted' - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-internal" deleted' - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-libvirt" deleted' - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-ovn" deleted' - ' logger.go:42: 19:56:19 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | secret "rootca-public" deleted' - ' logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings/5-cleanup | test step completed 5-cleanup' - ' logger.go:42: 19:56:45 | ctlplane-basic-deployment-with-nicMappings | skipping kubernetes event logging' - === NAME kuttl - ' harness.go:406: run tests finished' - ' harness.go:514: cleaning up' - ' harness.go:571: removing temp folder: ""' - '--- PASS: kuttl (301.64s)' - ' --- PASS: kuttl/harness (0.00s)' - ' --- PASS: kuttl/harness/ctlplane-basic-deployment-with-nicMappings (300.23s)' - PASS - No resources found - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage_cleanup.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/cleanup-crc-pv.sh - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $6}' - ++ grep Bound - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-external-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-external-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 2 - + NAME=mysql-db-openstack-galera-0 - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 - ++ cut -d / -f 2 - + NAME=mysql-db-openstack-cell1-galera-0 - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found - persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-internal-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 2 - + NAME=swift-swift-storage-0 - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found - persistentvolumeclaim "swift-swift-storage-0" deleted - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $1}' - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage01-crc - persistentvolume "local-storage01-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage02-crc - persistentvolume "local-storage02-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage03-crc - persistentvolume "local-storage03-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage04-crc - persistentvolume "local-storage04-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage05-crc - persistentvolume "local-storage05-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage06-crc - persistentvolume "local-storage06-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage07-crc - persistentvolume "local-storage07-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage08-crc - persistentvolume "local-storage08-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage09-crc - persistentvolume "local-storage09-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage10-crc - persistentvolume "local-storage10-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage11-crc - persistentvolume "local-storage11-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage12-crc - persistentvolume "local-storage12-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage13-crc - persistentvolume "local-storage13-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage14-crc - persistentvolume "local-storage14-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage15-crc - persistentvolume "local-storage15-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage16-crc - persistentvolume "local-storage16-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage17-crc - persistentvolume "local-storage17-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage18-crc - persistentvolume "local-storage18-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage19-crc - persistentvolume "local-storage19-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage20-crc - persistentvolume "local-storage20-crc" deleted - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m11s - storageclass.storage.k8s.io "local-storage" deleted - bash scripts/delete-pv.sh - +++ dirname scripts/delete-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete - ++ set -ex - ++ NODE=crc - ++ OPERATION=delete - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/create-pv.sh - +++ dirname scripts/create-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get pv -o json - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' - + released= - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create - ++ set -ex - ++ NODE=crc - ++ OPERATION=create - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - bash scripts/gen-crc-pv-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z '"local-storage"' ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' - + PV_NUM=20 - + STORAGE_CAPACITY=10 - ++ oc get node -o name -l node-role.kubernetes.io/worker - ++ head -c-1 - ++ sed -e 's|node/||' - ++ tr '\n' ' ' - + NODE_NAMES=crc - + '[' -z crc ']' - + cat - + for node in $NODE_NAMES - ++ seq -w 20 - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml - storageclass.storage.k8s.io/local-storage created - persistentvolume/local-storage01-crc created - persistentvolume/local-storage02-crc created - persistentvolume/local-storage03-crc created - persistentvolume/local-storage04-crc created - persistentvolume/local-storage05-crc created - persistentvolume/local-storage06-crc created - persistentvolume/local-storage07-crc created - persistentvolume/local-storage08-crc created - persistentvolume/local-storage09-crc created - persistentvolume/local-storage10-crc created - persistentvolume/local-storage11-crc created - persistentvolume/local-storage12-crc created - persistentvolume/local-storage13-crc created - persistentvolume/local-storage14-crc created - persistentvolume/local-storage15-crc created - persistentvolume/local-storage16-crc created - persistentvolume/local-storage17-crc created - persistentvolume/local-storage18-crc created - persistentvolume/local-storage19-crc created - persistentvolume/local-storage20-crc created - persistentvolumeclaim/ansible-ee-logs unchanged - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - '2025/10/13 19:57:08 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]' - === RUN kuttl - ' harness.go:463: starting setup' - ' harness.go:255: running tests using configured kubeconfig.' - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' - ' logger.go:42: 19:57:08 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' - ' logger.go:42: 19:57:08 | | netconfig.network.openstack.org/netconfig configured' - ' logger.go:42: 19:57:08 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' - ' logger.go:42: 19:57:09 | | dnsmasq.network.openstack.org/dnsmasq configured' - ' logger.go:42: 19:57:09 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then' - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' - ' fi' - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' - ' --save-config \' - ' --dry-run=client \' - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' - ' -n openstack-kuttl-tests \' - ' -o yaml | \' - ' oc apply -f -' - ' ]' - ' logger.go:42: 19:57:09 | | secret/dataplane-ansible-ssh-private-key-secret configured' - ' harness.go:363: running tests' - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each step' - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests' - === RUN kuttl/harness - === RUN kuttl/harness/ctlplane-collapsed - === PAUSE kuttl/harness/ctlplane-collapsed - === CONT kuttl/harness/ctlplane-collapsed - ' logger.go:42: 19:57:09 | ctlplane-collapsed | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | starting test step 0-deps' - ' logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | running command: [sh -c oc apply -f ../../common/rhobs.yaml' - ' until oc api-resources | grep -q rhobs; do sleep 1; done' - ' ]' - ' logger.go:42: 19:57:09 | ctlplane-collapsed/0-deps | subscription.operators.coreos.com/cluster-observability-operator created' - ' logger.go:42: 19:57:25 | ctlplane-collapsed/0-deps | test step completed 0-deps' - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | starting test step 1-deploy-openstack-collapsed-cell' - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_collapsed_cell.yaml' - ' ]' - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 19:57:25 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | openstackcontrolplane.core.openstack.org/openstack-collapsed-cell created' - ' logger.go:42: 20:01:51 | ctlplane-collapsed/1-deploy-openstack-collapsed-cell | test step completed 1-deploy-openstack-collapsed-cell' - ' logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | starting test step 2-cleanup' - ' logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | running command: [sh -c oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' - ' oc delete secret -l service-cert -n $NAMESPACE' - ' oc delete secret -l ca-cert -n $NAMESPACE' - ' ]' - ' logger.go:42: 20:01:51 | ctlplane-collapsed/2-cleanup | secret "combined-ca-bundle" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-barbican-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-barbican-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-barbican-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ceilometer-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-cinder-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-cinder-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-cinder-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-galera-openstack-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-glance-default-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-glance-default-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-glance-default-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-keystone-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-keystone-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-keystone-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-kube-state-metrics-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-memcached-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-metric-storage-prometheus-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-ovndbs" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-neutron-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-novncproxy-cell1-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-nova-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovn-metrics" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovndbcluster-nb-ovndbs" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovndbcluster-sb-ovndbs" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-ovnnorthd-ovndbs" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-placement-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-placement-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-placement-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-rabbitmq-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-swift-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-swift-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-swift-public-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-watcher-internal-svc" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-watcher-public-route" deleted' - ' logger.go:42: 20:01:52 | ctlplane-collapsed/2-cleanup | secret "cert-watcher-public-svc" deleted' - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-internal" deleted' - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-libvirt" deleted' - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-ovn" deleted' - ' logger.go:42: 20:01:59 | ctlplane-collapsed/2-cleanup | secret "rootca-public" deleted' - ' logger.go:42: 20:02:25 | ctlplane-collapsed/2-cleanup | test step completed 2-cleanup' - ' logger.go:42: 20:02:25 | ctlplane-collapsed | skipping kubernetes event logging' - === NAME kuttl - ' harness.go:406: run tests finished' - ' harness.go:514: cleaning up' - ' harness.go:571: removing temp folder: ""' - '--- PASS: kuttl (317.74s)' - ' --- PASS: kuttl/harness (0.00s)' - ' --- PASS: kuttl/harness/ctlplane-collapsed (316.26s)' - PASS - No resources found - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage_cleanup.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/cleanup-crc-pv.sh - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $6}' - ++ grep Bound - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-external-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-external-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-internal-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 2 - + NAME=swift-swift-storage-0 - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found - persistentvolumeclaim "swift-swift-storage-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 2 - + NAME=mysql-db-openstack-galera-0 - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $1}' - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage01-crc - persistentvolume "local-storage01-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage02-crc - persistentvolume "local-storage02-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage03-crc - persistentvolume "local-storage03-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage04-crc - persistentvolume "local-storage04-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage05-crc - persistentvolume "local-storage05-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage06-crc - persistentvolume "local-storage06-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage07-crc - persistentvolume "local-storage07-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage08-crc - persistentvolume "local-storage08-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage09-crc - persistentvolume "local-storage09-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage10-crc - persistentvolume "local-storage10-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage11-crc - persistentvolume "local-storage11-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage12-crc - persistentvolume "local-storage12-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage13-crc - persistentvolume "local-storage13-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage14-crc - persistentvolume "local-storage14-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage15-crc - persistentvolume "local-storage15-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage16-crc - persistentvolume "local-storage16-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage17-crc - persistentvolume "local-storage17-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage18-crc - persistentvolume "local-storage18-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage19-crc - persistentvolume "local-storage19-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage20-crc - persistentvolume "local-storage20-crc" deleted - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m26s - storageclass.storage.k8s.io "local-storage" deleted - bash scripts/delete-pv.sh - +++ dirname scripts/delete-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ oc apply -f - - ++ cat - serviceaccount/crc-storage unchanged - ++ oc apply -f - - ++ cat - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete - ++ set -ex - ++ NODE=crc - ++ OPERATION=delete - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/create-pv.sh - +++ dirname scripts/create-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get pv -o json - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' - + released= - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create - ++ set -ex - ++ NODE=crc - ++ OPERATION=create - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - bash scripts/gen-crc-pv-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z '"local-storage"' ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' - + PV_NUM=20 - + STORAGE_CAPACITY=10 - ++ oc get node -o name -l node-role.kubernetes.io/worker - ++ head -c-1 - ++ sed -e 's|node/||' - ++ tr '\n' ' ' - + NODE_NAMES=crc - + '[' -z crc ']' - + cat - + for node in $NODE_NAMES - ++ seq -w 20 - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml - storageclass.storage.k8s.io/local-storage created - persistentvolume/local-storage01-crc created - persistentvolume/local-storage02-crc created - persistentvolume/local-storage03-crc created - persistentvolume/local-storage04-crc created - persistentvolume/local-storage05-crc created - persistentvolume/local-storage06-crc created - persistentvolume/local-storage07-crc created - persistentvolume/local-storage08-crc created - persistentvolume/local-storage09-crc created - persistentvolume/local-storage10-crc created - persistentvolume/local-storage11-crc created - persistentvolume/local-storage12-crc created - persistentvolume/local-storage13-crc created - persistentvolume/local-storage14-crc created - persistentvolume/local-storage15-crc created - persistentvolume/local-storage16-crc created - persistentvolume/local-storage17-crc created - persistentvolume/local-storage18-crc created - persistentvolume/local-storage19-crc created - persistentvolume/local-storage20-crc created - persistentvolumeclaim/ansible-ee-logs unchanged - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - '2025/10/13 20:02:47 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]' - === RUN kuttl - ' harness.go:463: starting setup' - ' harness.go:255: running tests using configured kubeconfig.' - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' - ' logger.go:42: 20:02:47 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' - ' logger.go:42: 20:02:51 | | netconfig.network.openstack.org/netconfig configured' - ' logger.go:42: 20:02:51 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' - ' logger.go:42: 20:02:52 | | dnsmasq.network.openstack.org/dnsmasq configured' - ' logger.go:42: 20:02:52 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then' - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' - ' fi' - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' - ' --save-config \' - ' --dry-run=client \' - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' - ' -n openstack-kuttl-tests \' - ' -o yaml | \' - ' oc apply -f -' - ' ]' - ' logger.go:42: 20:02:52 | | secret/dataplane-ansible-ssh-private-key-secret configured' - ' harness.go:363: running tests' - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each step' - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests' - === RUN kuttl/harness - === RUN kuttl/harness/ctlplane-galera-3replicas - === PAUSE kuttl/harness/ctlplane-galera-3replicas - === CONT kuttl/harness/ctlplane-galera-3replicas - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | starting test step 1-deploy-galera-3replicas' - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera_3replicas.yaml' - ' ]' - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:02:52 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | openstackcontrolplane.core.openstack.org/openstack-galera-3replicas created' - ' logger.go:42: 20:07:10 | ctlplane-galera-3replicas/1-deploy-galera-3replicas | test step completed 1-deploy-galera-3replicas' - ' logger.go:42: 20:07:10 | ctlplane-galera-3replicas/2-cleanup | starting test step 2-cleanup' - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' - ' mysql-db-openstack-galera-0 \' - ' mysql-db-openstack-galera-1 \' - ' mysql-db-openstack-galera-2 \' - ' mysql-db-openstack-cell1-galera-0 \' - ' mysql-db-openstack-cell1-galera-1 \' - ' mysql-db-openstack-cell1-galera-2' - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' - ' oc delete secret -l service-cert -n $NAMESPACE' - ' oc delete secret -l ca-cert -n $NAMESPACE' - ' ]' - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim "mysql-db-openstack-galera-0" deleted' - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim "mysql-db-openstack-galera-1" deleted' - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim "mysql-db-openstack-galera-2" deleted' - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted' - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim "mysql-db-openstack-cell1-galera-1" deleted' - ' logger.go:42: 20:07:11 | ctlplane-galera-3replicas/2-cleanup | persistentvolumeclaim "mysql-db-openstack-cell1-galera-2" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "combined-ca-bundle" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-barbican-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-barbican-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-barbican-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ceilometer-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-cinder-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-cinder-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-cinder-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-galera-openstack-cell1-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-galera-openstack-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-glance-default-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-glance-default-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-glance-default-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-keystone-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-keystone-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-keystone-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-kube-state-metrics-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-memcached-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-ovndbs" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-neutron-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-novncproxy-cell1-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-nova-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovn-metrics" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovndbcluster-nb-ovndbs" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovndbcluster-sb-ovndbs" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-ovnnorthd-ovndbs" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-placement-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-placement-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-placement-public-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-rabbitmq-cell1-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-rabbitmq-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-swift-internal-svc" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-swift-public-route" deleted' - ' logger.go:42: 20:07:26 | ctlplane-galera-3replicas/2-cleanup | secret "cert-swift-public-svc" deleted' - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-internal" deleted' - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-libvirt" deleted' - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-ovn" deleted' - ' logger.go:42: 20:07:32 | ctlplane-galera-3replicas/2-cleanup | secret "rootca-public" deleted' - ' logger.go:42: 20:07:44 | ctlplane-galera-3replicas/2-cleanup | test step completed 2-cleanup' - ' logger.go:42: 20:07:44 | ctlplane-galera-3replicas | skipping kubernetes event logging' - === NAME kuttl - ' harness.go:406: run tests finished' - ' harness.go:514: cleaning up' - ' harness.go:571: removing temp folder: ""' - '--- PASS: kuttl (297.42s)' - ' --- PASS: kuttl/harness (0.00s)' - ' --- PASS: kuttl/harness/ctlplane-galera-3replicas (292.40s)' - PASS - No resources found - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage_cleanup.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/cleanup-crc-pv.sh - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $6}' - ++ grep Bound - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 2 - + NAME=swift-swift-storage-0 - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found - persistentvolumeclaim "swift-swift-storage-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-internal-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ cut -d / -f 1 - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-external-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-external-api-0" deleted - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $1}' - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage01-crc - persistentvolume "local-storage01-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage02-crc - persistentvolume "local-storage02-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage03-crc - persistentvolume "local-storage03-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage04-crc - persistentvolume "local-storage04-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage05-crc - persistentvolume "local-storage05-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage06-crc - persistentvolume "local-storage06-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage07-crc - persistentvolume "local-storage07-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage08-crc - persistentvolume "local-storage08-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage09-crc - persistentvolume "local-storage09-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage10-crc - persistentvolume "local-storage10-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage11-crc - persistentvolume "local-storage11-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage12-crc - persistentvolume "local-storage12-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage13-crc - persistentvolume "local-storage13-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage14-crc - persistentvolume "local-storage14-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage15-crc - persistentvolume "local-storage15-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage16-crc - persistentvolume "local-storage16-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage17-crc - persistentvolume "local-storage17-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage18-crc - persistentvolume "local-storage18-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage19-crc - persistentvolume "local-storage19-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage20-crc - persistentvolume "local-storage20-crc" deleted - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 5m6s - storageclass.storage.k8s.io "local-storage" deleted - bash scripts/delete-pv.sh - +++ dirname scripts/delete-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete - ++ set -ex - ++ NODE=crc - ++ OPERATION=delete - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/create-pv.sh - +++ dirname scripts/create-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ oc apply -f - - ++ cat - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get pv -o json - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' - + released= - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create - ++ set -ex - ++ NODE=crc - ++ OPERATION=create - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - bash scripts/gen-crc-pv-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z '"local-storage"' ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' - + PV_NUM=20 - + STORAGE_CAPACITY=10 - ++ oc get node -o name -l node-role.kubernetes.io/worker - ++ head -c-1 - ++ tr '\n' ' ' - ++ sed -e 's|node/||' - + NODE_NAMES=crc - + '[' -z crc ']' - + cat - + for node in $NODE_NAMES - ++ seq -w 20 - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml - storageclass.storage.k8s.io/local-storage created - persistentvolume/local-storage01-crc created - persistentvolume/local-storage02-crc created - persistentvolume/local-storage03-crc created - persistentvolume/local-storage04-crc created - persistentvolume/local-storage05-crc created - persistentvolume/local-storage06-crc created - persistentvolume/local-storage07-crc created - persistentvolume/local-storage08-crc created - persistentvolume/local-storage09-crc created - persistentvolume/local-storage10-crc created - persistentvolume/local-storage11-crc created - persistentvolume/local-storage12-crc created - persistentvolume/local-storage13-crc created - persistentvolume/local-storage14-crc created - persistentvolume/local-storage15-crc created - persistentvolume/local-storage16-crc created - persistentvolume/local-storage17-crc created - persistentvolume/local-storage18-crc created - persistentvolume/local-storage19-crc created - persistentvolume/local-storage20-crc created - persistentvolumeclaim/ansible-ee-logs unchanged - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - '2025/10/13 20:08:06 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]' - === RUN kuttl - ' harness.go:463: starting setup' - ' harness.go:255: running tests using configured kubeconfig.' - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' - ' logger.go:42: 20:08:06 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' - ' logger.go:42: 20:08:07 | | netconfig.network.openstack.org/netconfig configured' - ' logger.go:42: 20:08:07 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' - ' logger.go:42: 20:08:07 | | dnsmasq.network.openstack.org/dnsmasq configured' - ' logger.go:42: 20:08:07 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then' - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' - ' fi' - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' - ' --save-config \' - ' --dry-run=client \' - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' - ' -n openstack-kuttl-tests \' - ' -o yaml | \' - ' oc apply -f -' - ' ]' - ' logger.go:42: 20:08:07 | | secret/dataplane-ansible-ssh-private-key-secret configured' - ' harness.go:363: running tests' - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each step' - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests' - === RUN kuttl/harness - === RUN kuttl/harness/ctlplane-galera-basic - === PAUSE kuttl/harness/ctlplane-galera-basic - === CONT kuttl/harness/ctlplane-galera-basic - ' logger.go:42: 20:08:07 | ctlplane-galera-basic | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera | starting test step 1-deploy-galera' - ' logger.go:42: 20:08:07 | ctlplane-galera-basic/1-deploy-galera | running command: [sh -c oc apply -n $NAMESPACE -f ../../../../config/samples/core_v1beta1_openstackcontrolplane_galera.yaml' - ' ]' - ' logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:08:08 | ctlplane-galera-basic/1-deploy-galera | openstackcontrolplane.core.openstack.org/openstack-galera created' - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/1-deploy-galera | test step completed 1-deploy-galera' - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | starting test step 2-cleanup' - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | running command: [sh -c oc delete --ignore-not-found=true -n $NAMESPACE pvc \' - ' mysql-db-openstack-galera-0 \' - ' mysql-db-openstack-cell1-galera-0 \' - ' srv-swift-storage-0' - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' - ' oc delete secret -l service-cert -n $NAMESPACE' - ' oc delete secret -l ca-cert -n $NAMESPACE' - ' ]' - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | persistentvolumeclaim "mysql-db-openstack-galera-0" deleted' - ' logger.go:42: 20:12:05 | ctlplane-galera-basic/2-cleanup | persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "combined-ca-bundle" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-barbican-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-barbican-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-barbican-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ceilometer-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-cinder-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-cinder-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-cinder-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-galera-openstack-cell1-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-galera-openstack-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-glance-default-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-glance-default-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-glance-default-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-keystone-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-keystone-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-keystone-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-kube-state-metrics-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-memcached-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-ovndbs" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-neutron-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-novncproxy-cell1-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-nova-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovn-metrics" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovndbcluster-nb-ovndbs" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovndbcluster-sb-ovndbs" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-ovnnorthd-ovndbs" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-placement-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-placement-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-placement-public-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-rabbitmq-cell1-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-rabbitmq-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-swift-internal-svc" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-swift-public-route" deleted' - ' logger.go:42: 20:12:14 | ctlplane-galera-basic/2-cleanup | secret "cert-swift-public-svc" deleted' - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-internal" deleted' - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-libvirt" deleted' - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-ovn" deleted' - ' logger.go:42: 20:12:20 | ctlplane-galera-basic/2-cleanup | secret "rootca-public" deleted' - ' logger.go:42: 20:12:39 | ctlplane-galera-basic/2-cleanup | test step completed 2-cleanup' - ' logger.go:42: 20:12:39 | ctlplane-galera-basic | skipping kubernetes event logging' - === NAME kuttl - ' harness.go:406: run tests finished' - ' harness.go:514: cleaning up' - ' harness.go:571: removing temp folder: ""' - '--- PASS: kuttl (272.65s)' - ' --- PASS: kuttl/harness (0.00s)' - ' --- PASS: kuttl/harness/ctlplane-galera-basic (271.12s)' - PASS - No resources found - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage_cleanup.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/cleanup-crc-pv.sh - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $6}' - ++ grep Bound - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 2 - + NAME=swift-swift-storage-0 - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found - persistentvolumeclaim "swift-swift-storage-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-internal-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-external-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-external-api-0" deleted - ++ awk '{print $1}' - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage01-crc - persistentvolume "local-storage01-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage02-crc - persistentvolume "local-storage02-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage03-crc - persistentvolume "local-storage03-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage04-crc - persistentvolume "local-storage04-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage05-crc - persistentvolume "local-storage05-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage06-crc - persistentvolume "local-storage06-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage07-crc - persistentvolume "local-storage07-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage08-crc - persistentvolume "local-storage08-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage09-crc - persistentvolume "local-storage09-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage10-crc - persistentvolume "local-storage10-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage11-crc - persistentvolume "local-storage11-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage12-crc - persistentvolume "local-storage12-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage13-crc - persistentvolume "local-storage13-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage14-crc - persistentvolume "local-storage14-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage15-crc - persistentvolume "local-storage15-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage16-crc - persistentvolume "local-storage16-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage17-crc - persistentvolume "local-storage17-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage18-crc - persistentvolume "local-storage18-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage19-crc - persistentvolume "local-storage19-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage20-crc - persistentvolume "local-storage20-crc" deleted - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 4m41s - storageclass.storage.k8s.io "local-storage" deleted - bash scripts/delete-pv.sh - +++ dirname scripts/delete-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete - ++ set -ex - ++ NODE=crc - ++ OPERATION=delete - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/create-pv.sh - +++ dirname scripts/create-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get pv -o json - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' - + released= - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create - ++ set -ex - ++ NODE=crc - ++ OPERATION=create - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - bash scripts/gen-crc-pv-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z '"local-storage"' ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' - + PV_NUM=20 - + STORAGE_CAPACITY=10 - ++ oc get node -o name -l node-role.kubernetes.io/worker - ++ head -c-1 - ++ sed -e 's|node/||' - ++ tr '\n' ' ' - + NODE_NAMES=crc - + '[' -z crc ']' - + cat - + for node in $NODE_NAMES - ++ seq -w 20 - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml - storageclass.storage.k8s.io/local-storage created - persistentvolume/local-storage01-crc created - persistentvolume/local-storage02-crc created - persistentvolume/local-storage03-crc created - persistentvolume/local-storage04-crc created - persistentvolume/local-storage05-crc created - persistentvolume/local-storage06-crc created - persistentvolume/local-storage07-crc created - persistentvolume/local-storage08-crc created - persistentvolume/local-storage09-crc created - persistentvolume/local-storage10-crc created - persistentvolume/local-storage11-crc created - persistentvolume/local-storage12-crc created - persistentvolume/local-storage13-crc created - persistentvolume/local-storage14-crc created - persistentvolume/local-storage15-crc created - persistentvolume/local-storage16-crc created - persistentvolume/local-storage17-crc created - persistentvolume/local-storage18-crc created - persistentvolume/local-storage19-crc created - persistentvolume/local-storage20-crc created - persistentvolumeclaim/ansible-ee-logs unchanged - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - '2025/10/13 20:13:01 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]' - === RUN kuttl - ' harness.go:463: starting setup' - ' harness.go:255: running tests using configured kubeconfig.' - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' - ' logger.go:42: 20:13:01 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' - ' logger.go:42: 20:13:02 | | netconfig.network.openstack.org/netconfig configured' - ' logger.go:42: 20:13:02 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' - ' logger.go:42: 20:13:03 | | dnsmasq.network.openstack.org/dnsmasq configured' - ' logger.go:42: 20:13:03 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then' - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' - ' fi' - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' - ' --save-config \' - ' --dry-run=client \' - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' - ' -n openstack-kuttl-tests \' - ' -o yaml | \' - ' oc apply -f -' - ' ]' - ' logger.go:42: 20:13:03 | | secret/dataplane-ansible-ssh-private-key-secret configured' - ' harness.go:363: running tests' - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each step' - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests' - === RUN kuttl/harness - === RUN kuttl/harness/ctlplane-nodeselectors - === PAUSE kuttl/harness/ctlplane-nodeselectors - === CONT kuttl/harness/ctlplane-nodeselectors - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | starting test step 1-deploy-openstack' - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | running command: [sh -c oc annotate namespace $NAMESPACE openshift.io/node-selector="beta.kubernetes.io/os=linux"' - ' ]' - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | namespace/openstack-kuttl-tests annotated' - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/nodeselectors/global | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:13:03 | ctlplane-nodeselectors/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack created' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/1-deploy-openstack | test step completed 1-deploy-openstack' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | starting test step 2-' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | running command: [sh -c echo "Checking all pods have expected nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all pods have expected nodeselector' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | running command: [sh -c echo "Checking all cronjobs have expected nodeselector"' - ' EXPECTED_NODE_SELECTOR="node-role.kubernetes.io/worker:"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get cronjobs -n $NAMESPACE -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.jobTemplate.spec.template.spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | Checking all cronjobs have expected nodeselector' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/2- | test step completed 2-' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector | starting test step 3-update-nodeselector' - ' logger.go:42: 20:17:19 | ctlplane-nodeselectors/3-update-nodeselector | running command: [sh -c oc patch openstackcontrolplane -n $NAMESPACE openstack --type=''json'' -p=''[{' - ' "op": "replace",' - ' "path": "/spec/nodeSelector",' - ' "value": {"kubernetes.io/os":"linux"}' - ' }]''' - ' ]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector | openstackcontrolplane.core.openstack.org/openstack patched' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/3-update-nodeselector | test step completed 3-update-nodeselector' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | starting test step 4-' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | Found 28 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:20 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | Found 28 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | memcached-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovsdbserver-nb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | ovsdbserver-sb-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:21 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:22 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:22 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | Found 25 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | kube-state-metrics-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstack-cell1-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:23 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | Found 23 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-cell1-novncproxy-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | openstack-galera-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:24 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | Found 21 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | ceilometer-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:25 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | Found 20 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:26 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:27 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:27 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | Found 20 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | ovn-northd-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:28 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:29 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:30 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | Found 19 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | rabbitmq-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:31 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:32 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:32 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | Found 18 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | rabbitmq-cell1-server-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:33 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:34 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:35 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:36 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:36 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:37 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:38 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:39 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:40 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:40 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:41 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:42 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | Found 17 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | barbican-worker-58dcf4bdd8-4m58l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-cell1-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:43 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:44 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:44 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | Found 15 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | cinder-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | glance-default-external-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | glance-default-internal-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | openstackclient: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:45 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | Found 11 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:46 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | Found 11 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-cell0-conductor-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:47 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:48 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | Found 10 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | barbican-keystone-listener-5ff7664d5f-8q59l: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:49 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | Found 9 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:50 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | Found 9 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | swift-storage-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:51 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:52 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:52 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:53 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:54 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | Found 8 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | barbican-api-78cfff64d9-fq79n: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:55 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:56 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:56 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:57 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:58 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:17:59 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:00 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:01 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:02 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:03 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:04 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:05 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:06 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:07 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:08 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:09 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:10 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:11 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | Found 7 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | cinder-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:12 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:13 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:14 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:15 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:16 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:17 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:18 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:19 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:20 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | Found 6 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | keystone-7744f76b89-8b8k9: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:21 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:22 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | Found 5 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | neutron-c8f7c6645-wp4gb: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | placement-7cf77b4bbc-jrhtr: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:23 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | Found 3 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:24 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | Found 3 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | nova-scheduler-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:25 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:26 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | Found 2 pods with bad or missing nodeselector:' - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | nova-api-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | nova-metadata-0: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | swift-proxy-64b99674c-dkvsf: map[beta.kubernetes.io/os:linux node-role.kubernetes.io/worker:]' - ' logger.go:42: 20:18:27 | ctlplane-nodeselectors/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all running pods have new nodeselector"' - ' EXPECTED_NODE_SELECTOR="beta.kubernetes.io/os:linux kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get pods -n $NAMESPACE -l service!=dnsmasq --field-selector=status.phase=Running -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT pods with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | Checking all running pods have new nodeselector' - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | running command: [sh -c echo "Checking all cronjobs have expected nodeselector"' - ' EXPECTED_NODE_SELECTOR="kubernetes.io/os:linux"' - ' BAD_OR_MISSING_NODE_SELECTOR=$(oc get cronjobs -n $NAMESPACE -o=go-template --template=''{{ range .items }}{{ .metadata.name}}: {{ .spec.jobTemplate.spec.template.spec.nodeSelector }}{{"\n"}}{{ end }}'' | grep -v ''ovn-controller-.*-config'' | grep -v ''crc-storage-*'' | sed -e ''\!map\[''"$EXPECTED_NODE_SELECTOR"''\]$!d'')' - ' BAD_OR_MISSING_NODE_SELECTOR_COUNT=$(echo -n "$BAD_OR_MISSING_NODE_SELECTOR" | wc -l)' - ' if [ $BAD_OR_MISSING_NODE_SELECTOR_COUNT -ne 0 ]; then' - ' echo "Found $BAD_OR_MISSING_NODE_SELECTOR_COUNT cronjobs with bad or missing nodeselector:"' - ' echo "$BAD_OR_MISSING_NODE_SELECTOR"' - ' exit 1' - ' fi' - ' ]' - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | Checking all cronjobs have expected nodeselector' - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/4- | test step completed 4-' - ' logger.go:42: 20:18:28 | ctlplane-nodeselectors/5-cleanup | starting test step 5-cleanup' - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | running command: [sh -c oc annotate namespace $NAMESPACE openshift.io/node-selector-' - ' oc delete --ignore-not-found=true -n $NAMESPACE pvc \' - ' srv-swift-storage-0' - ' oc delete secret --ignore-not-found=true combined-ca-bundle -n $NAMESPACE' - ' oc delete secret -l service-cert -n $NAMESPACE' - ' oc delete secret -l ca-cert -n $NAMESPACE' - ' ]' - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | namespace/openstack-kuttl-tests annotated' - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret "combined-ca-bundle" deleted' - ' logger.go:42: 20:18:29 | ctlplane-nodeselectors/5-cleanup | secret "cert-barbican-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-barbican-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-barbican-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ceilometer-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-cinder-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-cinder-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-cinder-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-galera-openstack-cell1-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-galera-openstack-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-glance-default-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-glance-default-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-glance-default-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-keystone-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-keystone-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-keystone-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-kube-state-metrics-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-memcached-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-ovndbs" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-neutron-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-novncproxy-cell1-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-novncproxy-cell1-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-novncproxy-cell1-vencrypt" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-nova-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovn-metrics" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovndbcluster-nb-ovndbs" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovndbcluster-sb-ovndbs" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-ovnnorthd-ovndbs" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-placement-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-placement-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-placement-public-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-rabbitmq-cell1-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-rabbitmq-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-swift-internal-svc" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-swift-public-route" deleted' - ' logger.go:42: 20:18:30 | ctlplane-nodeselectors/5-cleanup | secret "cert-swift-public-svc" deleted' - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-internal" deleted' - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-libvirt" deleted' - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-ovn" deleted' - ' logger.go:42: 20:18:36 | ctlplane-nodeselectors/5-cleanup | secret "rootca-public" deleted' - ' logger.go:42: 20:19:03 | ctlplane-nodeselectors/5-cleanup | test step completed 5-cleanup' - ' logger.go:42: 20:19:03 | ctlplane-nodeselectors | skipping kubernetes event logging' - === NAME kuttl - ' harness.go:406: run tests finished' - ' harness.go:514: cleaning up' - ' harness.go:571: removing temp folder: ""' - '--- PASS: kuttl (361.27s)' - ' --- PASS: kuttl/harness (0.00s)' - ' --- PASS: kuttl/harness/ctlplane-nodeselectors (359.74s)' - PASS - No resources found - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage_cleanup.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/cleanup-crc-pv.sh - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ grep Bound - ++ awk '{print $6}' - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/swift-swift-storage-0 - ++ cut -d / -f 2 - + NAME=swift-swift-storage-0 - + oc delete -n openstack-kuttl-tests pvc/swift-swift-storage-0 --ignore-not-found - persistentvolumeclaim "swift-swift-storage-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/mysql-db-openstack-cell1-galera-0 - ++ cut -d / -f 2 - + NAME=mysql-db-openstack-cell1-galera-0 - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-cell1-galera-0 --ignore-not-found - persistentvolumeclaim "mysql-db-openstack-cell1-galera-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-internal-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-internal-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-internal-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-internal-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/glance-glance-default-external-api-0 - ++ cut -d / -f 2 - + NAME=glance-glance-default-external-api-0 - + oc delete -n openstack-kuttl-tests pvc/glance-glance-default-external-api-0 --ignore-not-found - persistentvolumeclaim "glance-glance-default-external-api-0" deleted - + for pvc in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | grep Bound | awk '{print $6}'` - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 1 - + NS=openstack-kuttl-tests - ++ echo openstack-kuttl-tests/mysql-db-openstack-galera-0 - ++ cut -d / -f 2 - + NAME=mysql-db-openstack-galera-0 - + oc delete -n openstack-kuttl-tests pvc/mysql-db-openstack-galera-0 --ignore-not-found - persistentvolumeclaim "mysql-db-openstack-galera-0" deleted - ++ oc get pv --selector provisioned-by=crc-devsetup --no-headers - ++ awk '{print $1}' - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage01-crc - persistentvolume "local-storage01-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage02-crc - persistentvolume "local-storage02-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage03-crc - persistentvolume "local-storage03-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage04-crc - persistentvolume "local-storage04-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage05-crc - persistentvolume "local-storage05-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage06-crc - persistentvolume "local-storage06-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage07-crc - persistentvolume "local-storage07-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage08-crc - persistentvolume "local-storage08-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage09-crc - persistentvolume "local-storage09-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage10-crc - persistentvolume "local-storage10-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage11-crc - persistentvolume "local-storage11-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage12-crc - persistentvolume "local-storage12-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage13-crc - persistentvolume "local-storage13-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage14-crc - persistentvolume "local-storage14-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage15-crc - persistentvolume "local-storage15-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage16-crc - persistentvolume "local-storage16-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage17-crc - persistentvolume "local-storage17-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage18-crc - persistentvolume "local-storage18-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage19-crc - persistentvolume "local-storage19-crc" deleted - + for pv in `oc get pv --selector provisioned-by=crc-devsetup --no-headers | awk '{print $1}'` - + oc delete pv/local-storage20-crc - persistentvolume "local-storage20-crc" deleted - if oc get sc "local-storage"; then oc delete sc "local-storage"; fi - NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE - local-storage kubernetes.io/no-provisioner Delete WaitForFirstConsumer true 6m10s - storageclass.storage.k8s.io "local-storage" deleted - bash scripts/delete-pv.sh - +++ dirname scripts/delete-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc delete - ++ set -ex - ++ NODE=crc - ++ OPERATION=delete - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/retry_make_crc_storage.sh 3 - 'make[3]: Entering directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - bash scripts/gen-namespace.sh - + '[' -z /home/zuul/ci-framework-data/artifacts/manifests ']' - + '[' -z crc-storage ']' - + OUT_DIR=/home/zuul/ci-framework-data/artifacts/manifests/crc-storage - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc-storage ']' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc-storage/namespace.yaml - namespace/crc-storage unchanged - timeout 500s bash -c "while ! (oc get project.v1.project.openshift.io crc-storage); do sleep 1; done" - NAME DISPLAY NAME STATUS - crc-storage Active - oc project crc-storage - Already on project "crc-storage" on server "https://api.crc.testing:6443". - bash scripts/create-pv.sh - +++ dirname scripts/create-pv.sh - ++ cd scripts - ++ pwd -P - + SCRIPTPATH=/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_common.sh - ++ set -ex - ++ OPERATION=create - ++ cat - ++ oc apply -f - - configmap/crc-storage unchanged - ++ cat - ++ oc apply -f - - serviceaccount/crc-storage unchanged - ++ cat - ++ oc apply -f - - role.rbac.authorization.k8s.io/crc-storage-role unchanged - ++ cat - ++ oc apply -f - - rolebinding.rbac.authorization.k8s.io/crc-storage-rolebinding unchanged - + PV_NUM=20 - + TIMEOUT=500s - ++ oc get pv -o json - ++ jq -r '.items[] | select(.status.phase | test("Released")).metadata.name' - + released= - ++ oc get node -o template --template '{{range .items}}{{.metadata.name}}{{"\n"}}{{end}}' -l node-role.kubernetes.io/worker - + NODE_NAMES=crc - + '[' -z crc ']' - + for node in $NODE_NAMES - + . /home/zuul/src/github.com/openstack-k8s-operators/install_yamls/scripts/storage_apply.sh crc create - ++ set -ex - ++ NODE=crc - ++ OPERATION=create - ++ oc delete -n crc-storage job crc-storage-crc --ignore-not-found - job.batch "crc-storage-crc" deleted - ++ cat - ++ oc apply -f - - 'Warning: would violate PodSecurity "restricted:latest": privileged (container "storage" must not set securityContext.privileged=true), allowPrivilegeEscalation != false (container "storage" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "storage" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "node-mnt" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "storage" must set securityContext.runAsNonRoot=true), runAsUser=0 (pod and container "storage" must not set runAsUser=0)' - job.batch/crc-storage-crc created - + oc wait job -n crc-storage -l install-yamls.crc.storage --for condition=Complete --timeout 500s - job.batch/crc-storage-crc condition met - bash scripts/gen-crc-pv-kustomize.sh - + OUT=/home/zuul/ci-framework-data/artifacts/manifests - + '[' -z '"local-storage"' ']' - + '[' '!' -d /home/zuul/ci-framework-data/artifacts/manifests/crc ']' - + PV_NUM=20 - + STORAGE_CAPACITY=10 - ++ oc get node -o name -l node-role.kubernetes.io/worker - ++ head -c-1 - ++ sed -e 's|node/||' - ++ tr '\n' ' ' - + NODE_NAMES=crc - + '[' -z crc ']' - + cat - + for node in $NODE_NAMES - ++ seq -w 20 - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + for i in `seq -w $PV_NUM` - + cat - ++ sed -e 's/^"//' -e 's/"$//' - + cat - oc apply -f /home/zuul/ci-framework-data/artifacts/manifests/crc/storage.yaml - storageclass.storage.k8s.io/local-storage created - persistentvolume/local-storage01-crc created - persistentvolume/local-storage02-crc created - persistentvolume/local-storage03-crc created - persistentvolume/local-storage04-crc created - persistentvolume/local-storage05-crc created - persistentvolume/local-storage06-crc created - persistentvolume/local-storage07-crc created - persistentvolume/local-storage08-crc created - persistentvolume/local-storage09-crc created - persistentvolume/local-storage10-crc created - persistentvolume/local-storage11-crc created - persistentvolume/local-storage12-crc created - persistentvolume/local-storage13-crc created - persistentvolume/local-storage14-crc created - persistentvolume/local-storage15-crc created - persistentvolume/local-storage16-crc created - persistentvolume/local-storage17-crc created - persistentvolume/local-storage18-crc created - persistentvolume/local-storage19-crc created - persistentvolume/local-storage20-crc created - persistentvolumeclaim/ansible-ee-logs unchanged - 'make[3]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make[2]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - '2025/10/13 20:19:25 kutt-test config testdirs is overridden with args: [ /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests ]' - === RUN kuttl - ' harness.go:463: starting setup' - ' harness.go:255: running tests using configured kubeconfig.' - ' harness.go:278: Successful connection to cluster at: https://api.crc.testing:6443' - ' logger.go:42: 20:19:25 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_netconfig.yaml]' - ' logger.go:42: 20:19:26 | | netconfig.network.openstack.org/netconfig configured' - ' logger.go:42: 20:19:26 | | running command: [oc apply -n openstack-kuttl-tests -f https://raw.githubusercontent.com/openstack-k8s-operators/infra-operator/main/config/samples/network_v1beta1_dnsmasq.yaml]' - ' logger.go:42: 20:19:26 | | dnsmasq.network.openstack.org/dnsmasq configured' - ' logger.go:42: 20:19:26 | | running command: [sh -c if [ ! -f ansibleee-ssh-key-id_rsa ]; then' - ' ssh-keygen -f ansibleee-ssh-key-id_rsa -N "" -t rsa -b 4096' - ' fi' - ' oc create secret generic dataplane-ansible-ssh-private-key-secret \' - ' --save-config \' - ' --dry-run=client \' - ' --from-file=authorized_keys=ansibleee-ssh-key-id_rsa.pub \' - ' --from-file=ssh-privatekey=ansibleee-ssh-key-id_rsa \' - ' --from-file=ssh-publickey=ansibleee-ssh-key-id_rsa.pub \' - ' -n openstack-kuttl-tests \' - ' -o yaml | \' - ' oc apply -f -' - ' ]' - ' logger.go:42: 20:19:27 | | secret/dataplane-ansible-ssh-private-key-secret configured' - ' harness.go:363: running tests' - ' harness.go:75: going to run test suite with timeout of 1380 seconds for each step' - ' harness.go:375: testsuite: /home/zuul/ci-framework-data/artifacts/manifests/operator/openstack-operator/tests/kuttl/tests has 19 tests' - === RUN kuttl/harness - === RUN kuttl/harness/ctlplane-tls-cert-rotation - === PAUSE kuttl/harness/ctlplane-tls-cert-rotation - === CONT kuttl/harness/ctlplane-tls-cert-rotation - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation | Skipping creation of user-supplied namespace: openstack-kuttl-tests' - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | starting test step 0-deploy-openstack-tls-ingress-only' - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c oc kustomize ../../../../config/samples/tls/tls_ingress | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Warning: spec.galera.template[openstack].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Warning: spec.galera.template[openstack-cell1].storageRequest: 500M is not appropriate for production! For production use at least 5G!' - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | openstackcontrolplane.core.openstack.org/openstack created' - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "Waiting for OpenStack control plane to be ready..."' - ' oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l core.openstack.org/openstackcontrolplane' - ' ]' - ' logger.go:42: 20:19:27 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Waiting for OpenStack control plane to be ready...' - ' logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | openstackcontrolplane.core.openstack.org/openstack condition met' - ' logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "Fail if internal https endpoints are registered"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -c "openstack endpoint list --interface internal -f value -c URL" | grep ''https:'' && exit 1' - ' exit 0' - ' ]' - ' logger.go:42: 20:23:16 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Fail if internal https endpoints are registered' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check ovn sb internalDbAddress use tcp"' - ' oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q tcp' - ' ]' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb internalDbAddress use tcp' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check ovn sb DB connection use tcp"' - ' oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c "ovn-sbctl --no-leader-only get-connection | grep -q ptcp"' - ' ]' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb DB connection use tcp' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check nova transport_url use tcp"' - ' oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c "grep transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q ''ssl=0''"' - ' ]' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check nova transport_url use tcp' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check neutron ovn_sb_connection url tcp address"' - ' oc exec -i deployment/neutron -n $NAMESPACE -- bash -c "grep ovn_sb_connection /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp"' - ' ]' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check neutron ovn_sb_connection url tcp address' - ' logger.go:42: 20:23:20 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container "neutron-api" out of: neutron-api, neutron-httpd' - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "Waiting for OpenStack control plane to be ready..."' - ' oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l core.openstack.org/openstackcontrolplane' - ' ]' - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Waiting for OpenStack control plane to be ready...' - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | openstackcontrolplane.core.openstack.org/openstack condition met' - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "Fail if internal https endpoints are registered"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -c "openstack endpoint list --interface internal -f value -c URL" | grep ''https:'' && exit 1' - ' exit 0' - ' ]' - ' logger.go:42: 20:23:22 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Fail if internal https endpoints are registered' - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check ovn sb internalDbAddress use tcp"' - ' oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q tcp' - ' ]' - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb internalDbAddress use tcp' - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check ovn sb DB connection use tcp"' - ' oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c "ovn-sbctl --no-leader-only get-connection | grep -q ptcp"' - ' ]' - ' logger.go:42: 20:23:24 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check ovn sb DB connection use tcp' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check nova transport_url use tcp"' - ' oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c "grep transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q ''ssl=0''"' - ' ]' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check nova transport_url use tcp' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | running command: [sh -c echo "check neutron ovn_sb_connection url tcp address"' - ' oc exec -i deployment/neutron -n $NAMESPACE -- bash -c "grep ovn_sb_connection /etc/neutron/neutron.conf.d/01-neutron.conf | grep -q tcp"' - ' ]' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | check neutron ovn_sb_connection url tcp address' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | Defaulted container "neutron-api" out of: neutron-api, neutron-httpd' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/0-deploy-openstack-tls-ingress-only | test step completed 0-deploy-openstack-tls-ingress-only' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/1-deploy-openstack | starting test step 1-deploy-openstack' - ' logger.go:42: 20:23:25 | ctlplane-tls-cert-rotation/1-deploy-openstack | running command: [sh -c oc kustomize ../../../../config/samples/base/openstackcontrolplane | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 20:23:26 | ctlplane-tls-cert-rotation/1-deploy-openstack | openstackcontrolplane.core.openstack.org/openstack configured' - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/1-deploy-openstack | test step completed 1-deploy-openstack' - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | starting test step 2-get-endpoints-certs' - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_before' - ' ]' - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Get fingerprints of all service certs' - ' logger.go:42: 20:26:10 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openstack endpoint list -c URL -f value' - ' logger.go:42: 20:26:11 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ awk -F/ ''{print $3}''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo nova-internal.openstack-kuttl-tests.svc:8774' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=nova-internal.openstack-kuttl-tests.svc:8774' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! nova-internal.openstack-kuttl-tests.svc:8774 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect nova-internal.openstack-kuttl-tests.svc:8774' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''nova-internal.openstack-kuttl-tests.svc:8774 69:B7:A8:39:D3:56:9B:F9:6C:20:00:88:92:1C:0F:08:B1:FA:77:BE''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo glance-default-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! glance-default-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=glance-default-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect glance-default-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''glance-default-public-openstack-kuttl-tests.apps-crc.testing:443 3C:9E:AC:47:9E:55:66:14:F0:2E:94:77:A0:B8:46:81:8C:1F:64:CB''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo swift-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! swift-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=swift-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect swift-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''swift-public-openstack-kuttl-tests.apps-crc.testing:443 FE:A1:B4:81:10:84:D0:C7:49:26:85:8E:16:D9:91:77:61:33:43:9A''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo glance-default-internal.openstack-kuttl-tests.svc:9292' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=glance-default-internal.openstack-kuttl-tests.svc:9292' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! glance-default-internal.openstack-kuttl-tests.svc:9292 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect glance-default-internal.openstack-kuttl-tests.svc:9292' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''glance-default-internal.openstack-kuttl-tests.svc:9292 82:94:C7:CF:5D:87:50:8D:14:F2:42:88:9C:11:9B:82:4D:DC:0A:69''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo cinder-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! cinder-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=cinder-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect cinder-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''cinder-public-openstack-kuttl-tests.apps-crc.testing:443 30:06:BF:06:E2:65:E2:C9:45:0B:89:EB:70:DC:6E:99:3F:F7:8D:BF''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo placement-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! placement-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=placement-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect placement-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''placement-public-openstack-kuttl-tests.apps-crc.testing:443 5F:AA:A1:8C:31:E6:08:06:27:B1:15:BA:DA:83:65:EA:D9:1D:BC:D5''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo neutron-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! neutron-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=neutron-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect neutron-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''neutron-public-openstack-kuttl-tests.apps-crc.testing:443 67:E3:8E:09:2C:B6:6F:83:C3:60:08:82:A2:C5:4B:3B:A5:25:0A:77''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo cinder-internal.openstack-kuttl-tests.svc:8776' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=cinder-internal.openstack-kuttl-tests.svc:8776' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! cinder-internal.openstack-kuttl-tests.svc:8776 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect cinder-internal.openstack-kuttl-tests.svc:8776' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''cinder-internal.openstack-kuttl-tests.svc:8776 01:07:13:B6:FF:11:56:31:E1:F7:8F:C7:41:06:22:95:93:87:6A:93''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo barbican-internal.openstack-kuttl-tests.svc:9311' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=barbican-internal.openstack-kuttl-tests.svc:9311' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! barbican-internal.openstack-kuttl-tests.svc:9311 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect barbican-internal.openstack-kuttl-tests.svc:9311' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''barbican-internal.openstack-kuttl-tests.svc:9311 2C:A9:ED:A9:8B:45:7C:9B:4B:B0:33:C5:89:3D:6A:F6:89:BC:06:72''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo swift-internal.openstack-kuttl-tests.svc:8080' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=swift-internal.openstack-kuttl-tests.svc:8080' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! swift-internal.openstack-kuttl-tests.svc:8080 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect swift-internal.openstack-kuttl-tests.svc:8080' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''swift-internal.openstack-kuttl-tests.svc:8080 F8:D2:94:AB:30:A6:E9:54:44:8C:13:00:BD:7A:13:6F:B7:CE:A8:F9''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo keystone-internal.openstack-kuttl-tests.svc:5000' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=keystone-internal.openstack-kuttl-tests.svc:5000' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! keystone-internal.openstack-kuttl-tests.svc:5000 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect keystone-internal.openstack-kuttl-tests.svc:5000' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''keystone-internal.openstack-kuttl-tests.svc:5000 08:FC:0C:DF:8C:0B:2E:C5:93:5B:7D:DE:E8:56:49:42:73:EA:1C:23''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo barbican-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! barbican-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=barbican-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect barbican-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''barbican-public-openstack-kuttl-tests.apps-crc.testing:443 5F:EC:8F:E4:BD:67:37:6C:77:65:A2:0F:50:FA:3B:B5:C0:16:23:7A''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo nova-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! nova-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=nova-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect nova-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''nova-public-openstack-kuttl-tests.apps-crc.testing:443 00:97:B7:1B:B6:67:7C:83:8B:01:63:75:EC:38:B8:93:EE:FB:F7:99''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo placement-internal.openstack-kuttl-tests.svc:8778' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=placement-internal.openstack-kuttl-tests.svc:8778' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! placement-internal.openstack-kuttl-tests.svc:8778 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect placement-internal.openstack-kuttl-tests.svc:8778' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''placement-internal.openstack-kuttl-tests.svc:8778 CF:74:4C:BC:D9:5E:B6:03:07:06:4B:43:4A:C4:C2:7A:77:AB:FC:36''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo keystone-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! keystone-public-openstack-kuttl-tests.apps-crc.testing =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=keystone-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect keystone-public-openstack-kuttl-tests.apps-crc.testing:443' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''keystone-public-openstack-kuttl-tests.apps-crc.testing:443 51:9F:C4:3A:B4:14:39:13:D2:9D:C5:0C:1C:A9:0C:E1:6A:A4:86:E3''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + for url in $(openstack endpoint list -c URL -f value | awk -F/ ''{print $3}'')' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ echo neutron-internal.openstack-kuttl-tests.svc:9696' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed -E ''s|^[^:/]+://([^:/]+)(:([0-9]+))?.*|\1:\3|''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + host_port=neutron-internal.openstack-kuttl-tests.svc:9696' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ ! neutron-internal.openstack-kuttl-tests.svc:9696 =~ :[0-9]+$ ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl s_client -connect neutron-internal.openstack-kuttl-tests.svc:9696' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ sed ''s/.* Fingerprint=//''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | ++ openssl x509 -fingerprint -noout -in /dev/stdin' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + finger_print=6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + [[ -n 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83 ]]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | + echo ''neutron-internal.openstack-kuttl-tests.svc:9696 6D:54:EC:95:55:25:08:0C:23:B6:2A:4B:EC:14:29:08:3B:D5:2F:83''' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo "Waiting for OpenStack control plane to be ready..."' - ' oc wait openstackcontrolplane -n $NAMESPACE --for=condition=Ready --timeout=400s -l core.openstack.org/openstackcontrolplane' - ' ]' - ' logger.go:42: 20:26:13 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Waiting for OpenStack control plane to be ready...' - ' logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | openstackcontrolplane.core.openstack.org/openstack condition met' - ' logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo "Fail if internal http endpoints are registered"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -c "openstack endpoint list --interface internal -f value -c URL" | grep ''http:'' && exit 1' - ' exit 0' - ' ]' - ' logger.go:42: 20:26:14 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Fail if internal http endpoints are registered' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo "check ovn sb internalDbAddress use ssl"' - ' oc get -n $NAMESPACE OVNDBCluster ovndbcluster-sb -o jsonpath={.status.internalDbAddress} | grep -q ssl' - ' ]' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check ovn sb internalDbAddress use ssl' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo "check ovn sb DB connection use ssl"' - ' oc exec -i statefulset/ovsdbserver-sb -n $NAMESPACE -- bash -c "ovn-sbctl --no-leader-only get-connection | grep -q pssl"' - ' ]' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check ovn sb DB connection use ssl' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Defaulted container "ovsdbserver-sb" out of: ovsdbserver-sb, openstack-network-exporter' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo "check nova transport_url use ssl"' - ' oc exec -i statefulset/nova-cell1-conductor -n $NAMESPACE -- bash -c "grep transport_url /etc/nova/nova.conf.d/01-nova.conf | grep -q ''ssl=1''"' - ' ]' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check nova transport_url use ssl' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | running command: [sh -c echo "check neutron ovn_sb_connection url ssl"' - ' oc exec -i deployment/neutron -n $NAMESPACE -- bash -c "grep ovn_sb_connection /etc/neutron/neutron.conf.d/01-neutron.conf| grep -q ssl"' - ' ]' - ' logger.go:42: 20:26:16 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | check neutron ovn_sb_connection url ssl' - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | Defaulted container "neutron-api" out of: neutron-api, neutron-httpd' - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/2-get-endpoints-certs | test step completed 2-get-endpoints-certs' - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration | starting test step 3-change-cert-duration' - ' logger.go:42: 20:26:17 | ctlplane-tls-cert-rotation/3-change-cert-duration | running command: [sh -c oc kustomize ../../../../config/samples/tls/custom_duration | oc apply -n $NAMESPACE -f -' - ' ]' - ' logger.go:42: 20:26:18 | ctlplane-tls-cert-rotation/3-change-cert-duration | openstackcontrolplane.core.openstack.org/openstack configured' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/3-change-cert-duration | test step completed 3-change-cert-duration' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | starting test step 4-' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:26:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:26:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 match the secret.' - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:26:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:26:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:26:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:26:24 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:26:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:26:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:26:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:26:29 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:26:30 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:26:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:26:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:26:33 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:26:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:26:35 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:26:36 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:26:36 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:26:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:26:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:26:39 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:26:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:26:41 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:42 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:26:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:26:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:26:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:26:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:26:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:26:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:26:49 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:26:50 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:26:51 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:26:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:26:53 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:53 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:26:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:26:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:26:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:26:57 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:26:58 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:26:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:27:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:01 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:02 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:27:03 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:27:04 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:04 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:27:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:27:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:08 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:27:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:27:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:11 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:27:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:13 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:27:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:27:15 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:15 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:27:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:18 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:27:19 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:27:20 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:27:21 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:21 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:27:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:27:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:25 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | Error from server (NotFound): pods "openstackclient" not found' - ' logger.go:42: 20:27:26 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15691.' - ' logger.go:42: 20:27:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:5671.' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq at 10.217.5.241:15671.' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6642.' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:6644.' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:28 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-sb-0 at 10.217.5.30:1981.' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6641.' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:6643.' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ovsdbserver-nb-0 at 10.217.5.243:1981.' - ' logger.go:42: 20:27:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:5671.' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15671.' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:30 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from rabbitmq-cell1 at 10.217.5.46:15691.' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack-cell1 at 10.217.4.238:3306.' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from openstack at 10.217.5.75:3306.' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Get fingerprints of all service certs"' - ' oc exec -i openstackclient -n $NAMESPACE -- bash -s < ../../common/osp_endpoint_fingerprints.sh > /tmp/endpoint_fingerprints_after' - ' ]' - ' logger.go:42: 20:27:31 | ctlplane-tls-cert-rotation/4- | Get fingerprints of all service certs' - ' logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- | error: unable to upgrade connection: container not found ("openstackclient")' - ' logger.go:42: 20:27:32 | ctlplane-tls-cert-rotation/4- | command failure, skipping 1 additional commands' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:27:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:27:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:27:36 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Error retrieving certificate from ceilometer-internal at 10.217.5.118:3000.' - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:27:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691' - ' logger.go:42: 20:27:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:27:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:27:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:27:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:45 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:27:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691' - ' logger.go:42: 20:27:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:27:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:27:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:27:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:27:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:27:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691' - ' logger.go:42: 20:27:56 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:27:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:27:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:27:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:28:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:28:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:28:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:28:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691' - ' logger.go:42: 20:28:05 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:28:06 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:28:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:28:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:28:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:28:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:28:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 DO NOT match the secret.' - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 DO NOT match the secret.' - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 DO NOT match the secret.' - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:28:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:28:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15691' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 5671' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq on port 15671' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 5671' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15671' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | - rabbitmq-cell1 on port 15691' - ' logger.go:42: 20:28:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:28:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:28:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:28:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:28:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:28:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:28:20 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:28:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:28:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:28:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:28:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:28:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:28:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:28:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:28:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:28:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:28:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:28:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:28:32 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:28:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:28:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:28:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:28:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:28:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:28:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:28:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:28:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:28:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:28:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:28:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:28:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:28:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:28:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:28:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:28:49 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:28:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:28:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:28:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:28:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:28:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:28:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:28:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:28:57 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:28:58 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:28:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:29:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:29:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:29:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:29:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:29:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:29:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:29:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:29:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:29:08 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:29:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:29:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:29:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:29:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:29:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:29:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:29:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:29:16 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:29:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:29:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:29:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:29:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:29:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:29:22 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:29:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:29:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:29:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:29:26 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:29:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:29:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:29:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:29:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:29:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:29:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:29:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:29:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:29:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:29:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:29:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:29:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:29:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:29:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:29:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:29:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:29:43 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:29:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:29:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:29:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:29:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:29:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:29:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:29:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:29:51 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:29:52 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:29:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:29:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:29:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:29:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:29:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:29:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:30:00 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:30:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:30:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:30:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:30:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:30:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:30:06 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:30:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:30:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:30:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:30:10 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:30:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:30:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:30:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:30:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:30:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:30:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:30:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:30:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:30:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:30:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:30:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:30:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:23 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:30:24 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:30:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:30:26 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:30:27 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:30:28 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:30:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:30:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:30:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:30:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:30:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:30:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:30:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:30:36 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:30:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:30:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:30:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:30:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:30:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:30:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:30:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:30:44 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:30:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:30:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:30:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:30:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:30:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:30:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:30:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:30:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:30:53 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:30:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:30:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:30:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:30:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:30:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:30:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:30:59 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:02 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:31:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:31:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:31:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:31:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:31:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:10 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:31:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:31:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:31:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:31:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:31:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:31:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:31:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:31:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:31:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:31:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:31:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:26 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:27 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:31:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:31:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:31:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:31:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:31:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:35 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:31:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:31:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:31:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:31:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:31:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:31:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:31:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:31:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:31:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:31:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:51 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:31:52 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:31:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:31:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:31:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:31:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:31:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:31:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:31:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:32:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:32:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:32:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:32:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:32:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:32:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:32:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:32:12 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:32:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:32:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:32:15 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:16 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:32:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:20 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:32:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:32:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:32:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:32:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:32:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:32:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:32:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:32:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:32:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:32:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:32:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:32:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:32:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:32:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:32:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:32:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:32:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:32:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:32:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:48 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:50 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:32:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:32:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:32:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:32:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:32:56 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:32:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:32:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:32:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:01 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:33:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:33:03 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:33:04 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:33:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:33:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:33:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:33:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:33:13 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:33:14 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:33:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:33:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:18 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:33:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:33:21 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:33:22 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:33:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:33:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:26 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:33:28 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:33:29 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:33:30 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:33:31 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:33:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:33 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:33:36 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:33:37 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:33:38 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:33:39 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:33:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:41 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:43 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:33:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:33:45 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:33:46 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:33:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:33:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:49 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:50 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:33:52 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:33:53 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:33:54 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:33:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:33:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:33:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:33:58 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:33:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:01 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:34:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:34:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:34:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:34:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:34:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:34:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:09 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:34:10 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:34:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:34:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:34:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:34:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:34:15 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:34:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:34:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:34:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:34:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:34:23 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:26 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:34:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:34:28 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:34:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:34:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:34:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:34:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:34:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:34:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:34:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:34:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:39 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:34:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:34:43 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:34:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:34:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:34:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:47 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:34:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:50 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:34:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:34:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:34:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:34:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:34:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:34:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:34:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:34:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:34:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:35:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:35:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:35:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:35:05 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:35:06 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:07 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:35:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:35:11 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:35:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:35:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:35:14 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:35:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:19 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:35:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:35:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:35:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:35:23 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:35:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:35:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:35:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:35:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:35:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:33 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:35:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:35:36 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:35:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:35:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:35:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:40 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:35:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:44 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:35:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:35:46 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:35:47 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:48 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:50 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:35:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:35:52 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:35:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:35:54 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:35:55 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:35:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:35:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:35:58 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:35:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:01 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:36:04 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:36:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:36:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:36:07 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:09 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:11 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:36:12 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:36:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:36:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:36:15 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:17 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:19 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:36:20 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:36:21 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:36:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:36:23 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:24 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:27 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:36:28 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:36:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:36:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:31 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:32 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:36:35 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:36:36 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:36:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:36:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:36:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:36:44 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:36:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:36:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:36:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:36:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:36:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:36:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:36:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:36:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:36:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:36:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:00 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:37:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:37:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:37:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:37:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:37:05 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:37:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:37:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:08 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:37:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:37:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:37:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:37:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:37:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:37:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:37:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:37:16 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:17 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:37:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:37:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:37:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:37:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:22 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:37:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:37:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:37:26 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:37:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:37:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:37:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:37:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:37:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:37:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:37:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:37:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:37:36 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:37:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:37:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:37:39 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:37:40 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:37:41 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:42 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:37:43 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:37:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:37:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:37:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:37:47 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:37:48 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:37:49 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:50 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:37:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:37:52 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:37:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:37:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:37:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:37:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:37:57 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:37:58 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:37:59 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:01 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:38:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:38:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:38:04 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:38:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:38:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:38:07 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:38:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:38:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:38:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:38:14 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:38:15 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:16 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:19 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:38:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:38:21 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:38:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:38:23 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:38:24 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:25 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:38:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:38:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:38:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:38:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:38:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:38:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:38:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:38:37 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:38:38 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:38:39 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:40 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:42 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:38:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:38:45 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:38:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:38:47 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:38:48 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:49 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:38:51 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:38:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:38:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:38:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:38:55 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:38:56 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:38:57 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:38:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:38:59 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:39:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:39:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:39:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:39:03 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:39:04 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:39:05 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:39:06 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:39:07 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:39:08 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:39:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:39:10 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:39:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:39:12 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:39:13 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:39:14 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:39:15 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:39:16 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:39:17 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:39:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:39:19 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:39:20 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:39:21 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:39:22 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:39:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:39:24 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:39:25 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:26 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:39:27 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:39:28 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:39:29 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:39:30 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:39:31 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:39:32 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:39:33 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:39:34 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:35 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:39:36 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:39:37 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:39:38 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:39:39 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:39:40 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:39:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:39:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:39:43 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:39:44 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:39:45 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:39:46 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:39:47 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:39:48 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:39:49 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:39:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:39:51 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:39:52 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:39:53 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:39:54 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:39:55 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:39:56 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:39:57 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:39:58 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:39:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:40:00 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:40:01 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:40:02 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:40:03 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:40:04 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:40:05 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:40:06 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:40:07 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:40:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:40:09 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:40:10 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:40:11 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:12 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:40:13 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:40:14 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:40:15 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:40:16 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:40:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:40:18 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:40:19 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:40:20 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:21 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:40:22 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:40:23 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:40:24 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:40:25 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:40:26 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:40:27 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:40:28 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:40:29 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:40:30 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:40:31 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:40:32 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:40:33 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:40:34 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:40:35 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:40:36 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:40:37 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:40:38 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:40:39 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:40:40 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:40:41 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:40:42 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:40:43 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:40:44 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:40:45 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:40:46 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:40:47 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:40:48 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:40:49 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:40:50 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:40:51 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:40:52 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:40:53 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:40:54 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:40:55 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:40:56 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:40:57 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:40:58 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:40:59 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:41:00 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:41:01 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:41:02 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:41:03 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:41:04 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:41:05 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:41:06 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:41:07 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:41:08 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:41:09 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:41:10 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | running command: [sh -c echo "Checking rotation of non API service certificates..."' - ' NAMESPACE=$NAMESPACE bash ../../common/osp_check_noapi_service_certs.sh' - ' ]' - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Checking rotation of non API service certificates...' - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq (ClusterIP: 10.217.5.241, Ports: 15691 5671 15671)' - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15691...' - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15691 match the secret.' - ' logger.go:42: 20:41:11 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 5671...' - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 5671 match the secret.' - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq on port 15671...' - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq on port 15671 match the secret.' - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-sb-0 (ClusterIP: 10.217.5.30, Ports: 6642 6644 1981)' - ' logger.go:42: 20:41:12 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6642...' - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6642 match the secret.' - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 6644...' - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 6644 match the secret.' - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-sb-0 on port 1981...' - ' logger.go:42: 20:41:13 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-sb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Checking service: ovsdbserver-nb-0 (ClusterIP: 10.217.5.243, Ports: 6641 6643 1981)' - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6641...' - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6641 match the secret.' - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 6643...' - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 6643 match the secret.' - ' logger.go:42: 20:41:14 | ctlplane-tls-cert-rotation/4- | Connecting to ovsdbserver-nb-0 on port 1981...' - ' logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Certificates for ovsdbserver-nb-0 on port 1981 DO NOT match the secret.' - ' logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Checking service: ceilometer-internal (ClusterIP: 10.217.5.118, Ports: 3000)' - ' logger.go:42: 20:41:15 | ctlplane-tls-cert-rotation/4- | Connecting to ceilometer-internal on port 3000...' - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Certificates for ceilometer-internal on port 3000 match the secret.' - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Checking service: rabbitmq-cell1 (ClusterIP: 10.217.5.46, Ports: 5671 15671 15691)' - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 5671...' - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 5671 match the secret.' - ' logger.go:42: 20:41:16 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15671...' - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15671 match the secret.' - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Connecting to rabbitmq-cell1 on port 15691...' - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Certificates for rabbitmq-cell1 on port 15691 match the secret.' - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Checking database: openstack-cell1 (ClusterIP: 10.217.4.238, Ports: 3306)' - ' logger.go:42: 20:41:17 | ctlplane-tls-cert-rotation/4- | Connecting to openstack-cell1 on port 3306...' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack-cell1 on port 3306 match the secret.' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Checking database: openstack (ClusterIP: 10.217.5.75, Ports: 3306)' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Connecting to openstack on port 3306...' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | Certificates for openstack on port 3306 match the secret.' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | The following services had certificate mismatches:' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-sb-0 on port 1981' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | - ovsdbserver-nb-0 on port 1981' - ' logger.go:42: 20:41:18 | ctlplane-tls-cert-rotation/4- | command failure, skipping 2 additional commands' - ' logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation/4- | test step failed 4-' - ' case.go:396: failed in step 4-' - ' case.go:398: command "echo \"Checking rotation of non API service certificates...\"\\n NAMES..." failed, exit status 1' - ' logger.go:42: 20:41:19 | ctlplane-tls-cert-rotation | skipping kubernetes event logging' - === NAME kuttl - ' harness.go:406: run tests finished' - ' harness.go:514: cleaning up' - ' harness.go:571: removing temp folder: ""' - '--- FAIL: kuttl (1314.18s)' - ' --- FAIL: kuttl/harness (0.00s)' - ' --- FAIL: kuttl/harness/ctlplane-tls-cert-rotation (1312.57s)' - FAIL - 'make[1]: *** [Makefile:2080: openstack_kuttl_run] Error 1' - 'make[1]: Leaving directory ''/home/zuul/src/github.com/openstack-k8s-operators/install_yamls''' - 'make: *** [Makefile:2102: openstack_kuttl] Error 2' 2025-10-13 20:41:20,358 p=28354 u=zuul n=ansible | ...ignoring 2025-10-13 20:41:20,387 p=28354 u=zuul n=ansible | TASK [Get resource status after openstack_kuttl run _raw_params={{ item }} >> {{ cifmw_artifacts_basedir }}/logs/cmd_after_{{ operator }}_kuttl.log ] *** 2025-10-13 20:41:20,387 p=28354 u=zuul n=ansible | Monday 13 October 2025 20:41:20 +0000 (1:06:41.792) 1:09:07.609 ******** 2025-10-13 20:41:20,790 p=28354 u=zuul n=ansible | changed: [localhost] => (item=oc get pv) 2025-10-13 20:41:21,395 p=28354 u=zuul n=ansible | changed: [localhost] => (item=oc get all) 2025-10-13 20:41:21,408 p=28354 u=zuul n=ansible | TASK [Find the generated JUnitXML files paths={{ cifmw_installyamls_repos }}, file_type=file, patterns=*.xml] *** 2025-10-13 20:41:21,408 p=28354 u=zuul n=ansible | Monday 13 October 2025 20:41:21 +0000 (0:00:01.020) 1:09:08.630 ******** 2025-10-13 20:41:21,600 p=28354 u=zuul n=ansible | ok: [localhost] 2025-10-13 20:41:21,616 p=28354 u=zuul n=ansible | TASK [Create the test results directory path={{ _kuttl_test_result_dir }}, state=directory, mode=0755] *** 2025-10-13 20:41:21,616 p=28354 u=zuul n=ansible | Monday 13 October 2025 20:41:21 +0000 (0:00:00.207) 1:09:08.838 ******** 2025-10-13 20:41:21,813 p=28354 u=zuul n=ansible | changed: [localhost] 2025-10-13 20:41:21,823 p=28354 u=zuul n=ansible | TASK [Copy the generated test results to the test results directory src={{ item.path }}, dest={{ _kuttl_test_result_dir }}, mode=0644] *** 2025-10-13 20:41:21,824 p=28354 u=zuul n=ansible | Monday 13 October 2025 20:41:21 +0000 (0:00:00.207) 1:09:09.045 ******** 2025-10-13 20:41:22,409 p=28354 u=zuul n=ansible | changed: [localhost] => (item={'path': '/home/zuul/src/github.com/openstack-k8s-operators/install_yamls/kuttl-report-openstack.xml', 'mode': '0644', 'isdir': False, 'ischr': False, 'isblk': False, 'isreg': True, 'isfifo': False, 'islnk': False, 'issock': False, 'uid': 1000, 'gid': 1000, 'size': 633, 'inode': 79844139, 'dev': 64513, 'nlink': 1, 'atime': 1760385082.3343067, 'mtime': 1760388079.762774, 'ctime': 1760388079.762774, 'gr_name': 'zuul', 'pw_name': 'zuul', 'wusr': True, 'rusr': True, 'xusr': False, 'wgrp': False, 'rgrp': True, 'xgrp': False, 'woth': False, 'roth': True, 'xoth': False, 'isuid': False, 'isgid': False}) 2025-10-13 20:41:22,428 p=28354 u=zuul n=ansible | TASK [Fail when any tests failed that=['_kuttl_curr_operator_result.rc == 0'], success_msg=KUTTL tests for {{ operator }} passed, fail_msg=KUTTL tests for {{ operator }} failed] *** 2025-10-13 20:41:22,428 p=28354 u=zuul n=ansible | Monday 13 October 2025 20:41:22 +0000 (0:00:00.604) 1:09:09.650 ******** 2025-10-13 20:41:22,468 p=28354 u=zuul n=ansible | fatal: [localhost]: FAILED! => assertion: _kuttl_curr_operator_result.rc == 0 changed: false evaluated_to: false msg: KUTTL tests for openstack failed 2025-10-13 20:41:22,469 p=28354 u=zuul n=ansible | NO MORE HOSTS LEFT ************************************************************* 2025-10-13 20:41:22,472 p=28354 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2025-10-13 20:41:22,472 p=28354 u=zuul n=ansible | localhost : ok=127 changed=54 unreachable=0 failed=1 skipped=67 rescued=0 ignored=2 2025-10-13 20:41:22,472 p=28354 u=zuul n=ansible | Monday 13 October 2025 20:41:22 +0000 (0:00:00.044) 1:09:09.694 ******** 2025-10-13 20:41:22,473 p=28354 u=zuul n=ansible | =============================================================================== 2025-10-13 20:41:22,473 p=28354 u=zuul n=ansible | install_yamls_makes : Run openstack_kuttl ---------------------------- 4001.79s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | install_yamls_makes : Run download_tools ------------------------------- 34.41s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | ci_setup : Install needed packages ------------------------------------- 26.27s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | ci_local_storage : Remove the cifmw_cls_namespace namespace ------------ 10.77s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | repo_setup : Initialize python venv and install requirements ------------ 8.68s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | ci_local_storage : Perform action in the PV directory ------------------- 5.78s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | ci_local_storage : Perform action in the PV directory ------------------- 5.77s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | ci_setup : Install openshift client ------------------------------------- 5.32s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | install_yamls_makes : Run crc_attach_default_interface ------------------ 5.20s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs --- 1.77s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | run_hook : Run hook without retry - Fetch crc facts and save them as parameters for kuttl jobs --- 1.74s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | openshift_setup : Create required namespaces ---------------------------- 1.71s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | ci_local_storage : Fetch hostnames for all hosts ------------------------ 1.63s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | install_ca : Update ca bundle ------------------------------------------- 1.53s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | ci_setup : Manage directories ------------------------------------------- 1.16s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | repo_setup : Make sure git-core package is installed -------------------- 1.09s 2025-10-13 20:41:22,474 p=28354 u=zuul n=ansible | repo_setup : Get repo-setup repository ---------------------------------- 1.05s 2025-10-13 20:41:22,475 p=28354 u=zuul n=ansible | Get resource status after openstack_kuttl run --------------------------- 1.02s 2025-10-13 20:41:22,475 p=28354 u=zuul n=ansible | ci_local_storage : Fetch hostnames for all hosts ------------------------ 0.99s 2025-10-13 20:41:22,475 p=28354 u=zuul n=ansible | openshift_setup : Gather network.operator info -------------------------- 0.97s