2026-02-04 12:12:47,547 p=36505 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace

2026-02-04 12:12:47,548 p=36505 u=zuul n=ansible | PLAY [Execute the default-telemetry scenario] **********************************
2026-02-04 12:12:47,584 p=36505 u=zuul n=ansible | TASK [default-telemetry : Check telemetry without COO and without Autoscaling and MetricStorage enabled] ***
2026-02-04 12:12:47,584 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:12:47 +0000 (0:00:00.055)       0:00:00.055 **** 
2026-02-04 12:12:47,604 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/no_coo_no_autoscaling_no_metricstorage.yml for localhost
2026-02-04 12:12:47,610 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait until telemetry is finished reconciling and its conditions are all True] ***
2026-02-04 12:12:47,611 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:12:47 +0000 (0:00:00.026)       0:00:00.082 **** 
2026-02-04 12:12:48,132 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:12:48,136 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get current time] ************************************
2026-02-04 12:12:48,136 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:12:48 +0000 (0:00:00.525)       0:00:00.607 **** 
2026-02-04 12:12:48,152 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:12:48,156 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for new logs to be generated] *******************
2026-02-04 12:12:48,156 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:12:48 +0000 (0:00:00.020)       0:00:00.627 **** 
2026-02-04 12:14:48,616 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:14:48,621 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get new telemetry-operator logs] *********************
2026-02-04 12:14:48,621 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:48 +0000 (0:02:00.464)       0:02:01.092 **** 
2026-02-04 12:14:49,030 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:14:49,034 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check telemetry-operator logs for errors after it's started
RHOSO-123456] ***
2026-02-04 12:14:49,034 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.413)       0:02:01.505 **** 
2026-02-04 12:14:49,052 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:14:49,057 p=36505 u=zuul n=ansible | TASK [default-telemetry : Output found errors for debugging purposes] **********
2026-02-04 12:14:49,057 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.023)       0:02:01.528 **** 
2026-02-04 12:14:49,069 p=36505 u=zuul n=ansible | skipping: [localhost]
2026-02-04 12:14:49,073 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator pod data] *********************
2026-02-04 12:14:49,073 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.015)       0:02:01.544 **** 
2026-02-04 12:14:49,383 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:14:49,387 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator container statuses] ***********
2026-02-04 12:14:49,387 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.314)       0:02:01.858 **** 
2026-02-04 12:14:49,402 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:14:49,405 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator restart counts] ***************
2026-02-04 12:14:49,406 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.018)       0:02:01.876 **** 
2026-02-04 12:14:49,421 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:14:49,424 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator failed container logs] ********
2026-02-04 12:14:49,425 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.018)       0:02:01.895 **** 
2026-02-04 12:14:49,733 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["oc", "logs", "-n", "openstack-operators", "-p", "-l", "openstack.org/operator-name=telemetry", "--tail=-1"], "delta": "0:00:00.128715", "end": "2026-02-04 12:14:49.711956", "msg": "non-zero return code", "rc": 1, "start": "2026-02-04 12:14:49.583241", "stderr": "Error from server (BadRequest): previous terminated container \"manager\" in pod \"telemetry-operator-controller-manager-6dcb54f59-lnlx2\" not found", "stderr_lines": ["Error from server (BadRequest): previous terminated container \"manager\" in pod \"telemetry-operator-controller-manager-6dcb54f59-lnlx2\" not found"], "stdout": "", "stdout_lines": []}
2026-02-04 12:14:49,733 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:14:49,737 p=36505 u=zuul n=ansible | TASK [default-telemetry : Output logs of failed container for debugging purposes] ***
2026-02-04 12:14:49,737 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.312)       0:02:02.208 **** 
2026-02-04 12:14:49,752 p=36505 u=zuul n=ansible | ok: [localhost] => {
    "operator_logs_previous.stdout_lines": []
}
2026-02-04 12:14:49,756 p=36505 u=zuul n=ansible | TASK [default-telemetry : Enable Autoscaling and MetricStorage] ****************
2026-02-04 12:14:49,756 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.019)       0:02:02.227 **** 
2026-02-04 12:14:49,768 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/enable_autoscaling_and_metricstorage.yml for localhost
2026-02-04 12:14:49,781 p=36505 u=zuul n=ansible | TASK [default-telemetry : Enable MetricStorage] ********************************
2026-02-04 12:14:49,781 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:49 +0000 (0:00:00.025)       0:02:02.252 **** 
2026-02-04 12:14:50,218 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:14:50,222 p=36505 u=zuul n=ansible | TASK [default-telemetry : Enable Autoscaling] **********************************
2026-02-04 12:14:50,222 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:50 +0000 (0:00:00.440)       0:02:02.693 **** 
2026-02-04 12:14:50,792 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:14:50,797 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait until reconciliation finishes] ******************
2026-02-04 12:14:50,797 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:14:50 +0000 (0:00:00.574)       0:02:03.268 **** 
2026-02-04 12:16:51,122 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:16:51,126 p=36505 u=zuul n=ansible | TASK [default-telemetry : Check telemetry without COO and with Autoscaling and MetricStorage enabled] ***
2026-02-04 12:16:51,126 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:51 +0000 (0:02:00.329)       0:04:03.597 **** 
2026-02-04 12:16:51,155 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/no_coo_autoscaling_metricstorage.yml for localhost
2026-02-04 12:16:51,173 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator pod data] *********************
2026-02-04 12:16:51,174 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:51 +0000 (0:00:00.047)       0:04:03.645 **** 
2026-02-04 12:16:51,623 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:16:51,629 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator container statuses] ***********
2026-02-04 12:16:51,629 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:51 +0000 (0:00:00.455)       0:04:04.100 **** 
2026-02-04 12:16:51,645 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:16:51,651 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator restart counts] ***************
2026-02-04 12:16:51,652 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:51 +0000 (0:00:00.022)       0:04:04.122 **** 
2026-02-04 12:16:51,672 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:16:51,676 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get telemetry-operator failed container logs] ********
2026-02-04 12:16:51,676 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:51 +0000 (0:00:00.024)       0:04:04.147 **** 
2026-02-04 12:16:52,017 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["oc", "logs", "-n", "openstack-operators", "-p", "-l", "openstack.org/operator-name=telemetry", "--tail=-1"], "delta": "0:00:00.135094", "end": "2026-02-04 12:16:51.993007", "msg": "non-zero return code", "rc": 1, "start": "2026-02-04 12:16:51.857913", "stderr": "Error from server (BadRequest): previous terminated container \"manager\" in pod \"telemetry-operator-controller-manager-6dcb54f59-lnlx2\" not found", "stderr_lines": ["Error from server (BadRequest): previous terminated container \"manager\" in pod \"telemetry-operator-controller-manager-6dcb54f59-lnlx2\" not found"], "stdout": "", "stdout_lines": []}
2026-02-04 12:16:52,018 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:16:52,022 p=36505 u=zuul n=ansible | TASK [default-telemetry : Output logs of failed container for debugging purposes] ***
2026-02-04 12:16:52,022 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:52 +0000 (0:00:00.346)       0:04:04.493 **** 
2026-02-04 12:16:52,042 p=36505 u=zuul n=ansible | ok: [localhost] => {
    "operator_logs_previous.stdout_lines": []
}
2026-02-04 12:16:52,046 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get current time] ************************************
2026-02-04 12:16:52,047 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:52 +0000 (0:00:00.024)       0:04:04.517 **** 
2026-02-04 12:16:52,061 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:16:52,065 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for new logs to be generated] *******************
2026-02-04 12:16:52,065 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:16:52 +0000 (0:00:00.018)       0:04:04.536 **** 
2026-02-04 12:18:52,437 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:18:52,442 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get new telemetry-operator logs] *********************
2026-02-04 12:18:52,442 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:52 +0000 (0:02:00.376)       0:06:04.913 **** 
2026-02-04 12:18:52,817 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:18:52,822 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that telemetry-operator logs include expected error logs when MetricStorage is enabled, but COO isn't installed
RHOSO-123459] ***
2026-02-04 12:18:52,822 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:52 +0000 (0:00:00.379)       0:06:05.293 **** 
2026-02-04 12:18:52,845 p=36505 u=zuul n=ansible | ok: [localhost] => (item=INFO	Controllers.MetricStorage	Can't own MonitoringStack resource) => {
    "ansible_loop_var": "item",
    "changed": false,
    "item": "INFO\tControllers.MetricStorage\tCan't own MonitoringStack resource",
    "msg": "All assertions passed"
}
2026-02-04 12:18:52,850 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that telemetry-operator logs don't include errors when MetricStorage is enabled, but COO isn't installed
RHOSO-123460] ***
2026-02-04 12:18:52,850 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:52 +0000 (0:00:00.027)       0:06:05.321 **** 
2026-02-04 12:18:52,868 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"ansible_facts": {"error_list": ["ERROR\tReconciler error\t{\"controller\": \"autoscaling\", \"controllerGroup\": \"telemetry.openstack.org\", \"controllerKind\": \"Autoscaling\", \"Autoscaling\": {\"name\":\"autoscaling\",\"namespace\":\"openstack\"}, \"namespace\": \"openstack\", \"name\": \"autoscaling\", \"reconcileID\": \"7f1b713e-31a2-4ec3-a7bc-dbf78ecfbb42\", \"error\": \"ApplicationCredential secret not found: ac-aodh-secret\"}"]}, "changed": false, "failed_when_result": true}
2026-02-04 12:18:52,868 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:18:52,872 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get MetricStorage condition types] *******************
2026-02-04 12:18:52,872 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:52 +0000 (0:00:00.021)       0:06:05.343 **** 
2026-02-04 12:18:53,209 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:18:53,213 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get MetricStorage condition values] ******************
2026-02-04 12:18:53,213 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:53 +0000 (0:00:00.341)       0:06:05.684 **** 
2026-02-04 12:18:53,572 p=36505 u=zuul n=ansible | changed: [localhost] => (item=Ready)
2026-02-04 12:18:53,900 p=36505 u=zuul n=ansible | changed: [localhost] => (item=DashboardDatasourceReady)
2026-02-04 12:18:54,255 p=36505 u=zuul n=ansible | changed: [localhost] => (item=DashboardDefinitionReady)
2026-02-04 12:18:54,641 p=36505 u=zuul n=ansible | changed: [localhost] => (item=DashboardPluginReady)
2026-02-04 12:18:54,990 p=36505 u=zuul n=ansible | changed: [localhost] => (item=DashboardPrometheusRuleReady)
2026-02-04 12:18:55,343 p=36505 u=zuul n=ansible | changed: [localhost] => (item=MonitoringStackReady)
2026-02-04 12:18:55,696 p=36505 u=zuul n=ansible | changed: [localhost] => (item=NetworkAttachmentsReady)
2026-02-04 12:18:56,008 p=36505 u=zuul n=ansible | changed: [localhost] => (item=PrometheusReady)
2026-02-04 12:18:56,344 p=36505 u=zuul n=ansible | changed: [localhost] => (item=ScrapeConfigReady)
2026-02-04 12:18:56,679 p=36505 u=zuul n=ansible | changed: [localhost] => (item=TLSInputReady)
2026-02-04 12:18:56,688 p=36505 u=zuul n=ansible | TASK [default-telemetry : Construct MetricStorage condition dictionary] ********
2026-02-04 12:18:56,688 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:56 +0000 (0:00:03.474)       0:06:09.159 **** 
2026-02-04 12:18:56,800 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io "monitoringstacks.monitoring.rhobs" not found', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "Ready")].message}'], 'start': '2026-02-04 12:18:53.404034', 'end': '2026-02-04 12:18:53.545772', 'delta': '0:00:00.141738', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "Ready")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io "monitoringstacks.monitoring.rhobs" not found'], 'stderr_lines': [], 'failed': False, 'item': 'Ready', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,801 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Dashboard Datasource not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "DashboardDatasourceReady")].message}'], 'start': '2026-02-04 12:18:53.729625', 'end': '2026-02-04 12:18:53.872926', 'delta': '0:00:00.143301', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "DashboardDatasourceReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Dashboard Datasource not started'], 'stderr_lines': [], 'failed': False, 'item': 'DashboardDatasourceReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,803 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Dashboard Definition not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "DashboardDefinitionReady")].message}'], 'start': '2026-02-04 12:18:54.072861', 'end': '2026-02-04 12:18:54.220417', 'delta': '0:00:00.147556', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "DashboardDefinitionReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Dashboard Definition not started'], 'stderr_lines': [], 'failed': False, 'item': 'DashboardDefinitionReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,804 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Dashboard Plugin not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "DashboardPluginReady")].message}'], 'start': '2026-02-04 12:18:54.474593', 'end': '2026-02-04 12:18:54.611448', 'delta': '0:00:00.136855', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "DashboardPluginReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Dashboard Plugin not started'], 'stderr_lines': [], 'failed': False, 'item': 'DashboardPluginReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,805 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Dashboard PrometheusRule not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "DashboardPrometheusRuleReady")].message}'], 'start': '2026-02-04 12:18:54.797899', 'end': '2026-02-04 12:18:54.958963', 'delta': '0:00:00.161064', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "DashboardPrometheusRuleReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Dashboard PrometheusRule not started'], 'stderr_lines': [], 'failed': False, 'item': 'DashboardPrometheusRuleReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,806 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io "monitoringstacks.monitoring.rhobs" not found', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "MonitoringStackReady")].message}'], 'start': '2026-02-04 12:18:55.173974', 'end': '2026-02-04 12:18:55.317046', 'delta': '0:00:00.143072', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "MonitoringStackReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io "monitoringstacks.monitoring.rhobs" not found'], 'stderr_lines': [], 'failed': False, 'item': 'MonitoringStackReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,814 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'NetworkAttachments not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "NetworkAttachmentsReady")].message}'], 'start': '2026-02-04 12:18:55.514480', 'end': '2026-02-04 12:18:55.666540', 'delta': '0:00:00.152060', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "NetworkAttachmentsReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['NetworkAttachments not started'], 'stderr_lines': [], 'failed': False, 'item': 'NetworkAttachmentsReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,822 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Prometheus not ready', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "PrometheusReady")].message}'], 'start': '2026-02-04 12:18:55.853208', 'end': '2026-02-04 12:18:55.979869', 'delta': '0:00:00.126661', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "PrometheusReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Prometheus not ready'], 'stderr_lines': [], 'failed': False, 'item': 'PrometheusReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,830 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'ScrapeConfig not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "ScrapeConfigReady")].message}'], 'start': '2026-02-04 12:18:56.168142', 'end': '2026-02-04 12:18:56.318951', 'delta': '0:00:00.150809', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "ScrapeConfigReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ScrapeConfig not started'], 'stderr_lines': [], 'failed': False, 'item': 'ScrapeConfigReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,836 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Input data not checked', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'metricstorage', 'metric-storage', '-o', 'jsonpath={.status.conditions[?(@.type == "TLSInputReady")].message}'], 'start': '2026-02-04 12:18:56.501951', 'end': '2026-02-04 12:18:56.652373', 'delta': '0:00:00.150422', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get metricstorage metric-storage -o jsonpath=\'{.status.conditions[?(@.type == "TLSInputReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Input data not checked'], 'stderr_lines': [], 'failed': False, 'item': 'TLSInputReady', 'ansible_loop_var': 'item'})
2026-02-04 12:18:56,845 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that all MetricStorage conditions are as expected when COO isn't installed
RHOSO-123461] ***
2026-02-04 12:18:56,846 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:56 +0000 (0:00:00.157)       0:06:09.316 **** 
2026-02-04 12:18:56,874 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'key': 'MonitoringStackReady', 'value': 'Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io "monitoringstacks.monitoring.rhobs" not found'}) => {
    "ansible_loop_var": "item",
    "changed": false,
    "item": {
        "key": "MonitoringStackReady",
        "value": "Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io \"monitoringstacks.monitoring.rhobs\" not found"
    },
    "msg": "All assertions passed"
}
2026-02-04 12:18:56,875 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'key': 'Ready', 'value': 'Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io "monitoringstacks.monitoring.rhobs" not found'}) => {
    "ansible_loop_var": "item",
    "changed": false,
    "item": {
        "key": "Ready",
        "value": "Error occured when trying to own: customresourcedefinitions.apiextensions.k8s.io \"monitoringstacks.monitoring.rhobs\" not found"
    },
    "msg": "All assertions passed"
}
2026-02-04 12:18:56,881 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get Autoscaling condition types] *********************
2026-02-04 12:18:56,881 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:56 +0000 (0:00:00.035)       0:06:09.352 **** 
2026-02-04 12:18:57,220 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:18:57,226 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get Autoscaling condition values] ********************
2026-02-04 12:18:57,226 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:18:57 +0000 (0:00:00.345)       0:06:09.697 **** 
2026-02-04 12:18:57,583 p=36505 u=zuul n=ansible | changed: [localhost] => (item=Ready)
2026-02-04 12:18:57,937 p=36505 u=zuul n=ansible | changed: [localhost] => (item=DBReady)
2026-02-04 12:18:58,298 p=36505 u=zuul n=ansible | changed: [localhost] => (item=DBSyncReady)
2026-02-04 12:18:58,687 p=36505 u=zuul n=ansible | changed: [localhost] => (item=DeploymentReady)
2026-02-04 12:18:59,083 p=36505 u=zuul n=ansible | changed: [localhost] => (item=HeatReady)
2026-02-04 12:18:59,476 p=36505 u=zuul n=ansible | changed: [localhost] => (item=KeystoneEndpointReady)
2026-02-04 12:18:59,865 p=36505 u=zuul n=ansible | changed: [localhost] => (item=KeystoneServiceReady)
2026-02-04 12:19:00,212 p=36505 u=zuul n=ansible | changed: [localhost] => (item=MariaDBAccountReady)
2026-02-04 12:19:00,549 p=36505 u=zuul n=ansible | changed: [localhost] => (item=MemcachedReady)
2026-02-04 12:19:00,870 p=36505 u=zuul n=ansible | changed: [localhost] => (item=RabbitMqTransportURLReady)
2026-02-04 12:19:01,205 p=36505 u=zuul n=ansible | changed: [localhost] => (item=RoleBindingReady)
2026-02-04 12:19:01,555 p=36505 u=zuul n=ansible | changed: [localhost] => (item=RoleReady)
2026-02-04 12:19:01,894 p=36505 u=zuul n=ansible | changed: [localhost] => (item=ServiceAccountReady)
2026-02-04 12:19:02,288 p=36505 u=zuul n=ansible | changed: [localhost] => (item=ServiceConfigReady)
2026-02-04 12:19:02,634 p=36505 u=zuul n=ansible | changed: [localhost] => (item=TLSInputReady)
2026-02-04 12:19:02,644 p=36505 u=zuul n=ansible | TASK [default-telemetry : Construct Autoscaling condition dictionary] **********
2026-02-04 12:19:02,644 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:02 +0000 (0:00:05.417)       0:06:15.115 **** 
2026-02-04 12:19:02,686 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "Ready")].message}'], 'start': '2026-02-04 12:18:57.407868', 'end': '2026-02-04 12:18:57.553841', 'delta': '0:00:00.145973', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "Ready")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret'], 'stderr_lines': [], 'failed': False, 'item': 'Ready', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,696 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'DB create completed', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "DBReady")].message}'], 'start': '2026-02-04 12:18:57.743951', 'end': '2026-02-04 12:18:57.895312', 'delta': '0:00:00.151361', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "DBReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['DB create completed'], 'stderr_lines': [], 'failed': False, 'item': 'DBReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,707 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'DBsync not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "DBSyncReady")].message}'], 'start': '2026-02-04 12:18:58.110286', 'end': '2026-02-04 12:18:58.264611', 'delta': '0:00:00.154325', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "DBSyncReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['DBsync not started'], 'stderr_lines': [], 'failed': False, 'item': 'DBSyncReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,717 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Deployment not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "DeploymentReady")].message}'], 'start': '2026-02-04 12:18:58.490383', 'end': '2026-02-04 12:18:58.652128', 'delta': '0:00:00.161745', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "DeploymentReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Deployment not started'], 'stderr_lines': [], 'failed': False, 'item': 'DeploymentReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,725 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Setup complete', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "HeatReady")].message}'], 'start': '2026-02-04 12:18:58.905904', 'end': '2026-02-04 12:18:59.049371', 'delta': '0:00:00.143467', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "HeatReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Setup complete'], 'stderr_lines': [], 'failed': False, 'item': 'HeatReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,732 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "KeystoneEndpointReady")].message}'], 'start': '2026-02-04 12:18:59.306971', 'end': '2026-02-04 12:18:59.446550', 'delta': '0:00:00.139579', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "KeystoneEndpointReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'item': 'KeystoneEndpointReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,740 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "KeystoneServiceReady")].message}'], 'start': '2026-02-04 12:18:59.645423', 'end': '2026-02-04 12:18:59.828755', 'delta': '0:00:00.183332', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "KeystoneServiceReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'item': 'KeystoneServiceReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,747 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'MariaDBAccount creation complete', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "MariaDBAccountReady")].message}'], 'start': '2026-02-04 12:19:00.055761', 'end': '2026-02-04 12:19:00.186600', 'delta': '0:00:00.130839', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "MariaDBAccountReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['MariaDBAccount creation complete'], 'stderr_lines': [], 'failed': False, 'item': 'MariaDBAccountReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,754 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': ' Memcached instance has been provisioned', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "MemcachedReady")].message}'], 'start': '2026-02-04 12:19:00.371733', 'end': '2026-02-04 12:19:00.523643', 'delta': '0:00:00.151910', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "MemcachedReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [' Memcached instance has been provisioned'], 'stderr_lines': [], 'failed': False, 'item': 'MemcachedReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,761 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'RabbitMqTransportURL successfully created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "RabbitMqTransportURLReady")].message}'], 'start': '2026-02-04 12:19:00.711775', 'end': '2026-02-04 12:19:00.837343', 'delta': '0:00:00.125568', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "RabbitMqTransportURLReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['RabbitMqTransportURL successfully created'], 'stderr_lines': [], 'failed': False, 'item': 'RabbitMqTransportURLReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,769 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'RoleBinding created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "RoleBindingReady")].message}'], 'start': '2026-02-04 12:19:01.048501', 'end': '2026-02-04 12:19:01.172004', 'delta': '0:00:00.123503', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "RoleBindingReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['RoleBinding created'], 'stderr_lines': [], 'failed': False, 'item': 'RoleBindingReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,776 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Role created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "RoleReady")].message}'], 'start': '2026-02-04 12:19:01.383630', 'end': '2026-02-04 12:19:01.525849', 'delta': '0:00:00.142219', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "RoleReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Role created'], 'stderr_lines': [], 'failed': False, 'item': 'RoleReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,784 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'ServiceAccount created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "ServiceAccountReady")].message}'], 'start': '2026-02-04 12:19:01.720745', 'end': '2026-02-04 12:19:01.861689', 'delta': '0:00:00.140944', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "ServiceAccountReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ServiceAccount created'], 'stderr_lines': [], 'failed': False, 'item': 'ServiceAccountReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,792 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "ServiceConfigReady")].message}'], 'start': '2026-02-04 12:19:02.084572', 'end': '2026-02-04 12:19:02.257007', 'delta': '0:00:00.172435', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "ServiceConfigReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret'], 'stderr_lines': [], 'failed': False, 'item': 'ServiceConfigReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,800 p=36505 u=zuul n=ansible | ok: [localhost] => (item={'changed': True, 'stdout': 'Input data not checked', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == "TLSInputReady")].message}'], 'start': '2026-02-04 12:19:02.454176', 'end': '2026-02-04 12:19:02.607082', 'delta': '0:00:00.152906', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\'{.status.conditions[?(@.type == "TLSInputReady")].message}\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Input data not checked'], 'stderr_lines': [], 'failed': False, 'item': 'TLSInputReady', 'ansible_loop_var': 'item'})
2026-02-04 12:19:02,816 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that all Autoscaling conditions are as expected when COO isn't installed
RHOSO-123462] ***
2026-02-04 12:19:02,816 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:02 +0000 (0:00:00.172)       0:06:15.287 **** 
2026-02-04 12:19:02,846 p=36505 u=zuul n=ansible | failed: [localhost] (item={'key': 'Ready', 'value': 'Setup complete'}) => {
    "ansible_loop_var": "item",
    "assertion": "conditions[item.key] == item.value",
    "changed": false,
    "evaluated_to": false,
    "item": {
        "key": "Ready",
        "value": "Setup complete"
    },
    "msg": "Expected Ready condition field to be Setup complete, not {'results': [{'changed': True, 'stdout': 'Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"Ready\")].message}'], 'start': '2026-02-04 12:18:57.407868', 'end': '2026-02-04 12:18:57.553841', 'delta': '0:00:00.145973', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"Ready\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret'], 'stderr_lines': [], 'failed': False, 'item': 'Ready', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'DB create completed', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"DBReady\")].message}'], 'start': '2026-02-04 12:18:57.743951', 'end': '2026-02-04 12:18:57.895312', 'delta': '0:00:00.151361', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"DBReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['DB create completed'], 'stderr_lines': [], 'failed': False, 'item': 'DBReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'DBsync not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"DBSyncReady\")].message}'], 'start': '2026-02-04 12:18:58.110286', 'end': '2026-02-04 12:18:58.264611', 'delta': '0:00:00.154325', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"DBSyncReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['DBsync not started'], 'stderr_lines': [], 'failed': False, 'item': 'DBSyncReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'Deployment not started', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"DeploymentReady\")].message}'], 'start': '2026-02-04 12:18:58.490383', 'end': '2026-02-04 12:18:58.652128', 'delta': '0:00:00.161745', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"DeploymentReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Deployment not started'], 'stderr_lines': [], 'failed': False, 'item': 'DeploymentReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'Setup complete', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"HeatReady\")].message}'], 'start': '2026-02-04 12:18:58.905904', 'end': '2026-02-04 12:18:59.049371', 'delta': '0:00:00.143467', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"HeatReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Setup complete'], 'stderr_lines': [], 'failed': False, 'item': 'HeatReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"KeystoneEndpointReady\")].message}'], 'start': '2026-02-04 12:18:59.306971', 'end': '2026-02-04 12:18:59.446550', 'delta': '0:00:00.139579', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"KeystoneEndpointReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'item': 'KeystoneEndpointReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': '', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"KeystoneServiceReady\")].message}'], 'start': '2026-02-04 12:18:59.645423', 'end': '2026-02-04 12:18:59.828755', 'delta': '0:00:00.183332', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"KeystoneServiceReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [], 'stderr_lines': [], 'failed': False, 'item': 'KeystoneServiceReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'MariaDBAccount creation complete', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"MariaDBAccountReady\")].message}'], 'start': '2026-02-04 12:19:00.055761', 'end': '2026-02-04 12:19:00.186600', 'delta': '0:00:00.130839', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"MariaDBAccountReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['MariaDBAccount creation complete'], 'stderr_lines': [], 'failed': False, 'item': 'MariaDBAccountReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': ' Memcached instance has been provisioned', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"MemcachedReady\")].message}'], 'start': '2026-02-04 12:19:00.371733', 'end': '2026-02-04 12:19:00.523643', 'delta': '0:00:00.151910', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"MemcachedReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': [' Memcached instance has been provisioned'], 'stderr_lines': [], 'failed': False, 'item': 'MemcachedReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'RabbitMqTransportURL successfully created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"RabbitMqTransportURLReady\")].message}'], 'start': '2026-02-04 12:19:00.711775', 'end': '2026-02-04 12:19:00.837343', 'delta': '0:00:00.125568', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"RabbitMqTransportURLReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['RabbitMqTransportURL successfully created'], 'stderr_lines': [], 'failed': False, 'item': 'RabbitMqTransportURLReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'RoleBinding created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"RoleBindingReady\")].message}'], 'start': '2026-02-04 12:19:01.048501', 'end': '2026-02-04 12:19:01.172004', 'delta': '0:00:00.123503', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"RoleBindingReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['RoleBinding created'], 'stderr_lines': [], 'failed': False, 'item': 'RoleBindingReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'Role created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"RoleReady\")].message}'], 'start': '2026-02-04 12:19:01.383630', 'end': '2026-02-04 12:19:01.525849', 'delta': '0:00:00.142219', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"RoleReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Role created'], 'stderr_lines': [], 'failed': False, 'item': 'RoleReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'ServiceAccount created', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"ServiceAccountReady\")].message}'], 'start': '2026-02-04 12:19:01.720745', 'end': '2026-02-04 12:19:01.861689', 'delta': '0:00:00.140944', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"ServiceAccountReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['ServiceAccount created'], 'stderr_lines': [], 'failed': False, 'item': 'ServiceAccountReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"ServiceConfigReady\")].message}'], 'start': '2026-02-04 12:19:02.084572', 'end': '2026-02-04 12:19:02.257007', 'delta': '0:00:00.172435', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"ServiceConfigReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Service config create error occurred ApplicationCredential secret not found: ac-aodh-secret'], 'stderr_lines': [], 'failed': False, 'item': 'ServiceConfigReady', 'ansible_loop_var': 'item'}, {'changed': True, 'stdout': 'Input data not checked', 'stderr': '', 'rc': 0, 'cmd': ['oc', 'get', 'autoscaling', 'autoscaling', '-o', 'jsonpath={.status.conditions[?(@.type == \"TLSInputReady\")].message}'], 'start': '2026-02-04 12:19:02.454176', 'end': '2026-02-04 12:19:02.607082', 'delta': '0:00:00.152906', 'msg': '', 'invocation': {'module_args': {'_raw_params': 'oc get autoscaling autoscaling -o jsonpath=\\'{.status.conditions[?(@.type == \"TLSInputReady\")].message}\\'', '_uses_shell': False, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'stdout_lines': ['Input data not checked'], 'stderr_lines': [], 'failed': False, 'item': 'TLSInputReady', 'ansible_loop_var': 'item'}], 'skipped': False, 'changed': True, 'msg': 'All items completed'}"
}
2026-02-04 12:19:02,848 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:19:02,852 p=36505 u=zuul n=ansible | TASK [default-telemetry : Enable Autoscaling and MetricStorage] ****************
2026-02-04 12:19:02,852 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:02 +0000 (0:00:00.035)       0:06:15.323 **** 
2026-02-04 12:19:02,867 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/../../create-coo-subscription.yaml for localhost
2026-02-04 12:19:02,889 p=36505 u=zuul n=ansible | TASK [default-telemetry : Create the COO subscription] *************************
2026-02-04 12:19:02,890 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:02 +0000 (0:00:00.037)       0:06:15.361 **** 
2026-02-04 12:19:03,222 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:19:03,226 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for the required resource to be created] ********
2026-02-04 12:19:03,226 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:03 +0000 (0:00:00.336)       0:06:15.697 **** 
2026-02-04 12:19:24,328 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:19:24,332 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for the resources to be available] **************
2026-02-04 12:19:24,332 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:24 +0000 (0:00:21.105)       0:06:36.803 **** 
2026-02-04 12:19:58,630 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:19:58,634 p=36505 u=zuul n=ansible | TASK [default-telemetry : Check telemetry with COO and with Autoscaling and MetricStorage enabled] ***
2026-02-04 12:19:58,635 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:58 +0000 (0:00:34.302)       0:07:11.105 **** 
2026-02-04 12:19:58,649 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/coo_autoscaling_metricstorage.yml for localhost
2026-02-04 12:19:58,672 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait until Autoscaling and MetricStorage are ready] ***
2026-02-04 12:19:58,672 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:19:58 +0000 (0:00:00.037)       0:07:11.143 **** 
2026-02-04 12:21:01,414 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:21:01,418 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get current time] ************************************
2026-02-04 12:21:01,418 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:21:01 +0000 (0:01:02.745)       0:08:13.889 **** 
2026-02-04 12:21:01,434 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:21:01,438 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for new logs to be generated] *******************
2026-02-04 12:21:01,438 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:21:01 +0000 (0:00:00.020)       0:08:13.909 **** 
2026-02-04 12:23:01,743 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:23:01,747 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get new telemetry-operator logs] *********************
2026-02-04 12:23:01,747 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:23:01 +0000 (0:02:00.308)       0:10:14.218 **** 
2026-02-04 12:23:02,158 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:23:02,162 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that telemetry-operator logs don't include any errors after COO is installed
RHOSO-123463] ***
2026-02-04 12:23:02,163 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:23:02 +0000 (0:00:00.415)       0:10:14.634 **** 
2026-02-04 12:23:02,186 p=36505 u=zuul n=ansible | ok: [localhost] => {
    "changed": false,
    "msg": "All assertions passed"
}
2026-02-04 12:23:02,191 p=36505 u=zuul n=ansible | TASK [default-telemetry : Test CustomMonitoringStack] **************************
2026-02-04 12:23:02,191 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:23:02 +0000 (0:00:00.028)       0:10:14.662 **** 
2026-02-04 12:23:02,216 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/test_custom_monitoring_stack.yml for localhost
2026-02-04 12:23:02,251 p=36505 u=zuul n=ansible | TASK [default-telemetry : Patch MetricStorage to use CustomMonitoringStack field] ***
2026-02-04 12:23:02,251 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:23:02 +0000 (0:00:00.059)       0:10:14.722 **** 
2026-02-04 12:23:02,741 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:23:02,746 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait until MetricStorage is ready] *******************
2026-02-04 12:23:02,746 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:23:02 +0000 (0:00:00.495)       0:10:15.217 **** 
2026-02-04 12:25:03,132 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["oc", "wait", "telemetry", "telemetry", "--for=condition=Ready", "--timeout=2m"], "delta": "0:02:00.151553", "end": "2026-02-04 12:25:03.103073", "msg": "non-zero return code", "rc": 1, "start": "2026-02-04 12:23:02.951520", "stderr": "error: timed out waiting for the condition on telemetries/telemetry", "stderr_lines": ["error: timed out waiting for the condition on telemetries/telemetry"], "stdout": "", "stdout_lines": []}
2026-02-04 12:25:03,132 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:25:03,136 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get current time] ************************************
2026-02-04 12:25:03,136 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:25:03 +0000 (0:02:00.390)       0:12:15.607 **** 
2026-02-04 12:25:03,154 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:25:03,160 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for new logs to be generated] *******************
2026-02-04 12:25:03,160 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:25:03 +0000 (0:00:00.024)       0:12:15.631 **** 
2026-02-04 12:27:03,441 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:27:03,446 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get new telemetry-operator logs] *********************
2026-02-04 12:27:03,446 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:27:03 +0000 (0:02:00.285)       0:14:15.917 **** 
2026-02-04 12:27:03,881 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:27:03,886 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that telemetry-operator logs don't include any errors when using the CustomMonitoringStack
RHOSO-123464] ***
2026-02-04 12:27:03,886 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:27:03 +0000 (0:00:00.439)       0:14:16.357 **** 
2026-02-04 12:27:03,906 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:27:03,910 p=36505 u=zuul n=ansible | TASK [default-telemetry : Patch Autoscaling to use a custom Prometheus instance] ***
2026-02-04 12:27:03,911 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:27:03 +0000 (0:00:00.024)       0:14:16.382 **** 
2026-02-04 12:27:04,387 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:27:04,392 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait until Autoscaling is ready] *********************
2026-02-04 12:27:04,392 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:27:04 +0000 (0:00:00.481)       0:14:16.863 **** 
2026-02-04 12:29:04,709 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["oc", "wait", "telemetry", "telemetry", "--for=condition=Ready", "--timeout=2m"], "delta": "0:02:00.109790", "end": "2026-02-04 12:29:04.680918", "msg": "non-zero return code", "rc": 1, "start": "2026-02-04 12:27:04.571128", "stderr": "error: timed out waiting for the condition on telemetries/telemetry", "stderr_lines": ["error: timed out waiting for the condition on telemetries/telemetry"], "stdout": "", "stdout_lines": []}
2026-02-04 12:29:04,709 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:29:04,713 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get current time] ************************************
2026-02-04 12:29:04,713 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:29:04 +0000 (0:02:00.321)       0:16:17.184 **** 
2026-02-04 12:29:04,732 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:29:04,736 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for new logs to be generated] *******************
2026-02-04 12:29:04,737 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:29:04 +0000 (0:00:00.023)       0:16:17.207 **** 
2026-02-04 12:31:05,058 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:31:05,062 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get new telemetry-operator logs] *********************
2026-02-04 12:31:05,063 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:05 +0000 (0:02:00.326)       0:18:17.533 **** 
2026-02-04 12:31:05,472 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:31:05,477 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that telemetry-operator logs don't include any errors when using a custom Prometheus instance for Autoscaling
RHOSO-123465] ***
2026-02-04 12:31:05,477 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:05 +0000 (0:00:00.414)       0:18:17.948 **** 
2026-02-04 12:31:05,494 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:31:05,498 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check Prometheus host is set correctly in the aodh-evaluator container when using a custom Prometheus
RHOSO-123466] ***
2026-02-04 12:31:05,498 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:05 +0000 (0:00:00.021)       0:18:17.969 **** 
2026-02-04 12:31:05,884 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": "oc rsh -c aodh-evaluator aodh-0 cat /etc/openstack/prometheus.yaml | grep host | cut -d \" \" -f 2", "delta": "0:00:00.146893", "end": "2026-02-04 12:31:05.850337", "failed_when_result": true, "msg": "", "rc": 0, "start": "2026-02-04 12:31:05.703444", "stderr": "Error from server (NotFound): pods \"aodh-0\" not found", "stderr_lines": ["Error from server (NotFound): pods \"aodh-0\" not found"], "stdout": "", "stdout_lines": []}
2026-02-04 12:31:05,885 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:31:05,890 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check Prometheus port is set correctly in the aodh-evaluator container when using a custom Prometheus
RHOSO-123467] ***
2026-02-04 12:31:05,891 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:05 +0000 (0:00:00.392)       0:18:18.362 **** 
2026-02-04 12:31:06,316 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": "oc rsh -c aodh-evaluator aodh-0 cat /etc/openstack/prometheus.yaml | grep port | cut -d \" \" -f 2", "delta": "0:00:00.156166", "end": "2026-02-04 12:31:06.283962", "failed_when_result": true, "msg": "", "rc": 0, "start": "2026-02-04 12:31:06.127796", "stderr": "Error from server (NotFound): pods \"aodh-0\" not found", "stderr_lines": ["Error from server (NotFound): pods \"aodh-0\" not found"], "stdout": "", "stdout_lines": []}
2026-02-04 12:31:06,316 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:31:06,320 p=36505 u=zuul n=ansible | TASK [default-telemetry : Test podlevel TLS with NAD for MetricStorage] ********
2026-02-04 12:31:06,321 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:06 +0000 (0:00:00.429)       0:18:18.791 **** 
2026-02-04 12:31:06,342 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/test_podlevel_tls_with_nad_metricstorage.yml for localhost
2026-02-04 12:31:06,373 p=36505 u=zuul n=ansible | TASK [default-telemetry : Enable TLS at a pod level] ***************************
2026-02-04 12:31:06,374 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:06 +0000 (0:00:00.053)       0:18:18.845 **** 
2026-02-04 12:31:06,984 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:31:06,990 p=36505 u=zuul n=ansible | TASK [default-telemetry : Set NAD for MetricStorage] ***************************
2026-02-04 12:31:06,990 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:06 +0000 (0:00:00.616)       0:18:19.461 **** 
2026-02-04 12:31:07,526 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:31:07,531 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait until MetricStorage is ready] *******************
2026-02-04 12:31:07,532 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:31:07 +0000 (0:00:00.541)       0:18:20.003 **** 
2026-02-04 12:33:07,886 p=36505 u=zuul n=ansible | fatal: [localhost]: FAILED! => {"changed": true, "cmd": ["oc", "wait", "telemetry", "telemetry", "--for=condition=Ready", "--timeout=2m"], "delta": "0:02:00.145929", "end": "2026-02-04 12:33:07.862485", "msg": "non-zero return code", "rc": 1, "start": "2026-02-04 12:31:07.716556", "stderr": "error: timed out waiting for the condition on telemetries/telemetry", "stderr_lines": ["error: timed out waiting for the condition on telemetries/telemetry"], "stdout": "", "stdout_lines": []}
2026-02-04 12:33:07,886 p=36505 u=zuul n=ansible | ...ignoring
2026-02-04 12:33:07,891 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get current time] ************************************
2026-02-04 12:33:07,891 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:33:07 +0000 (0:02:00.359)       0:20:20.362 **** 
2026-02-04 12:33:07,905 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:33:07,910 p=36505 u=zuul n=ansible | TASK [default-telemetry : Wait for new logs to be generated] *******************
2026-02-04 12:33:07,910 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:33:07 +0000 (0:00:00.018)       0:20:20.381 **** 
2026-02-04 12:35:08,194 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:35:08,198 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get new telemetry-operator logs] *********************
2026-02-04 12:35:08,198 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:35:08 +0000 (0:02:00.288)       0:22:20.669 **** 
2026-02-04 12:35:08,548 p=36505 u=zuul n=ansible | changed: [localhost]
2026-02-04 12:35:08,553 p=36505 u=zuul n=ansible | TASK [default-telemetry : TEST Check that telemetry-operator logs don't include any errors when using TLS at a pod level
OSPRH-14635] ***
2026-02-04 12:35:08,554 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:35:08 +0000 (0:00:00.355)       0:22:21.025 **** 
2026-02-04 12:35:08,574 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:35:08,578 p=36505 u=zuul n=ansible | TASK [default-telemetry : Test Prometheus_secret values] ***********************
2026-02-04 12:35:08,578 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:35:08 +0000 (0:00:00.024)       0:22:21.049 **** 
2026-02-04 12:35:08,593 p=36505 u=zuul n=ansible | included: /home/zuul/src/github.com/openstack-k8s-operators/telemetry-operator/ci/default-telemetry/tasks/test_prometheus_secret.yml for localhost
2026-02-04 12:35:08,626 p=36505 u=zuul n=ansible | TASK [default-telemetry : Get metric-storage-prometheus-endpoint secret values] ***
2026-02-04 12:35:08,626 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:35:08 +0000 (0:00:00.047)       0:22:21.097 **** 
2026-02-04 12:35:09,005 p=36505 u=zuul n=ansible | ok: [localhost]
2026-02-04 12:35:09,008 p=36505 u=zuul n=ansible | TASK [default-telemetry : Show secret decoded values] **************************
2026-02-04 12:35:09,008 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:35:09 +0000 (0:00:00.382)       0:22:21.479 **** 
2026-02-04 12:35:09,026 p=36505 u=zuul n=ansible | ok: [localhost] => {
    "secret_output.stdout_lines": [
        "ca_key=ca.crt",
        "ca_secret=ce**********vc",
        "host=metric-storage-prometheus.openstack.svc",
        "port=9090"
    ]
}
2026-02-04 12:35:09,030 p=36505 u=zuul n=ansible | TASK [default-telemetry : Assert secret contains expected values] **************
2026-02-04 12:35:09,030 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:35:09 +0000 (0:00:00.022)       0:22:21.501 **** 
2026-02-04 12:35:09,049 p=36505 u=zuul n=ansible | ok: [localhost] => {
    "changed": false,
    "msg": "Secret metric-storage-prometheus-endpoint contains all required values"
}
2026-02-04 12:35:09,064 p=36505 u=zuul n=ansible | PLAY RECAP *********************************************************************
2026-02-04 12:35:09,064 p=36505 u=zuul n=ansible | localhost                  : ok=71   changed=30   unreachable=0    failed=0    skipped=1    rescued=0    ignored=9   
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | Wednesday 04 February 2026  12:35:09 +0000 (0:00:00.039)       0:22:21.541 **** 
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | =============================================================================== 
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait for new logs to be generated ----------------- 120.46s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait until MetricStorage is ready ----------------- 120.39s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait for new logs to be generated ----------------- 120.38s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait until MetricStorage is ready ----------------- 120.36s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait until reconciliation finishes ---------------- 120.33s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait for new logs to be generated ----------------- 120.33s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait until Autoscaling is ready ------------------- 120.32s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait for new logs to be generated ----------------- 120.31s
2026-02-04 12:35:09,070 p=36505 u=zuul n=ansible | default-telemetry : Wait for new logs to be generated ----------------- 120.29s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Wait for new logs to be generated ----------------- 120.29s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Wait until Autoscaling and MetricStorage are ready -- 62.75s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Wait for the resources to be available ------------- 34.30s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Wait for the required resource to be created ------- 21.11s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get Autoscaling condition values -------------------- 5.42s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get MetricStorage condition values ------------------ 3.47s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Enable TLS at a pod level --------------------------- 0.62s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Enable Autoscaling ---------------------------------- 0.57s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Set NAD for MetricStorage --------------------------- 0.54s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Wait until telemetry is finished reconciling and its conditions are all True --- 0.53s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Patch MetricStorage to use CustomMonitoringStack field --- 0.50s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Patch Autoscaling to use a custom Prometheus instance --- 0.48s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator pod data --------------------- 0.46s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Enable MetricStorage -------------------------------- 0.44s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get new telemetry-operator logs --------------------- 0.44s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : TEST Check Prometheus port is set correctly in the aodh-evaluator container when using a custom Prometheus
RHOSO-123467
 --- 0.43s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get new telemetry-operator logs --------------------- 0.42s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get new telemetry-operator logs --------------------- 0.41s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get new telemetry-operator logs --------------------- 0.41s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : TEST Check Prometheus host is set correctly in the aodh-evaluator container when using a custom Prometheus
RHOSO-123466
 --- 0.39s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get metric-storage-prometheus-endpoint secret values --- 0.38s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get new telemetry-operator logs --------------------- 0.38s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get new telemetry-operator logs --------------------- 0.36s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator failed container logs -------- 0.35s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get Autoscaling condition types --------------------- 0.35s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get MetricStorage condition types ------------------- 0.34s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Create the COO subscription ------------------------- 0.34s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator pod data --------------------- 0.31s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator failed container logs -------- 0.31s
2026-02-04 12:35:09,071 p=36505 u=zuul n=ansible | default-telemetry : Construct Autoscaling condition dictionary ---------- 0.17s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Construct MetricStorage condition dictionary -------- 0.16s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Test CustomMonitoringStack -------------------------- 0.06s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Test podlevel TLS with NAD for MetricStorage -------- 0.05s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Test Prometheus_secret values ----------------------- 0.05s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Check telemetry without COO and with Autoscaling and MetricStorage enabled --- 0.05s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Assert secret contains expected values -------------- 0.04s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Check telemetry with COO and with Autoscaling and MetricStorage enabled --- 0.04s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Enable Autoscaling and MetricStorage ---------------- 0.04s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that all Autoscaling conditions are as expected when COO isn't installed
RHOSO-123462
 --- 0.04s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that all MetricStorage conditions are as expected when COO isn't installed
RHOSO-123461
 --- 0.04s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that telemetry-operator logs don't include any errors after COO is installed
RHOSO-123463
 --- 0.03s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that telemetry-operator logs include expected error logs when MetricStorage is enabled, but COO isn't installed
RHOSO-123459
 --- 0.03s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Check telemetry without COO and without Autoscaling and MetricStorage enabled --- 0.03s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Enable Autoscaling and MetricStorage ---------------- 0.03s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that telemetry-operator logs don't include any errors when using the CustomMonitoringStack
RHOSO-123464
 --- 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that telemetry-operator logs don't include any errors when using TLS at a pod level
OSPRH-14635
 --- 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Output logs of failed container for debugging purposes --- 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator restart counts --------------- 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Get current time ------------------------------------ 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check telemetry-operator logs for errors after it's started
RHOSO-123456
 --- 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Get current time ------------------------------------ 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator container statuses ----------- 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : Show secret decoded values -------------------------- 0.02s
2026-02-04 12:35:09,072 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that telemetry-operator logs don't include errors when MetricStorage is enabled, but COO isn't installed
RHOSO-123460
 --- 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : TEST Check that telemetry-operator logs don't include any errors when using a custom Prometheus instance for Autoscaling
RHOSO-123465
 --- 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : Get current time ------------------------------------ 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : Get current time ------------------------------------ 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : Output logs of failed container for debugging purposes --- 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : Get current time ------------------------------------ 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator restart counts --------------- 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : Get current time ------------------------------------ 0.02s
2026-02-04 12:35:09,073 p=36505 u=zuul n=ansible | default-telemetry : Get telemetry-operator container statuses ----------- 0.02s