2026-03-17 01:38:36,317 p=39425 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-17 01:38:36,318 p=39425 u=zuul n=ansible | PLAY [Verify logging journalctl identifiers] *********************************** 2026-03-17 01:38:36,326 p=39425 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-17 01:38:36,326 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:36 +0000 (0:00:00.011) 0:00:00.011 ********* 2026-03-17 01:38:38,859 p=39425 u=zuul n=ansible | ok: [compute-0] 2026-03-17 01:38:38,894 p=39425 u=zuul n=ansible | TASK [telemetry_logging : Verify journal entries] ****************************** 2026-03-17 01:38:38,894 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:38 +0000 (0:00:02.567) 0:00:02.578 ********* 2026-03-17 01:38:38,938 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-17 01:38:38,941 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=nova_compute) 2026-03-17 01:38:38,953 p=39425 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-17 01:38:38,953 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:38 +0000 (0:00:00.059) 0:00:02.638 ********* 2026-03-17 01:38:40,256 p=39425 u=zuul n=ansible | ok: [compute-0] 2026-03-17 01:38:40,278 p=39425 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-17 01:38:40,278 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:40 +0000 (0:00:01.324) 0:00:03.962 ********* 2026-03-17 01:38:40,351 p=39425 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-17 01:38:40,365 p=39425 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-17 01:38:40,365 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:40 +0000 (0:00:00.087) 0:00:04.049 ********* 2026-03-17 01:38:42,965 p=39425 u=zuul n=ansible | ok: [compute-0] 2026-03-17 01:38:43,023 p=39425 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-17 01:38:43,023 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:02.658) 0:00:06.708 ********* 2026-03-17 01:38:43,092 p=39425 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-17 01:38:43,106 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:38:43,107 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:00.083) 0:00:06.791 ********* 2026-03-17 01:38:43,126 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:43,134 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:38:43,134 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:00.027) 0:00:06.818 ********* 2026-03-17 01:38:43,149 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:43,157 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:38:43,157 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:00.022) 0:00:06.841 ********* 2026-03-17 01:38:43,173 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:43,182 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:38:43,182 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:00.025) 0:00:06.866 ********* 2026-03-17 01:38:43,197 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:43,205 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:38:43,206 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:00.023) 0:00:06.890 ********* 2026-03-17 01:38:43,222 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:43,231 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:38:43,231 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:00.025) 0:00:06.915 ********* 2026-03-17 01:38:43,259 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/file_tests.yml for compute-0 => (item=/etc/rsyslog.d/10-telemetry.conf) 2026-03-17 01:38:43,268 p=39425 u=zuul n=ansible | TASK [common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf"] ******** 2026-03-17 01:38:43,268 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:43 +0000 (0:00:00.037) 0:00:06.952 ********* 2026-03-17 01:38:44,085 p=39425 u=zuul n=ansible | ok: [compute-0] 2026-03-17 01:38:44,094 p=39425 u=zuul n=ansible | TASK [common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists] *** 2026-03-17 01:38:44,094 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:44 +0000 (0:00:00.825) 0:00:07.778 ********* 2026-03-17 01:38:44,134 p=39425 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed" } 2026-03-17 01:38:44,143 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:38:44,143 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:44 +0000 (0:00:00.049) 0:00:07.827 ********* 2026-03-17 01:38:44,159 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:44,168 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:38:44,168 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:44 +0000 (0:00:00.024) 0:00:07.852 ********* 2026-03-17 01:38:44,184 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:44,192 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:38:44,193 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:44 +0000 (0:00:00.024) 0:00:07.877 ********* 2026-03-17 01:38:44,208 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:44,216 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:38:44,216 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:44 +0000 (0:00:00.023) 0:00:07.900 ********* 2026-03-17 01:38:44,231 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:44,240 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:38:44,241 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:44 +0000 (0:00:00.024) 0:00:07.925 ********* 2026-03-17 01:38:44,256 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:44,293 p=39425 u=zuul n=ansible | PLAY [Run container tests which require root on compute nodes] ***************** 2026-03-17 01:38:44,303 p=39425 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-17 01:38:44,303 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:44 +0000 (0:00:00.062) 0:00:07.988 ********* 2026-03-17 01:38:46,430 p=39425 u=zuul n=ansible | ok: [compute-0] 2026-03-17 01:38:46,485 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:38:46,485 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:02.181) 0:00:10.169 ********* 2026-03-17 01:38:46,786 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,794 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:38:46,794 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.309) 0:00:10.479 ********* 2026-03-17 01:38:46,810 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,819 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:38:46,819 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.024) 0:00:10.503 ********* 2026-03-17 01:38:46,833 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,842 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:38:46,842 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.023) 0:00:10.526 ********* 2026-03-17 01:38:46,856 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,863 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:38:46,864 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.021) 0:00:10.548 ********* 2026-03-17 01:38:46,877 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,885 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:38:46,885 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.021) 0:00:10.569 ********* 2026-03-17 01:38:46,900 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,907 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:38:46,907 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.022) 0:00:10.592 ********* 2026-03-17 01:38:46,921 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,929 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:38:46,929 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.021) 0:00:10.613 ********* 2026-03-17 01:38:46,945 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,955 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:38:46,955 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.026) 0:00:10.640 ********* 2026-03-17 01:38:46,971 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:46,979 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:38:46,979 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:46 +0000 (0:00:00.023) 0:00:10.663 ********* 2026-03-17 01:38:46,994 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:47,002 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:38:47,002 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:47 +0000 (0:00:00.022) 0:00:10.686 ********* 2026-03-17 01:38:47,034 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-17 01:38:47,038 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=node_exporter) 2026-03-17 01:38:47,048 p=39425 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-17 01:38:47,048 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:47 +0000 (0:00:00.045) 0:00:10.732 ********* 2026-03-17 01:38:47,927 p=39425 u=zuul n=ansible | ok: [compute-0] 2026-03-17 01:38:47,937 p=39425 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-17 01:38:47,937 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:47 +0000 (0:00:00.888) 0:00:11.621 ********* 2026-03-17 01:38:47,955 p=39425 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "ceilometer_agent_compute Up 8 minutes (healthy)" } 2026-03-17 01:38:47,964 p=39425 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-17 01:38:47,964 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:47 +0000 (0:00:00.027) 0:00:11.648 ********* 2026-03-17 01:38:47,987 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:47,996 p=39425 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-17 01:38:47,996 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:47 +0000 (0:00:00.031) 0:00:11.680 ********* 2026-03-17 01:38:48,018 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:48,027 p=39425 u=zuul n=ansible | TASK [common : TEST Verify ceilometer_agent_compute container status] ********** 2026-03-17 01:38:48,027 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.031) 0:00:11.712 ********* 2026-03-17 01:38:48,056 p=39425 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'ceilometer_agent_compute' is in 'healthy' status." } 2026-03-17 01:38:48,064 p=39425 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-17 01:38:48,064 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.036) 0:00:11.748 ********* 2026-03-17 01:38:48,698 p=39425 u=zuul n=ansible | ok: [compute-0] 2026-03-17 01:38:48,707 p=39425 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-17 01:38:48,708 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.643) 0:00:12.392 ********* 2026-03-17 01:38:48,725 p=39425 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "node_exporter Up 7 minutes (healthy)" } 2026-03-17 01:38:48,736 p=39425 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-17 01:38:48,736 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.028) 0:00:12.420 ********* 2026-03-17 01:38:48,761 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:48,769 p=39425 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-17 01:38:48,770 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.033) 0:00:12.454 ********* 2026-03-17 01:38:48,793 p=39425 u=zuul n=ansible | skipping: [compute-0] 2026-03-17 01:38:48,802 p=39425 u=zuul n=ansible | TASK [common : TEST Verify node_exporter container status] ********************* 2026-03-17 01:38:48,802 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.032) 0:00:12.487 ********* 2026-03-17 01:38:48,834 p=39425 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'node_exporter' is in 'healthy' status." } 2026-03-17 01:38:48,869 p=39425 u=zuul n=ansible | PLAY [Verify logging projects, endpoints, credentials, nodes, pods, services, manifests and subscriptions] *** 2026-03-17 01:38:48,877 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:38:48,877 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.074) 0:00:12.561 ********* 2026-03-17 01:38:48,914 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-operator-controller-manager) 2026-03-17 01:38:48,916 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstack-operator-controller-manager) 2026-03-17 01:38:48,922 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:38:48,922 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:48 +0000 (0:00:00.045) 0:00:12.607 ********* 2026-03-17 01:38:49,732 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:38:49,737 p=39425 u=zuul n=ansible | TASK [common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-17 01:38:49,738 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:49 +0000 (0:00:00.815) 0:00:13.422 ********* 2026-03-17 01:38:50,270 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:38:50,275 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:38:50,275 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:50 +0000 (0:00:00.537) 0:00:13.960 ********* 2026-03-17 01:38:50,856 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:38:50,862 p=39425 u=zuul n=ansible | TASK [common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-17 01:38:50,863 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:50 +0000 (0:00:00.587) 0:00:14.547 ********* 2026-03-17 01:38:51,389 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:38:51,393 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:38:51,393 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:51 +0000 (0:00:00.530) 0:00:15.078 ********* 2026-03-17 01:38:51,420 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/subscription_tests.yml for controller => (item=loki-operator) 2026-03-17 01:38:51,429 p=39425 u=zuul n=ansible | TASK [common : Verify subscription "loki-operator"] **************************** 2026-03-17 01:38:51,429 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:51 +0000 (0:00:00.035) 0:00:15.114 ********* 2026-03-17 01:38:51,955 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:38:51,961 p=39425 u=zuul n=ansible | TASK [common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace] *** 2026-03-17 01:38:51,961 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:51 +0000 (0:00:00.532) 0:00:15.646 ********* 2026-03-17 01:38:51,981 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "subscription loki-operator is found." } 2026-03-17 01:38:51,985 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:38:51,985 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:51 +0000 (0:00:00.023) 0:00:15.670 ********* 2026-03-17 01:38:52,073 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'public']) 2026-03-17 01:38:52,075 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'internal']) 2026-03-17 01:38:52,077 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'public']) 2026-03-17 01:38:52,079 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'internal']) 2026-03-17 01:38:52,080 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'public']) 2026-03-17 01:38:52,082 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'internal']) 2026-03-17 01:38:52,084 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'public']) 2026-03-17 01:38:52,086 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'internal']) 2026-03-17 01:38:52,087 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'public']) 2026-03-17 01:38:52,089 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'internal']) 2026-03-17 01:38:52,091 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'public']) 2026-03-17 01:38:52,093 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'internal']) 2026-03-17 01:38:52,094 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'public']) 2026-03-17 01:38:52,096 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'internal']) 2026-03-17 01:38:52,098 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'public']) 2026-03-17 01:38:52,100 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'internal']) 2026-03-17 01:38:52,110 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'public']"] **************** 2026-03-17 01:38:52,110 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:52 +0000 (0:00:00.124) 0:00:15.794 ********* 2026-03-17 01:38:54,688 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:38:54,699 p=39425 u=zuul n=ansible | TASK [common : TEST Check that nova public endpoint exists] ******************** 2026-03-17 01:38:54,699 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:54 +0000 (0:00:02.588) 0:00:18.383 ********* 2026-03-17 01:38:54,726 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-17 01:38:54,731 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'internal']"] ************** 2026-03-17 01:38:54,731 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:54 +0000 (0:00:00.031) 0:00:18.415 ********* 2026-03-17 01:38:57,583 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:38:57,590 p=39425 u=zuul n=ansible | TASK [common : TEST Check that nova internal endpoint exists] ****************** 2026-03-17 01:38:57,591 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:57 +0000 (0:00:02.859) 0:00:21.275 ********* 2026-03-17 01:38:57,612 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-17 01:38:57,618 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'public']"] ********* 2026-03-17 01:38:57,619 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:38:57 +0000 (0:00:00.027) 0:00:21.303 ********* 2026-03-17 01:39:00,089 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:00,097 p=39425 u=zuul n=ansible | TASK [common : TEST Check that placement public endpoint exists] *************** 2026-03-17 01:39:00,097 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:00 +0000 (0:00:02.478) 0:00:23.781 ********* 2026-03-17 01:39:00,121 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-17 01:39:00,128 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'internal']"] ******* 2026-03-17 01:39:00,129 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:00 +0000 (0:00:00.031) 0:00:23.813 ********* 2026-03-17 01:39:02,691 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:02,700 p=39425 u=zuul n=ansible | TASK [common : TEST Check that placement internal endpoint exists] ************* 2026-03-17 01:39:02,700 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:02 +0000 (0:00:02.571) 0:00:26.384 ********* 2026-03-17 01:39:02,720 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-17 01:39:02,725 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'public']"] ********** 2026-03-17 01:39:02,725 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:02 +0000 (0:00:00.025) 0:00:26.410 ********* 2026-03-17 01:39:05,196 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:05,204 p=39425 u=zuul n=ansible | TASK [common : TEST Check that swift public endpoint exists] ******************* 2026-03-17 01:39:05,204 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:05 +0000 (0:00:02.478) 0:00:28.888 ********* 2026-03-17 01:39:05,223 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-17 01:39:05,229 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'internal']"] ******** 2026-03-17 01:39:05,229 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:05 +0000 (0:00:00.025) 0:00:28.914 ********* 2026-03-17 01:39:07,694 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:07,701 p=39425 u=zuul n=ansible | TASK [common : TEST Check that swift internal endpoint exists] ***************** 2026-03-17 01:39:07,701 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:07 +0000 (0:00:02.471) 0:00:31.385 ********* 2026-03-17 01:39:07,719 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-17 01:39:07,725 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'public']"] *********** 2026-03-17 01:39:07,726 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:07 +0000 (0:00:00.024) 0:00:31.410 ********* 2026-03-17 01:39:10,281 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:10,287 p=39425 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 public endpoint exists] **************** 2026-03-17 01:39:10,287 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:10 +0000 (0:00:02.561) 0:00:33.971 ********* 2026-03-17 01:39:10,305 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-17 01:39:10,310 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'internal']"] ********* 2026-03-17 01:39:10,310 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:10 +0000 (0:00:00.023) 0:00:33.994 ********* 2026-03-17 01:39:12,725 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:12,731 p=39425 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 internal endpoint exists] ************** 2026-03-17 01:39:12,731 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:12 +0000 (0:00:02.420) 0:00:36.415 ********* 2026-03-17 01:39:12,748 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-17 01:39:12,753 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'public']"] ******** 2026-03-17 01:39:12,753 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:12 +0000 (0:00:00.021) 0:00:36.437 ********* 2026-03-17 01:39:15,213 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:15,221 p=39425 u=zuul n=ansible | TASK [common : TEST Check that barbican public endpoint exists] **************** 2026-03-17 01:39:15,221 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:15 +0000 (0:00:02.468) 0:00:38.905 ********* 2026-03-17 01:39:15,240 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-17 01:39:15,246 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'internal']"] ****** 2026-03-17 01:39:15,246 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:15 +0000 (0:00:00.024) 0:00:38.930 ********* 2026-03-17 01:39:17,716 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:17,729 p=39425 u=zuul n=ansible | TASK [common : TEST Check that barbican internal endpoint exists] ************** 2026-03-17 01:39:17,729 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:17 +0000 (0:00:02.483) 0:00:41.414 ********* 2026-03-17 01:39:17,755 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-17 01:39:17,761 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'public']"] *********** 2026-03-17 01:39:17,761 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:17 +0000 (0:00:00.032) 0:00:41.446 ********* 2026-03-17 01:39:20,402 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:20,409 p=39425 u=zuul n=ansible | TASK [common : TEST Check that keystone public endpoint exists] **************** 2026-03-17 01:39:20,409 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:20 +0000 (0:00:02.647) 0:00:44.093 ********* 2026-03-17 01:39:20,425 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-17 01:39:20,430 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'internal']"] ********* 2026-03-17 01:39:20,430 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:20 +0000 (0:00:00.021) 0:00:44.115 ********* 2026-03-17 01:39:22,911 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:22,919 p=39425 u=zuul n=ansible | TASK [common : TEST Check that keystone internal endpoint exists] ************** 2026-03-17 01:39:22,919 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:22 +0000 (0:00:02.489) 0:00:46.604 ********* 2026-03-17 01:39:22,943 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-17 01:39:22,950 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'public']"] **************** 2026-03-17 01:39:22,950 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:22 +0000 (0:00:00.030) 0:00:46.635 ********* 2026-03-17 01:39:25,477 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:25,482 p=39425 u=zuul n=ansible | TASK [common : TEST Check that glance public endpoint exists] ****************** 2026-03-17 01:39:25,483 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:25 +0000 (0:00:02.532) 0:00:49.167 ********* 2026-03-17 01:39:25,502 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-17 01:39:25,507 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'internal']"] ************** 2026-03-17 01:39:25,507 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:25 +0000 (0:00:00.024) 0:00:49.192 ********* 2026-03-17 01:39:28,048 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:28,056 p=39425 u=zuul n=ansible | TASK [common : TEST Check that glance internal endpoint exists] **************** 2026-03-17 01:39:28,056 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:28 +0000 (0:00:02.548) 0:00:51.740 ********* 2026-03-17 01:39:28,082 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-17 01:39:28,088 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'public']"] ************* 2026-03-17 01:39:28,088 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:28 +0000 (0:00:00.032) 0:00:51.773 ********* 2026-03-17 01:39:30,655 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:30,664 p=39425 u=zuul n=ansible | TASK [common : TEST Check that neutron public endpoint exists] ***************** 2026-03-17 01:39:30,664 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:30 +0000 (0:00:02.575) 0:00:54.348 ********* 2026-03-17 01:39:30,682 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-17 01:39:30,690 p=39425 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'internal']"] *********** 2026-03-17 01:39:30,690 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:30 +0000 (0:00:00.026) 0:00:54.375 ********* 2026-03-17 01:39:33,354 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:33,360 p=39425 u=zuul n=ansible | TASK [common : TEST Check that neutron internal endpoint exists] *************** 2026-03-17 01:39:33,361 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:33 +0000 (0:00:02.670) 0:00:57.045 ********* 2026-03-17 01:39:33,377 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-17 01:39:33,383 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:39:33,383 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:33 +0000 (0:00:00.022) 0:00:57.067 ********* 2026-03-17 01:39:33,417 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-openstack-infra) 2026-03-17 01:39:33,420 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift) 2026-03-17 01:39:33,422 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openstack-operators) 2026-03-17 01:39:33,424 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-logging) 2026-03-17 01:39:33,450 p=39425 u=zuul n=ansible | TASK [common : Get the openshift-openstack-infra project] ********************** 2026-03-17 01:39:33,450 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:33 +0000 (0:00:00.067) 0:00:57.135 ********* 2026-03-17 01:39:33,977 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:33,981 p=39425 u=zuul n=ansible | TASK [common : TEST Verify openshift-openstack-infra project exists] *********** 2026-03-17 01:39:33,982 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:33 +0000 (0:00:00.531) 0:00:57.666 ********* 2026-03-17 01:39:34,009 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-openstack-infra is found." } 2026-03-17 01:39:34,014 p=39425 u=zuul n=ansible | TASK [common : Get the openshift project] ************************************** 2026-03-17 01:39:34,014 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:34 +0000 (0:00:00.032) 0:00:57.698 ********* 2026-03-17 01:39:34,555 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:34,560 p=39425 u=zuul n=ansible | TASK [common : TEST Verify openshift project exists] *************************** 2026-03-17 01:39:34,560 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:34 +0000 (0:00:00.546) 0:00:58.245 ********* 2026-03-17 01:39:34,579 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift is found." } 2026-03-17 01:39:34,585 p=39425 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-17 01:39:34,585 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:34 +0000 (0:00:00.024) 0:00:58.269 ********* 2026-03-17 01:39:35,191 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:35,196 p=39425 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-17 01:39:35,196 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:35 +0000 (0:00:00.611) 0:00:58.880 ********* 2026-03-17 01:39:35,212 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-17 01:39:35,219 p=39425 u=zuul n=ansible | TASK [common : Get the openshift-logging project] ****************************** 2026-03-17 01:39:35,219 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:35 +0000 (0:00:00.023) 0:00:58.903 ********* 2026-03-17 01:39:35,681 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:35,687 p=39425 u=zuul n=ansible | TASK [common : TEST Verify openshift-logging project exists] ******************* 2026-03-17 01:39:35,687 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:35 +0000 (0:00:00.467) 0:00:59.371 ********* 2026-03-17 01:39:35,704 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-logging is found." } 2026-03-17 01:39:35,708 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:39:35,708 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:35 +0000 (0:00:00.021) 0:00:59.393 ********* 2026-03-17 01:39:35,802 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=cluster-logging-operator-metrics) 2026-03-17 01:39:35,803 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-grpc) 2026-03-17 01:39:35,805 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-http) 2026-03-17 01:39:35,807 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-grpc) 2026-03-17 01:39:35,808 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-http) 2026-03-17 01:39:35,810 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gateway-http) 2026-03-17 01:39:35,811 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gossip-ring) 2026-03-17 01:39:35,813 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-grpc) 2026-03-17 01:39:35,815 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-http) 2026-03-17 01:39:35,817 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-grpc) 2026-03-17 01:39:35,819 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-http) 2026-03-17 01:39:35,820 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-grpc) 2026-03-17 01:39:35,822 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-http) 2026-03-17 01:39:35,824 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-grpc) 2026-03-17 01:39:35,826 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-http) 2026-03-17 01:39:35,827 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=openstack-logging) 2026-03-17 01:39:35,856 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "cluster-logging-operator-metrics"] ************ 2026-03-17 01:39:35,857 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:35 +0000 (0:00:00.148) 0:00:59.541 ********* 2026-03-17 01:39:36,359 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:36,365 p=39425 u=zuul n=ansible | TASK [common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace] *** 2026-03-17 01:39:36,365 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:36 +0000 (0:00:00.508) 0:01:00.049 ********* 2026-03-17 01:39:36,384 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service cluster-logging-operator-metrics is running." } 2026-03-17 01:39:36,389 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-grpc"] ***************** 2026-03-17 01:39:36,390 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:36 +0000 (0:00:00.024) 0:01:00.074 ********* 2026-03-17 01:39:36,881 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:36,887 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace] *** 2026-03-17 01:39:36,887 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:36 +0000 (0:00:00.497) 0:01:00.571 ********* 2026-03-17 01:39:36,908 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-grpc is running." } 2026-03-17 01:39:36,915 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-http"] ***************** 2026-03-17 01:39:36,915 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:36 +0000 (0:00:00.028) 0:01:00.599 ********* 2026-03-17 01:39:37,424 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:37,429 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace] *** 2026-03-17 01:39:37,429 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:37 +0000 (0:00:00.513) 0:01:01.113 ********* 2026-03-17 01:39:37,449 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-http is running." } 2026-03-17 01:39:37,454 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-grpc"] *************** 2026-03-17 01:39:37,454 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:37 +0000 (0:00:00.025) 0:01:01.139 ********* 2026-03-17 01:39:37,994 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:38,000 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace] *** 2026-03-17 01:39:38,000 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:38 +0000 (0:00:00.546) 0:01:01.685 ********* 2026-03-17 01:39:38,020 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-grpc is running." } 2026-03-17 01:39:38,026 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-http"] *************** 2026-03-17 01:39:38,026 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:38 +0000 (0:00:00.025) 0:01:01.711 ********* 2026-03-17 01:39:38,549 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:38,555 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace] *** 2026-03-17 01:39:38,555 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:38 +0000 (0:00:00.528) 0:01:02.239 ********* 2026-03-17 01:39:38,574 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-http is running." } 2026-03-17 01:39:38,579 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gateway-http"] ******************* 2026-03-17 01:39:38,579 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:38 +0000 (0:00:00.024) 0:01:02.263 ********* 2026-03-17 01:39:39,107 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:39,112 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace] *** 2026-03-17 01:39:39,112 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:39 +0000 (0:00:00.532) 0:01:02.796 ********* 2026-03-17 01:39:39,135 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gateway-http is running." } 2026-03-17 01:39:39,140 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gossip-ring"] ******************** 2026-03-17 01:39:39,140 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:39 +0000 (0:00:00.028) 0:01:02.824 ********* 2026-03-17 01:39:39,670 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:39,675 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace] *** 2026-03-17 01:39:39,675 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:39 +0000 (0:00:00.534) 0:01:03.359 ********* 2026-03-17 01:39:39,693 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gossip-ring is running." } 2026-03-17 01:39:39,701 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-grpc"] ************* 2026-03-17 01:39:39,701 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:39 +0000 (0:00:00.025) 0:01:03.385 ********* 2026-03-17 01:39:40,277 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:40,283 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace] *** 2026-03-17 01:39:40,283 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:40 +0000 (0:00:00.581) 0:01:03.967 ********* 2026-03-17 01:39:40,307 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-grpc is running." } 2026-03-17 01:39:40,312 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-http"] ************* 2026-03-17 01:39:40,312 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:40 +0000 (0:00:00.029) 0:01:03.996 ********* 2026-03-17 01:39:40,837 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:40,843 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace] *** 2026-03-17 01:39:40,843 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:40 +0000 (0:00:00.530) 0:01:04.527 ********* 2026-03-17 01:39:40,863 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-http is running." } 2026-03-17 01:39:40,869 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-grpc"] ****************** 2026-03-17 01:39:40,869 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:40 +0000 (0:00:00.025) 0:01:04.553 ********* 2026-03-17 01:39:41,399 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:41,404 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace] *** 2026-03-17 01:39:41,404 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:41 +0000 (0:00:00.535) 0:01:05.088 ********* 2026-03-17 01:39:41,428 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-grpc is running." } 2026-03-17 01:39:41,433 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-http"] ****************** 2026-03-17 01:39:41,433 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:41 +0000 (0:00:00.029) 0:01:05.118 ********* 2026-03-17 01:39:41,925 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:41,930 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace] *** 2026-03-17 01:39:41,930 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:41 +0000 (0:00:00.496) 0:01:05.614 ********* 2026-03-17 01:39:41,948 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-http is running." } 2026-03-17 01:39:41,952 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-grpc"] ******************* 2026-03-17 01:39:41,953 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:41 +0000 (0:00:00.022) 0:01:05.637 ********* 2026-03-17 01:39:42,479 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:42,484 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace] *** 2026-03-17 01:39:42,484 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:42 +0000 (0:00:00.531) 0:01:06.168 ********* 2026-03-17 01:39:42,502 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-grpc is running." } 2026-03-17 01:39:42,506 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-http"] ******************* 2026-03-17 01:39:42,507 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:42 +0000 (0:00:00.022) 0:01:06.191 ********* 2026-03-17 01:39:43,011 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:43,016 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace] *** 2026-03-17 01:39:43,016 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:43 +0000 (0:00:00.509) 0:01:06.701 ********* 2026-03-17 01:39:43,036 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-http is running." } 2026-03-17 01:39:43,041 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-grpc"] ************ 2026-03-17 01:39:43,042 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:43 +0000 (0:00:00.025) 0:01:06.726 ********* 2026-03-17 01:39:43,563 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:43,568 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace] *** 2026-03-17 01:39:43,569 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:43 +0000 (0:00:00.526) 0:01:07.253 ********* 2026-03-17 01:39:43,591 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-grpc is running." } 2026-03-17 01:39:43,597 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-http"] ************ 2026-03-17 01:39:43,597 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:43 +0000 (0:00:00.028) 0:01:07.281 ********* 2026-03-17 01:39:44,096 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:44,102 p=39425 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace] *** 2026-03-17 01:39:44,102 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:44 +0000 (0:00:00.505) 0:01:07.786 ********* 2026-03-17 01:39:44,121 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-http is running." } 2026-03-17 01:39:44,127 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "openstack-logging"] *************************** 2026-03-17 01:39:44,127 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:44 +0000 (0:00:00.025) 0:01:07.812 ********* 2026-03-17 01:39:44,676 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:44,682 p=39425 u=zuul n=ansible | TASK [common : TEST Verify openstack-logging service is running in openshift-logging namespace] *** 2026-03-17 01:39:44,682 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:44 +0000 (0:00:00.555) 0:01:08.367 ********* 2026-03-17 01:39:44,706 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service openstack-logging is running." } 2026-03-17 01:39:44,711 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:39:44,711 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:44 +0000 (0:00:00.028) 0:01:08.395 ********* 2026-03-17 01:39:44,729 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:44,733 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:39:44,734 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:44 +0000 (0:00:00.022) 0:01:08.418 ********* 2026-03-17 01:39:45,327 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:45,332 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:39:45,333 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:45 +0000 (0:00:00.599) 0:01:09.017 ********* 2026-03-17 01:39:45,358 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/manifest_tests.yml for controller => (item={'name': 'loki-operator', 'expected_number': 2}) 2026-03-17 01:39:45,376 p=39425 u=zuul n=ansible | TASK [common : TEST Get loki-operator 2 packagemanifest] *********************** 2026-03-17 01:39:45,376 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:45 +0000 (0:00:00.043) 0:01:09.061 ********* 2026-03-17 01:39:45,433 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "Expected 2 and found 2\n" } 2026-03-17 01:39:45,437 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:39:45,437 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:45 +0000 (0:00:00.060) 0:01:09.121 ********* 2026-03-17 01:39:45,454 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:45,457 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:39:45,458 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:45 +0000 (0:00:00.020) 0:01:09.142 ********* 2026-03-17 01:39:45,474 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:45,477 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:39:45,478 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:45 +0000 (0:00:00.019) 0:01:09.162 ********* 2026-03-17 01:39:45,493 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:45,507 p=39425 u=zuul n=ansible | PLAY [Verify logging pods are running in openstack] **************************** 2026-03-17 01:39:45,514 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:39:45,514 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:45 +0000 (0:00:00.036) 0:01:09.199 ********* 2026-03-17 01:39:45,540 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstackclient) 2026-03-17 01:39:45,545 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:45,545 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:45 +0000 (0:00:00.031) 0:01:09.230 ********* 2026-03-17 01:39:46,136 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:46,142 p=39425 u=zuul n=ansible | TASK [common : TEST Check openstackclient pod is Running in openstack namespace] *** 2026-03-17 01:39:46,142 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.596) 0:01:09.826 ********* 2026-03-17 01:39:46,693 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:46,697 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:39:46,697 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.555) 0:01:10.382 ********* 2026-03-17 01:39:46,714 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,717 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:39:46,717 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.020) 0:01:10.402 ********* 2026-03-17 01:39:46,733 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,737 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:39:46,737 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.019) 0:01:10.421 ********* 2026-03-17 01:39:46,753 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,757 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:39:46,757 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.020) 0:01:10.441 ********* 2026-03-17 01:39:46,775 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,779 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:39:46,779 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.021) 0:01:10.463 ********* 2026-03-17 01:39:46,794 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,798 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:39:46,798 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.019) 0:01:10.482 ********* 2026-03-17 01:39:46,814 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,818 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:39:46,818 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.020) 0:01:10.503 ********* 2026-03-17 01:39:46,836 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,840 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:39:46,840 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.021) 0:01:10.525 ********* 2026-03-17 01:39:46,859 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,863 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:39:46,863 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.022) 0:01:10.547 ********* 2026-03-17 01:39:46,880 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:46,883 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:39:46,883 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:46 +0000 (0:00:00.020) 0:01:10.568 ********* 2026-03-17 01:39:47,155 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:47,171 p=39425 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-operators-redhat] *********** 2026-03-17 01:39:47,180 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:39:47,180 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:47 +0000 (0:00:00.296) 0:01:10.865 ********* 2026-03-17 01:39:47,209 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=loki-operator-controller-manager) 2026-03-17 01:39:47,216 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:47,217 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:47 +0000 (0:00:00.036) 0:01:10.901 ********* 2026-03-17 01:39:47,749 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:47,753 p=39425 u=zuul n=ansible | TASK [common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace] *** 2026-03-17 01:39:47,753 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:47 +0000 (0:00:00.536) 0:01:11.438 ********* 2026-03-17 01:39:48,318 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:48,321 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:39:48,322 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.568) 0:01:12.006 ********* 2026-03-17 01:39:48,339 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,342 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:39:48,343 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.020) 0:01:12.027 ********* 2026-03-17 01:39:48,361 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,365 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:39:48,365 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.022) 0:01:12.049 ********* 2026-03-17 01:39:48,381 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,385 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:39:48,385 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.020) 0:01:12.070 ********* 2026-03-17 01:39:48,401 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,405 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:39:48,405 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.019) 0:01:12.089 ********* 2026-03-17 01:39:48,421 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,424 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:39:48,424 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.019) 0:01:12.108 ********* 2026-03-17 01:39:48,440 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,443 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:39:48,444 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.019) 0:01:12.128 ********* 2026-03-17 01:39:48,460 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,463 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:39:48,463 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.019) 0:01:12.147 ********* 2026-03-17 01:39:48,480 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,483 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:39:48,484 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.020) 0:01:12.168 ********* 2026-03-17 01:39:48,499 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,503 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:39:48,503 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.019) 0:01:12.187 ********* 2026-03-17 01:39:48,520 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:48,532 p=39425 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-logging] ******************** 2026-03-17 01:39:48,539 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:39:48,539 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.035) 0:01:12.223 ********* 2026-03-17 01:39:48,609 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=cluster-logging-operator) 2026-03-17 01:39:48,611 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-compactor) 2026-03-17 01:39:48,613 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-distributor) 2026-03-17 01:39:48,615 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-index-gateway) 2026-03-17 01:39:48,617 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-ingester) 2026-03-17 01:39:48,619 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-querier) 2026-03-17 01:39:48,620 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-query-frontend) 2026-03-17 01:39:48,622 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=collector) 2026-03-17 01:39:48,627 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:48,628 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:48 +0000 (0:00:00.088) 0:01:12.312 ********* 2026-03-17 01:39:49,120 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:49,125 p=39425 u=zuul n=ansible | TASK [common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:49,125 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:49 +0000 (0:00:00.497) 0:01:12.809 ********* 2026-03-17 01:39:49,629 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:49,634 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:49,634 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:49 +0000 (0:00:00.509) 0:01:13.318 ********* 2026-03-17 01:39:50,174 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:50,179 p=39425 u=zuul n=ansible | TASK [common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:50,179 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:50 +0000 (0:00:00.545) 0:01:13.864 ********* 2026-03-17 01:39:50,663 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:50,668 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:50,668 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:50 +0000 (0:00:00.488) 0:01:14.352 ********* 2026-03-17 01:39:51,197 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:51,202 p=39425 u=zuul n=ansible | TASK [common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:51,202 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:51 +0000 (0:00:00.533) 0:01:14.886 ********* 2026-03-17 01:39:51,646 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:51,651 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:51,651 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:51 +0000 (0:00:00.449) 0:01:15.335 ********* 2026-03-17 01:39:52,171 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:52,176 p=39425 u=zuul n=ansible | TASK [common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:52,176 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:52 +0000 (0:00:00.525) 0:01:15.861 ********* 2026-03-17 01:39:52,693 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:52,697 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:52,698 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:52 +0000 (0:00:00.521) 0:01:16.382 ********* 2026-03-17 01:39:53,207 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:53,213 p=39425 u=zuul n=ansible | TASK [common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:53,213 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:53 +0000 (0:00:00.515) 0:01:16.897 ********* 2026-03-17 01:39:53,746 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:53,751 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:53,751 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:53 +0000 (0:00:00.537) 0:01:17.435 ********* 2026-03-17 01:39:54,311 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:54,317 p=39425 u=zuul n=ansible | TASK [common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:54,317 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:54 +0000 (0:00:00.565) 0:01:18.001 ********* 2026-03-17 01:39:54,839 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:54,846 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:54,847 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:54 +0000 (0:00:00.529) 0:01:18.531 ********* 2026-03-17 01:39:55,446 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:55,453 p=39425 u=zuul n=ansible | TASK [common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:55,454 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:55 +0000 (0:00:00.606) 0:01:19.138 ********* 2026-03-17 01:39:55,989 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:55,995 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:55,995 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:55 +0000 (0:00:00.541) 0:01:19.679 ********* 2026-03-17 01:39:56,564 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:56,570 p=39425 u=zuul n=ansible | TASK [common : TEST Check collector pod is Running in openshift-logging namespace] *** 2026-03-17 01:39:56,570 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:56 +0000 (0:00:00.575) 0:01:20.254 ********* 2026-03-17 01:39:57,104 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:57,110 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:39:57,110 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.540) 0:01:20.794 ********* 2026-03-17 01:39:57,131 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,136 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:39:57,137 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.026) 0:01:20.821 ********* 2026-03-17 01:39:57,158 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,163 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:39:57,163 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.026) 0:01:20.847 ********* 2026-03-17 01:39:57,183 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,190 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:39:57,191 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.027) 0:01:20.875 ********* 2026-03-17 01:39:57,213 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,218 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:39:57,218 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.027) 0:01:20.902 ********* 2026-03-17 01:39:57,239 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,244 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:39:57,244 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.025) 0:01:20.928 ********* 2026-03-17 01:39:57,264 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,269 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:39:57,269 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.025) 0:01:20.953 ********* 2026-03-17 01:39:57,290 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,295 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:39:57,295 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.026) 0:01:20.980 ********* 2026-03-17 01:39:57,317 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,322 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:39:57,322 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.026) 0:01:21.006 ********* 2026-03-17 01:39:57,344 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,350 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:39:57,350 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.028) 0:01:21.034 ********* 2026-03-17 01:39:57,372 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:57,384 p=39425 u=zuul n=ansible | PLAY [Verify logging pods are running in minio-dev] **************************** 2026-03-17 01:39:57,391 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:39:57,392 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.041) 0:01:21.076 ********* 2026-03-17 01:39:57,423 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=minio) 2026-03-17 01:39:57,429 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-17 01:39:57,429 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.037) 0:01:21.114 ********* 2026-03-17 01:39:57,923 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:57,927 p=39425 u=zuul n=ansible | TASK [common : TEST Check minio pod is Running in minio-dev namespace] ********* 2026-03-17 01:39:57,928 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:57 +0000 (0:00:00.498) 0:01:21.612 ********* 2026-03-17 01:39:58,391 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:58,394 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:39:58,394 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.466) 0:01:22.079 ********* 2026-03-17 01:39:58,408 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,412 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:39:58,412 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.017) 0:01:22.096 ********* 2026-03-17 01:39:58,429 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,433 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:39:58,433 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.021) 0:01:22.117 ********* 2026-03-17 01:39:58,448 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,452 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:39:58,452 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.019) 0:01:22.136 ********* 2026-03-17 01:39:58,467 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,471 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:39:58,471 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.018) 0:01:22.155 ********* 2026-03-17 01:39:58,486 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,489 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:39:58,489 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.018) 0:01:22.173 ********* 2026-03-17 01:39:58,503 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,506 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:39:58,506 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.016) 0:01:22.190 ********* 2026-03-17 01:39:58,520 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,523 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:39:58,524 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.017) 0:01:22.208 ********* 2026-03-17 01:39:58,538 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,541 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:39:58,541 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.017) 0:01:22.225 ********* 2026-03-17 01:39:58,554 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,557 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:39:58,558 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.016) 0:01:22.242 ********* 2026-03-17 01:39:58,571 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:39:58,584 p=39425 u=zuul n=ansible | PLAY [Verify logging pods have complete status in openstack] ******************* 2026-03-17 01:39:58,592 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:39:58,592 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.034) 0:01:22.276 ********* 2026-03-17 01:39:58,696 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=bootstrap-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,698 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-network-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,700 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,702 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-certs-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,703 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,705 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=libvirt-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,707 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,709 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=neutron-metadata-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,710 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ovn-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,712 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=reboot-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,714 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=run-os-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,716 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ssh-known-hosts-edpm-deployment) 2026-03-17 01:39:58,717 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,719 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=validate-network-edpm-deployment-openstack-edpm-ipam) 2026-03-17 01:39:58,724 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:39:58,724 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:58 +0000 (0:00:00.132) 0:01:22.409 ********* 2026-03-17 01:39:59,299 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:59,303 p=39425 u=zuul n=ansible | TASK [common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:39:59,304 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:59 +0000 (0:00:00.579) 0:01:22.988 ********* 2026-03-17 01:39:59,835 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:39:59,840 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:39:59,840 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:39:59 +0000 (0:00:00.536) 0:01:23.524 ********* 2026-03-17 01:40:00,407 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:00,411 p=39425 u=zuul n=ansible | TASK [common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:00,412 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:00 +0000 (0:00:00.571) 0:01:24.096 ********* 2026-03-17 01:40:00,946 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:00,951 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:00,951 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:00 +0000 (0:00:00.539) 0:01:24.636 ********* 2026-03-17 01:40:01,531 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:01,536 p=39425 u=zuul n=ansible | TASK [common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:01,536 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:01 +0000 (0:00:00.585) 0:01:25.221 ********* 2026-03-17 01:40:02,070 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:02,074 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:02,074 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:02 +0000 (0:00:00.537) 0:01:25.758 ********* 2026-03-17 01:40:02,593 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:02,598 p=39425 u=zuul n=ansible | TASK [common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:02,598 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:02 +0000 (0:00:00.523) 0:01:26.282 ********* 2026-03-17 01:40:03,061 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:03,067 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:03,068 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:03 +0000 (0:00:00.469) 0:01:26.752 ********* 2026-03-17 01:40:03,624 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:03,629 p=39425 u=zuul n=ansible | TASK [common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:03,629 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:03 +0000 (0:00:00.561) 0:01:27.313 ********* 2026-03-17 01:40:04,123 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:04,127 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:04,127 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:04 +0000 (0:00:00.498) 0:01:27.812 ********* 2026-03-17 01:40:04,698 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:04,703 p=39425 u=zuul n=ansible | TASK [common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:04,703 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:04 +0000 (0:00:00.575) 0:01:28.387 ********* 2026-03-17 01:40:05,290 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:05,295 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:05,296 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:05 +0000 (0:00:00.592) 0:01:28.980 ********* 2026-03-17 01:40:05,904 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:05,909 p=39425 u=zuul n=ansible | TASK [common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:05,909 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:05 +0000 (0:00:00.613) 0:01:29.594 ********* 2026-03-17 01:40:06,460 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:06,465 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:06,465 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:06 +0000 (0:00:00.555) 0:01:30.150 ********* 2026-03-17 01:40:07,067 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:07,073 p=39425 u=zuul n=ansible | TASK [common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:07,073 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:07 +0000 (0:00:00.607) 0:01:30.757 ********* 2026-03-17 01:40:07,577 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:07,582 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:07,582 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:07 +0000 (0:00:00.509) 0:01:31.266 ********* 2026-03-17 01:40:08,166 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:08,172 p=39425 u=zuul n=ansible | TASK [common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:08,172 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:08 +0000 (0:00:00.590) 0:01:31.856 ********* 2026-03-17 01:40:08,714 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:08,719 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:08,719 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:08 +0000 (0:00:00.547) 0:01:32.403 ********* 2026-03-17 01:40:09,319 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:09,324 p=39425 u=zuul n=ansible | TASK [common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:09,324 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:09 +0000 (0:00:00.605) 0:01:33.009 ********* 2026-03-17 01:40:09,860 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:09,865 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:09,865 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:09 +0000 (0:00:00.540) 0:01:33.550 ********* 2026-03-17 01:40:10,460 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:10,466 p=39425 u=zuul n=ansible | TASK [common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:10,466 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:10 +0000 (0:00:00.600) 0:01:34.151 ********* 2026-03-17 01:40:11,024 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:11,029 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:11,030 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:11 +0000 (0:00:00.563) 0:01:34.714 ********* 2026-03-17 01:40:11,653 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:11,658 p=39425 u=zuul n=ansible | TASK [common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace] *** 2026-03-17 01:40:11,658 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:11 +0000 (0:00:00.628) 0:01:35.343 ********* 2026-03-17 01:40:12,129 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:12,134 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:12,134 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:12 +0000 (0:00:00.476) 0:01:35.819 ********* 2026-03-17 01:40:12,725 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:12,730 p=39425 u=zuul n=ansible | TASK [common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:12,730 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:12 +0000 (0:00:00.595) 0:01:36.414 ********* 2026-03-17 01:40:13,275 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:13,280 p=39425 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-17 01:40:13,280 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:13 +0000 (0:00:00.549) 0:01:36.964 ********* 2026-03-17 01:40:13,919 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:13,925 p=39425 u=zuul n=ansible | TASK [common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-17 01:40:13,925 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:13 +0000 (0:00:00.644) 0:01:37.609 ********* 2026-03-17 01:40:14,471 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:14,475 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:40:14,475 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.550) 0:01:38.159 ********* 2026-03-17 01:40:14,495 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,499 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:40:14,499 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.023) 0:01:38.183 ********* 2026-03-17 01:40:14,517 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,521 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:40:14,521 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.021) 0:01:38.205 ********* 2026-03-17 01:40:14,537 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,541 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:40:14,541 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.020) 0:01:38.225 ********* 2026-03-17 01:40:14,557 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,561 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:40:14,561 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.019) 0:01:38.245 ********* 2026-03-17 01:40:14,578 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,581 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:40:14,581 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.020) 0:01:38.265 ********* 2026-03-17 01:40:14,601 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,605 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:40:14,605 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.023) 0:01:38.289 ********* 2026-03-17 01:40:14,624 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,629 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:40:14,629 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.024) 0:01:38.313 ********* 2026-03-17 01:40:14,648 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,651 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:40:14,652 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.022) 0:01:38.336 ********* 2026-03-17 01:40:14,669 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,673 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:40:14,673 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.021) 0:01:38.357 ********* 2026-03-17 01:40:14,693 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,705 p=39425 u=zuul n=ansible | PLAY [Verify the crds exist] *************************************************** 2026-03-17 01:40:14,713 p=39425 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-17 01:40:14,713 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.039) 0:01:38.397 ********* 2026-03-17 01:40:14,733 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,736 p=39425 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-17 01:40:14,737 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.023) 0:01:38.421 ********* 2026-03-17 01:40:14,756 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,759 p=39425 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-17 01:40:14,760 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.022) 0:01:38.444 ********* 2026-03-17 01:40:14,779 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,786 p=39425 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-17 01:40:14,787 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.027) 0:01:38.471 ********* 2026-03-17 01:40:14,805 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:14,812 p=39425 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-17 01:40:14,812 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.025) 0:01:38.496 ********* 2026-03-17 01:40:14,863 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-internal) 2026-03-17 01:40:14,865 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-metadata-internal) 2026-03-17 01:40:14,868 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-novncproxy-cell1-public) 2026-03-17 01:40:14,869 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-public) 2026-03-17 01:40:14,875 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "nova-internal"] ******************************* 2026-03-17 01:40:14,875 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:14 +0000 (0:00:00.062) 0:01:38.559 ********* 2026-03-17 01:40:15,417 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:15,421 p=39425 u=zuul n=ansible | TASK [common : TEST Verify nova-internal service is running in openstack namespace] *** 2026-03-17 01:40:15,422 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:15 +0000 (0:00:00.546) 0:01:39.106 ********* 2026-03-17 01:40:15,440 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-internal is running." } 2026-03-17 01:40:15,444 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "nova-metadata-internal"] ********************** 2026-03-17 01:40:15,445 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:15 +0000 (0:00:00.023) 0:01:39.129 ********* 2026-03-17 01:40:15,951 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:15,957 p=39425 u=zuul n=ansible | TASK [common : TEST Verify nova-metadata-internal service is running in openstack namespace] *** 2026-03-17 01:40:15,957 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:15 +0000 (0:00:00.512) 0:01:39.642 ********* 2026-03-17 01:40:15,976 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-metadata-internal is running." } 2026-03-17 01:40:15,981 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "nova-novncproxy-cell1-public"] **************** 2026-03-17 01:40:15,981 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:15 +0000 (0:00:00.023) 0:01:39.665 ********* 2026-03-17 01:40:16,486 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:16,491 p=39425 u=zuul n=ansible | TASK [common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace] *** 2026-03-17 01:40:16,492 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:16 +0000 (0:00:00.510) 0:01:40.176 ********* 2026-03-17 01:40:16,508 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-novncproxy-cell1-public is running." } 2026-03-17 01:40:16,512 p=39425 u=zuul n=ansible | TASK [common : Verify Service - "nova-public"] ********************************* 2026-03-17 01:40:16,512 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:16 +0000 (0:00:00.020) 0:01:40.197 ********* 2026-03-17 01:40:17,044 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:17,049 p=39425 u=zuul n=ansible | TASK [common : TEST Verify nova-public service is running in openstack namespace] *** 2026-03-17 01:40:17,049 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.536) 0:01:40.734 ********* 2026-03-17 01:40:17,070 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-public is running." } 2026-03-17 01:40:17,074 p=39425 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-17 01:40:17,074 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.024) 0:01:40.758 ********* 2026-03-17 01:40:17,094 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:17,098 p=39425 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-17 01:40:17,098 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.024) 0:01:40.782 ********* 2026-03-17 01:40:17,115 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:17,119 p=39425 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-17 01:40:17,119 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.020) 0:01:40.803 ********* 2026-03-17 01:40:17,136 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:17,140 p=39425 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-17 01:40:17,140 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.021) 0:01:40.824 ********* 2026-03-17 01:40:17,178 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=alertingrules.loki.grafana.com) 2026-03-17 01:40:17,180 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=lokistacks.loki.grafana.com) 2026-03-17 01:40:17,182 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=recordingrules.loki.grafana.com) 2026-03-17 01:40:17,184 p=39425 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=rulerconfigs.loki.grafana.com) 2026-03-17 01:40:17,190 p=39425 u=zuul n=ansible | TASK [common : Verify CRD "alertingrules.loki.grafana.com"] ******************** 2026-03-17 01:40:17,190 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.049) 0:01:40.874 ********* 2026-03-17 01:40:17,766 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:17,771 p=39425 u=zuul n=ansible | TASK [common : TEST Verify CRD alertingrules.loki.grafana.com is found] ******** 2026-03-17 01:40:17,771 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.581) 0:01:41.455 ********* 2026-03-17 01:40:17,791 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD alertingrules.loki.grafana.com is found." } 2026-03-17 01:40:17,796 p=39425 u=zuul n=ansible | TASK [common : Verify CRD "lokistacks.loki.grafana.com"] *********************** 2026-03-17 01:40:17,797 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:17 +0000 (0:00:00.025) 0:01:41.481 ********* 2026-03-17 01:40:18,284 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:18,289 p=39425 u=zuul n=ansible | TASK [common : TEST Verify CRD lokistacks.loki.grafana.com is found] *********** 2026-03-17 01:40:18,289 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:18 +0000 (0:00:00.492) 0:01:41.973 ********* 2026-03-17 01:40:18,304 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD lokistacks.loki.grafana.com is found." } 2026-03-17 01:40:18,309 p=39425 u=zuul n=ansible | TASK [common : Verify CRD "recordingrules.loki.grafana.com"] ******************* 2026-03-17 01:40:18,309 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:18 +0000 (0:00:00.020) 0:01:41.993 ********* 2026-03-17 01:40:18,826 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:18,833 p=39425 u=zuul n=ansible | TASK [common : TEST Verify CRD recordingrules.loki.grafana.com is found] ******* 2026-03-17 01:40:18,834 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:18 +0000 (0:00:00.524) 0:01:42.518 ********* 2026-03-17 01:40:18,857 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD recordingrules.loki.grafana.com is found." } 2026-03-17 01:40:18,865 p=39425 u=zuul n=ansible | TASK [common : Verify CRD "rulerconfigs.loki.grafana.com"] ********************* 2026-03-17 01:40:18,865 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:18 +0000 (0:00:00.031) 0:01:42.550 ********* 2026-03-17 01:40:19,514 p=39425 u=zuul n=ansible | ok: [controller] 2026-03-17 01:40:19,519 p=39425 u=zuul n=ansible | TASK [common : TEST Verify CRD rulerconfigs.loki.grafana.com is found] ********* 2026-03-17 01:40:19,520 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:19 +0000 (0:00:00.654) 0:01:43.204 ********* 2026-03-17 01:40:19,554 p=39425 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD rulerconfigs.loki.grafana.com is found." } 2026-03-17 01:40:19,558 p=39425 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-17 01:40:19,558 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:19 +0000 (0:00:00.038) 0:01:43.242 ********* 2026-03-17 01:40:19,583 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:19,587 p=39425 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-17 01:40:19,588 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:19 +0000 (0:00:00.029) 0:01:43.272 ********* 2026-03-17 01:40:19,609 p=39425 u=zuul n=ansible | skipping: [controller] 2026-03-17 01:40:19,622 p=39425 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-17 01:40:19,622 p=39425 u=zuul n=ansible | compute-0 : ok=19 changed=0 unreachable=0 failed=0 skipped=24 rescued=0 ignored=0 2026-03-17 01:40:19,622 p=39425 u=zuul n=ansible | controller : ok=219 changed=0 unreachable=0 failed=0 skipped=63 rescued=0 ignored=0 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | Tuesday 17 March 2026 01:40:19 +0000 (0:00:00.104) 0:01:43.376 ********* 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | =============================================================================== 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'internal']" -------------- 2.86s 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'internal']" ----------- 2.67s 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 2.66s 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'public']" ----------- 2.65s 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'public']" ---------------- 2.59s 2026-03-17 01:40:19,692 p=39425 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'public']" ------------- 2.58s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'internal']" ------- 2.57s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.57s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'public']" ----------- 2.56s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'internal']" -------------- 2.55s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'public']" ---------------- 2.53s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'internal']" --------- 2.49s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'internal']" ------ 2.48s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'public']" ---------- 2.48s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'public']" --------- 2.48s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'internal']" -------- 2.47s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'public']" -------- 2.47s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'internal']" --------- 2.42s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.18s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 1.32s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.89s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf" -------- 0.83s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.82s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Verify CRD "rulerconfigs.loki.grafana.com" --------------------- 0.65s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.64s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.64s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.63s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.61s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.61s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.60s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.60s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.60s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.59s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.59s 2026-03-17 01:40:19,693 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-grpc" ------------- 0.58s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify CRD "alertingrules.loki.grafana.com" -------------------- 0.58s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.58s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.57s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace --- 0.57s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.57s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.56s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.56s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.56s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check openstackclient pod is Running in openstack namespace --- 0.56s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "openstack-logging" --------------------------- 0.56s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.55s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.55s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.55s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "nova-internal" ------------------------------- 0.55s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get the openshift project -------------------------------------- 0.55s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-grpc" --------------- 0.55s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check collector pod is Running in openshift-logging namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "nova-public" --------------------------------- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-grpc" ------------------ 0.54s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-gossip-ring" -------------------- 0.53s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.53s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-gateway-http" ------------------- 0.53s 2026-03-17 01:40:19,694 p=39425 u=zuul n=ansible | common : Verify subscription "loki-operator" ---------------------------- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-grpc" ------------------- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Get the openshift-openstack-infra project ---------------------- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace --- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-http" ------------- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace --- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-http" --------------- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-grpc" ------------ 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.53s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify CRD "recordingrules.loki.grafana.com" ------------------- 0.52s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.52s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace --- 0.52s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.52s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-http" ----------------- 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "nova-metadata-internal" ---------------------- 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "nova-novncproxy-cell1-public" ---------------- 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-http" ------------------- 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace --- 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "cluster-logging-operator-metrics" ------------ 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-http" ------------ 0.51s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.50s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.50s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.50s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-grpc" ----------------- 0.50s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-http" ------------------ 0.50s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Verify CRD "lokistacks.loki.grafana.com" ----------------------- 0.49s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace --- 0.49s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace --- 0.48s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.47s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : Get the openshift-logging project ------------------------------ 0.47s 2026-03-17 01:40:19,695 p=39425 u=zuul n=ansible | common : TEST Check minio pod is Running in minio-dev namespace -------- 0.47s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace --- 0.45s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.31s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.30s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.15s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.13s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.12s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.10s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.09s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 0.09s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 0.08s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Verify node_exporter container status -------------------- 0.07s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.07s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.06s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.06s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Get loki-operator 2 packagemanifest ---------------------- 0.06s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | telemetry_logging : Verify journal entries ------------------------------ 0.06s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.05s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists --- 0.05s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.05s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Verify CRD rulerconfigs.loki.grafana.com is found -------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Verify ceilometer_agent_compute container status --------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.03s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.03s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.03s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Verify openshift-openstack-infra project exists ---------- 0.03s 2026-03-17 01:40:19,696 p=39425 u=zuul n=ansible | common : TEST Check that glance internal endpoint exists --------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify CRD recordingrules.loki.grafana.com is found ------ 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Check that barbican internal endpoint exists ------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Check that placement public endpoint exists -------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Check that nova public endpoint exists ------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Check that keystone internal endpoint exists ------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify openstack-logging service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Check that nova internal endpoint exists ----------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Check that neutron public endpoint exists ---------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,697 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify CRD alertingrules.loki.grafana.com is found ------- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Check that placement internal endpoint exists ------------ 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Check that swift public endpoint exists ------------------ 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace --- 0.03s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Check that barbican public endpoint exists --------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Check that glance public endpoint exists ----------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Check that swift internal endpoint exists ---------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace --- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify openshift project exists -------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify nova-public service is running in openstack namespace --- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace --- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace --- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 01:40:19,698 p=39425 u=zuul n=ansible | common : TEST Verify nova-metadata-internal service is running in openstack namespace --- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Check that cinderv3 public endpoint exists --------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Verify nova-internal service is running in openstack namespace --- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace --- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Check that neutron internal endpoint exists -------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Check that cinderv3 internal endpoint exists ------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Verify openshift-logging project exists ------------------ 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Check that keystone public endpoint exists --------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace --- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : TEST Verify CRD lokistacks.loki.grafana.com is found ---------- 0.02s 2026-03-17 01:40:19,699 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-17 01:40:19,700 p=39425 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s