2026-03-18 15:00:42,394 p=37566 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-18 15:00:42,395 p=37566 u=zuul n=ansible | PLAY [Verify logging journalctl identifiers] *********************************** 2026-03-18 15:00:42,405 p=37566 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-18 15:00:42,405 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:42 +0000 (0:00:00.013) 0:00:00.013 ******* 2026-03-18 15:00:44,382 p=37566 u=zuul n=ansible | ok: [compute-0] 2026-03-18 15:00:44,406 p=37566 u=zuul n=ansible | TASK [telemetry_logging : Verify journal entries] ****************************** 2026-03-18 15:00:44,406 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:44 +0000 (0:00:02.001) 0:00:02.014 ******* 2026-03-18 15:00:44,450 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-18 15:00:44,452 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=nova_compute) 2026-03-18 15:00:44,468 p=37566 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-18 15:00:44,468 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:44 +0000 (0:00:00.062) 0:00:02.076 ******* 2026-03-18 15:00:45,280 p=37566 u=zuul n=ansible | ok: [compute-0] 2026-03-18 15:00:45,295 p=37566 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-18 15:00:45,295 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:45 +0000 (0:00:00.826) 0:00:02.903 ******* 2026-03-18 15:00:45,343 p=37566 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-18 15:00:45,354 p=37566 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-18 15:00:45,354 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:45 +0000 (0:00:00.059) 0:00:02.963 ******* 2026-03-18 15:00:47,593 p=37566 u=zuul n=ansible | ok: [compute-0] 2026-03-18 15:00:47,648 p=37566 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-18 15:00:47,648 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:02.293) 0:00:05.256 ******* 2026-03-18 15:00:47,744 p=37566 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-18 15:00:47,757 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:00:47,757 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:00.109) 0:00:05.365 ******* 2026-03-18 15:00:47,773 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:47,780 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:00:47,780 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:00.022) 0:00:05.388 ******* 2026-03-18 15:00:47,795 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:47,803 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:00:47,804 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:00.023) 0:00:05.412 ******* 2026-03-18 15:00:47,819 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:47,826 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:00:47,827 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:00.022) 0:00:05.435 ******* 2026-03-18 15:00:47,841 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:47,849 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:00:47,849 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:00.022) 0:00:05.457 ******* 2026-03-18 15:00:47,862 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:47,874 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:00:47,875 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:00.026) 0:00:05.483 ******* 2026-03-18 15:00:47,910 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/file_tests.yml for compute-0 => (item=/etc/rsyslog.d/10-telemetry.conf) 2026-03-18 15:00:47,924 p=37566 u=zuul n=ansible | TASK [common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf"] ******** 2026-03-18 15:00:47,924 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:47 +0000 (0:00:00.049) 0:00:05.532 ******* 2026-03-18 15:00:48,558 p=37566 u=zuul n=ansible | ok: [compute-0] 2026-03-18 15:00:48,577 p=37566 u=zuul n=ansible | TASK [common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists] *** 2026-03-18 15:00:48,578 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:48 +0000 (0:00:00.653) 0:00:06.186 ******* 2026-03-18 15:00:48,643 p=37566 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed" } 2026-03-18 15:00:48,655 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:00:48,655 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:48 +0000 (0:00:00.077) 0:00:06.263 ******* 2026-03-18 15:00:48,674 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:48,683 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:00:48,684 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:48 +0000 (0:00:00.028) 0:00:06.292 ******* 2026-03-18 15:00:48,704 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:48,713 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:00:48,713 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:48 +0000 (0:00:00.029) 0:00:06.322 ******* 2026-03-18 15:00:48,731 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:48,740 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:00:48,740 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:48 +0000 (0:00:00.026) 0:00:06.348 ******* 2026-03-18 15:00:48,759 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:48,768 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:00:48,769 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:48 +0000 (0:00:00.028) 0:00:06.377 ******* 2026-03-18 15:00:48,785 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:48,821 p=37566 u=zuul n=ansible | PLAY [Run container tests which require root on compute nodes] ***************** 2026-03-18 15:00:48,827 p=37566 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-18 15:00:48,828 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:48 +0000 (0:00:00.058) 0:00:06.436 ******* 2026-03-18 15:00:51,063 p=37566 u=zuul n=ansible | ok: [compute-0] 2026-03-18 15:00:51,092 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:00:51,092 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:02.264) 0:00:08.700 ******* 2026-03-18 15:00:51,114 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,125 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:00:51,126 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.033) 0:00:08.734 ******* 2026-03-18 15:00:51,150 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,160 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:00:51,161 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.035) 0:00:08.769 ******* 2026-03-18 15:00:51,185 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,195 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:00:51,195 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.034) 0:00:08.803 ******* 2026-03-18 15:00:51,216 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,226 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:00:51,226 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.031) 0:00:08.835 ******* 2026-03-18 15:00:51,253 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,262 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:00:51,262 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.035) 0:00:08.871 ******* 2026-03-18 15:00:51,324 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,331 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:00:51,331 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.069) 0:00:08.940 ******* 2026-03-18 15:00:51,349 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,359 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:00:51,359 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.027) 0:00:08.967 ******* 2026-03-18 15:00:51,376 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,385 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:00:51,385 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.025) 0:00:08.993 ******* 2026-03-18 15:00:51,401 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,409 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:00:51,410 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.024) 0:00:09.018 ******* 2026-03-18 15:00:51,426 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:51,435 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:00:51,435 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.025) 0:00:09.043 ******* 2026-03-18 15:00:51,473 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-18 15:00:51,477 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=node_exporter) 2026-03-18 15:00:51,488 p=37566 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-18 15:00:51,489 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:51 +0000 (0:00:00.053) 0:00:09.097 ******* 2026-03-18 15:00:52,151 p=37566 u=zuul n=ansible | ok: [compute-0] 2026-03-18 15:00:52,164 p=37566 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-18 15:00:52,164 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:52 +0000 (0:00:00.675) 0:00:09.772 ******* 2026-03-18 15:00:52,185 p=37566 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "ceilometer_agent_compute Up 5 minutes (healthy)" } 2026-03-18 15:00:52,197 p=37566 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-18 15:00:52,197 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:52 +0000 (0:00:00.033) 0:00:09.805 ******* 2026-03-18 15:00:52,230 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:52,240 p=37566 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-18 15:00:52,240 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:52 +0000 (0:00:00.042) 0:00:09.848 ******* 2026-03-18 15:00:52,272 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:52,284 p=37566 u=zuul n=ansible | TASK [common : TEST Verify ceilometer_agent_compute container status] ********** 2026-03-18 15:00:52,285 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:52 +0000 (0:00:00.044) 0:00:09.893 ******* 2026-03-18 15:00:52,326 p=37566 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'ceilometer_agent_compute' is in 'healthy' status." } 2026-03-18 15:00:52,338 p=37566 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-18 15:00:52,338 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:52 +0000 (0:00:00.053) 0:00:09.946 ******* 2026-03-18 15:00:52,977 p=37566 u=zuul n=ansible | ok: [compute-0] 2026-03-18 15:00:52,988 p=37566 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-18 15:00:52,988 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:52 +0000 (0:00:00.649) 0:00:10.596 ******* 2026-03-18 15:00:53,014 p=37566 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "node_exporter Up 4 minutes (healthy)" } 2026-03-18 15:00:53,022 p=37566 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-18 15:00:53,022 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:53 +0000 (0:00:00.033) 0:00:10.630 ******* 2026-03-18 15:00:53,047 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:53,057 p=37566 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-18 15:00:53,057 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:53 +0000 (0:00:00.035) 0:00:10.666 ******* 2026-03-18 15:00:53,084 p=37566 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 15:00:53,096 p=37566 u=zuul n=ansible | TASK [common : TEST Verify node_exporter container status] ********************* 2026-03-18 15:00:53,096 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:53 +0000 (0:00:00.038) 0:00:10.704 ******* 2026-03-18 15:00:53,130 p=37566 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'node_exporter' is in 'healthy' status." } 2026-03-18 15:00:53,162 p=37566 u=zuul n=ansible | PLAY [Verify logging projects, endpoints, credentials, nodes, pods, services, manifests and subscriptions] *** 2026-03-18 15:00:53,171 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:00:53,171 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:53 +0000 (0:00:00.075) 0:00:10.779 ******* 2026-03-18 15:00:53,237 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-operator-controller-manager) 2026-03-18 15:00:53,240 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstack-operator-controller-manager) 2026-03-18 15:00:53,250 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:00:53,251 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:53 +0000 (0:00:00.079) 0:00:10.859 ******* 2026-03-18 15:00:54,082 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:00:54,087 p=37566 u=zuul n=ansible | TASK [common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-18 15:00:54,087 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:54 +0000 (0:00:00.836) 0:00:11.695 ******* 2026-03-18 15:00:54,587 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:00:54,594 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:00:54,594 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:54 +0000 (0:00:00.507) 0:00:12.202 ******* 2026-03-18 15:00:55,136 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:00:55,141 p=37566 u=zuul n=ansible | TASK [common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-18 15:00:55,142 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:55 +0000 (0:00:00.547) 0:00:12.750 ******* 2026-03-18 15:00:55,783 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:00:55,790 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:00:55,790 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:55 +0000 (0:00:00.648) 0:00:13.398 ******* 2026-03-18 15:00:55,820 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/subscription_tests.yml for controller => (item=loki-operator) 2026-03-18 15:00:55,835 p=37566 u=zuul n=ansible | TASK [common : Verify subscription "loki-operator"] **************************** 2026-03-18 15:00:55,835 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:55 +0000 (0:00:00.045) 0:00:13.443 ******* 2026-03-18 15:00:56,438 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:00:56,444 p=37566 u=zuul n=ansible | TASK [common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace] *** 2026-03-18 15:00:56,444 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:56 +0000 (0:00:00.609) 0:00:14.053 ******* 2026-03-18 15:00:56,463 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "subscription loki-operator is found." } 2026-03-18 15:00:56,467 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:00:56,467 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:56 +0000 (0:00:00.023) 0:00:14.076 ******* 2026-03-18 15:00:56,572 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'public']) 2026-03-18 15:00:56,574 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'internal']) 2026-03-18 15:00:56,577 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'public']) 2026-03-18 15:00:56,579 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'internal']) 2026-03-18 15:00:56,581 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'public']) 2026-03-18 15:00:56,583 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'internal']) 2026-03-18 15:00:56,585 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'public']) 2026-03-18 15:00:56,587 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'internal']) 2026-03-18 15:00:56,589 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'public']) 2026-03-18 15:00:56,591 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'internal']) 2026-03-18 15:00:56,592 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'public']) 2026-03-18 15:00:56,594 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'internal']) 2026-03-18 15:00:56,596 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'public']) 2026-03-18 15:00:56,598 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'internal']) 2026-03-18 15:00:56,600 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'public']) 2026-03-18 15:00:56,602 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'internal']) 2026-03-18 15:00:56,613 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'public']"] **************** 2026-03-18 15:00:56,613 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:56 +0000 (0:00:00.145) 0:00:14.221 ******* 2026-03-18 15:00:59,638 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:00:59,644 p=37566 u=zuul n=ansible | TASK [common : TEST Check that nova public endpoint exists] ******************** 2026-03-18 15:00:59,644 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:59 +0000 (0:00:03.031) 0:00:17.252 ******* 2026-03-18 15:00:59,662 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-18 15:00:59,667 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'internal']"] ************** 2026-03-18 15:00:59,667 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:00:59 +0000 (0:00:00.023) 0:00:17.276 ******* 2026-03-18 15:01:02,881 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:02,887 p=37566 u=zuul n=ansible | TASK [common : TEST Check that nova internal endpoint exists] ****************** 2026-03-18 15:01:02,887 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:02 +0000 (0:00:03.219) 0:00:20.495 ******* 2026-03-18 15:01:02,906 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-18 15:01:02,911 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'public']"] ********* 2026-03-18 15:01:02,911 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:02 +0000 (0:00:00.024) 0:00:20.520 ******* 2026-03-18 15:01:05,675 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:05,682 p=37566 u=zuul n=ansible | TASK [common : TEST Check that placement public endpoint exists] *************** 2026-03-18 15:01:05,683 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:05 +0000 (0:00:02.771) 0:00:23.291 ******* 2026-03-18 15:01:05,701 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-18 15:01:05,707 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'internal']"] ******* 2026-03-18 15:01:05,708 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:05 +0000 (0:00:00.024) 0:00:23.316 ******* 2026-03-18 15:01:08,408 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:08,413 p=37566 u=zuul n=ansible | TASK [common : TEST Check that placement internal endpoint exists] ************* 2026-03-18 15:01:08,414 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:08 +0000 (0:00:02.705) 0:00:26.022 ******* 2026-03-18 15:01:08,436 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-18 15:01:08,441 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'public']"] ********** 2026-03-18 15:01:08,441 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:08 +0000 (0:00:00.027) 0:00:26.049 ******* 2026-03-18 15:01:11,365 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:11,371 p=37566 u=zuul n=ansible | TASK [common : TEST Check that swift public endpoint exists] ******************* 2026-03-18 15:01:11,371 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:11 +0000 (0:00:02.930) 0:00:28.979 ******* 2026-03-18 15:01:11,391 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-18 15:01:11,398 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'internal']"] ******** 2026-03-18 15:01:11,398 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:11 +0000 (0:00:00.026) 0:00:29.006 ******* 2026-03-18 15:01:14,101 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:14,106 p=37566 u=zuul n=ansible | TASK [common : TEST Check that swift internal endpoint exists] ***************** 2026-03-18 15:01:14,106 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:14 +0000 (0:00:02.708) 0:00:31.714 ******* 2026-03-18 15:01:14,127 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-18 15:01:14,132 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'public']"] *********** 2026-03-18 15:01:14,132 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:14 +0000 (0:00:00.025) 0:00:31.740 ******* 2026-03-18 15:01:16,937 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:16,944 p=37566 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 public endpoint exists] **************** 2026-03-18 15:01:16,944 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:16 +0000 (0:00:02.811) 0:00:34.552 ******* 2026-03-18 15:01:16,961 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-18 15:01:16,966 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'internal']"] ********* 2026-03-18 15:01:16,967 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:16 +0000 (0:00:00.022) 0:00:34.575 ******* 2026-03-18 15:01:19,999 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:20,007 p=37566 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 internal endpoint exists] ************** 2026-03-18 15:01:20,007 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:20 +0000 (0:00:03.040) 0:00:37.615 ******* 2026-03-18 15:01:20,032 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-18 15:01:20,039 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'public']"] ******** 2026-03-18 15:01:20,039 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:20 +0000 (0:00:00.032) 0:00:37.647 ******* 2026-03-18 15:01:22,892 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:22,902 p=37566 u=zuul n=ansible | TASK [common : TEST Check that barbican public endpoint exists] **************** 2026-03-18 15:01:22,902 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:22 +0000 (0:00:02.862) 0:00:40.510 ******* 2026-03-18 15:01:22,927 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-18 15:01:22,933 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'internal']"] ****** 2026-03-18 15:01:22,934 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:22 +0000 (0:00:00.031) 0:00:40.542 ******* 2026-03-18 15:01:25,630 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:25,637 p=37566 u=zuul n=ansible | TASK [common : TEST Check that barbican internal endpoint exists] ************** 2026-03-18 15:01:25,637 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:25 +0000 (0:00:02.703) 0:00:43.245 ******* 2026-03-18 15:01:25,671 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-18 15:01:25,678 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'public']"] *********** 2026-03-18 15:01:25,678 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:25 +0000 (0:00:00.041) 0:00:43.286 ******* 2026-03-18 15:01:28,963 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:28,971 p=37566 u=zuul n=ansible | TASK [common : TEST Check that keystone public endpoint exists] **************** 2026-03-18 15:01:28,971 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:28 +0000 (0:00:03.293) 0:00:46.579 ******* 2026-03-18 15:01:28,994 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-18 15:01:29,002 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'internal']"] ********* 2026-03-18 15:01:29,002 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:29 +0000 (0:00:00.031) 0:00:46.610 ******* 2026-03-18 15:01:31,772 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:31,779 p=37566 u=zuul n=ansible | TASK [common : TEST Check that keystone internal endpoint exists] ************** 2026-03-18 15:01:31,779 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:31 +0000 (0:00:02.776) 0:00:49.387 ******* 2026-03-18 15:01:31,798 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-18 15:01:31,804 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'public']"] **************** 2026-03-18 15:01:31,805 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:31 +0000 (0:00:00.025) 0:00:49.413 ******* 2026-03-18 15:01:34,453 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:34,460 p=37566 u=zuul n=ansible | TASK [common : TEST Check that glance public endpoint exists] ****************** 2026-03-18 15:01:34,461 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:34 +0000 (0:00:02.656) 0:00:52.069 ******* 2026-03-18 15:01:34,488 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-18 15:01:34,494 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'internal']"] ************** 2026-03-18 15:01:34,494 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:34 +0000 (0:00:00.033) 0:00:52.103 ******* 2026-03-18 15:01:37,357 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:37,365 p=37566 u=zuul n=ansible | TASK [common : TEST Check that glance internal endpoint exists] **************** 2026-03-18 15:01:37,365 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:37 +0000 (0:00:02.870) 0:00:54.973 ******* 2026-03-18 15:01:37,398 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-18 15:01:37,404 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'public']"] ************* 2026-03-18 15:01:37,404 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:37 +0000 (0:00:00.039) 0:00:55.012 ******* 2026-03-18 15:01:40,205 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:40,221 p=37566 u=zuul n=ansible | TASK [common : TEST Check that neutron public endpoint exists] ***************** 2026-03-18 15:01:40,222 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:40 +0000 (0:00:02.817) 0:00:57.830 ******* 2026-03-18 15:01:40,254 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-18 15:01:40,260 p=37566 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'internal']"] *********** 2026-03-18 15:01:40,260 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:40 +0000 (0:00:00.038) 0:00:57.868 ******* 2026-03-18 15:01:43,005 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:43,012 p=37566 u=zuul n=ansible | TASK [common : TEST Check that neutron internal endpoint exists] *************** 2026-03-18 15:01:43,013 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:43 +0000 (0:00:02.752) 0:01:00.621 ******* 2026-03-18 15:01:43,037 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-18 15:01:43,042 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:01:43,042 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:43 +0000 (0:00:00.029) 0:01:00.650 ******* 2026-03-18 15:01:43,086 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-openstack-infra) 2026-03-18 15:01:43,088 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift) 2026-03-18 15:01:43,090 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openstack-operators) 2026-03-18 15:01:43,092 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-logging) 2026-03-18 15:01:43,128 p=37566 u=zuul n=ansible | TASK [common : Get the openshift-openstack-infra project] ********************** 2026-03-18 15:01:43,128 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:43 +0000 (0:00:00.086) 0:01:00.736 ******* 2026-03-18 15:01:43,710 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:43,717 p=37566 u=zuul n=ansible | TASK [common : TEST Verify openshift-openstack-infra project exists] *********** 2026-03-18 15:01:43,718 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:43 +0000 (0:00:00.589) 0:01:01.326 ******* 2026-03-18 15:01:43,737 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-openstack-infra is found." } 2026-03-18 15:01:43,744 p=37566 u=zuul n=ansible | TASK [common : Get the openshift project] ************************************** 2026-03-18 15:01:43,744 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:43 +0000 (0:00:00.026) 0:01:01.352 ******* 2026-03-18 15:01:44,333 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:44,338 p=37566 u=zuul n=ansible | TASK [common : TEST Verify openshift project exists] *************************** 2026-03-18 15:01:44,338 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:44 +0000 (0:00:00.594) 0:01:01.946 ******* 2026-03-18 15:01:44,355 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift is found." } 2026-03-18 15:01:44,360 p=37566 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-18 15:01:44,360 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:44 +0000 (0:00:00.021) 0:01:01.968 ******* 2026-03-18 15:01:44,943 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:44,954 p=37566 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-18 15:01:44,954 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:44 +0000 (0:00:00.594) 0:01:02.562 ******* 2026-03-18 15:01:44,974 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-18 15:01:44,980 p=37566 u=zuul n=ansible | TASK [common : Get the openshift-logging project] ****************************** 2026-03-18 15:01:44,980 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:44 +0000 (0:00:00.025) 0:01:02.588 ******* 2026-03-18 15:01:45,467 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:45,473 p=37566 u=zuul n=ansible | TASK [common : TEST Verify openshift-logging project exists] ******************* 2026-03-18 15:01:45,473 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:45 +0000 (0:00:00.492) 0:01:03.081 ******* 2026-03-18 15:01:45,489 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-logging is found." } 2026-03-18 15:01:45,494 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:01:45,494 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:45 +0000 (0:00:00.021) 0:01:03.102 ******* 2026-03-18 15:01:45,596 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=cluster-logging-operator-metrics) 2026-03-18 15:01:45,598 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-grpc) 2026-03-18 15:01:45,601 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-http) 2026-03-18 15:01:45,603 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-grpc) 2026-03-18 15:01:45,604 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-http) 2026-03-18 15:01:45,606 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gateway-http) 2026-03-18 15:01:45,608 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gossip-ring) 2026-03-18 15:01:45,610 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-grpc) 2026-03-18 15:01:45,612 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-http) 2026-03-18 15:01:45,613 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-grpc) 2026-03-18 15:01:45,615 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-http) 2026-03-18 15:01:45,617 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-grpc) 2026-03-18 15:01:45,619 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-http) 2026-03-18 15:01:45,621 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-grpc) 2026-03-18 15:01:45,623 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-http) 2026-03-18 15:01:45,624 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=openstack-logging) 2026-03-18 15:01:45,656 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "cluster-logging-operator-metrics"] ************ 2026-03-18 15:01:45,656 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:45 +0000 (0:00:00.162) 0:01:03.265 ******* 2026-03-18 15:01:46,153 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:46,158 p=37566 u=zuul n=ansible | TASK [common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace] *** 2026-03-18 15:01:46,158 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:46 +0000 (0:00:00.501) 0:01:03.766 ******* 2026-03-18 15:01:46,172 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service cluster-logging-operator-metrics is running." } 2026-03-18 15:01:46,177 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-grpc"] ***************** 2026-03-18 15:01:46,177 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:46 +0000 (0:00:00.018) 0:01:03.785 ******* 2026-03-18 15:01:46,609 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:46,614 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace] *** 2026-03-18 15:01:46,614 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:46 +0000 (0:00:00.437) 0:01:04.222 ******* 2026-03-18 15:01:46,630 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-grpc is running." } 2026-03-18 15:01:46,634 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-http"] ***************** 2026-03-18 15:01:46,634 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:46 +0000 (0:00:00.020) 0:01:04.242 ******* 2026-03-18 15:01:47,164 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:47,170 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace] *** 2026-03-18 15:01:47,170 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:47 +0000 (0:00:00.535) 0:01:04.778 ******* 2026-03-18 15:01:47,190 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-http is running." } 2026-03-18 15:01:47,195 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-grpc"] *************** 2026-03-18 15:01:47,195 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:47 +0000 (0:00:00.025) 0:01:04.803 ******* 2026-03-18 15:01:47,709 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:47,715 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace] *** 2026-03-18 15:01:47,716 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:47 +0000 (0:00:00.520) 0:01:05.324 ******* 2026-03-18 15:01:47,734 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-grpc is running." } 2026-03-18 15:01:47,740 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-http"] *************** 2026-03-18 15:01:47,741 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:47 +0000 (0:00:00.024) 0:01:05.349 ******* 2026-03-18 15:01:48,307 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:48,315 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace] *** 2026-03-18 15:01:48,315 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:48 +0000 (0:00:00.574) 0:01:05.923 ******* 2026-03-18 15:01:48,335 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-http is running." } 2026-03-18 15:01:48,341 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gateway-http"] ******************* 2026-03-18 15:01:48,341 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:48 +0000 (0:00:00.026) 0:01:05.949 ******* 2026-03-18 15:01:48,913 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:48,918 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace] *** 2026-03-18 15:01:48,918 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:48 +0000 (0:00:00.576) 0:01:06.526 ******* 2026-03-18 15:01:48,941 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gateway-http is running." } 2026-03-18 15:01:48,947 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gossip-ring"] ******************** 2026-03-18 15:01:48,947 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:48 +0000 (0:00:00.028) 0:01:06.555 ******* 2026-03-18 15:01:49,783 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:49,788 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace] *** 2026-03-18 15:01:49,788 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:49 +0000 (0:00:00.840) 0:01:07.396 ******* 2026-03-18 15:01:49,802 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gossip-ring is running." } 2026-03-18 15:01:49,807 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-grpc"] ************* 2026-03-18 15:01:49,808 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:49 +0000 (0:00:00.019) 0:01:07.416 ******* 2026-03-18 15:01:50,296 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:50,301 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace] *** 2026-03-18 15:01:50,301 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:50 +0000 (0:00:00.493) 0:01:07.909 ******* 2026-03-18 15:01:50,318 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-grpc is running." } 2026-03-18 15:01:50,326 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-http"] ************* 2026-03-18 15:01:50,326 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:50 +0000 (0:00:00.024) 0:01:07.934 ******* 2026-03-18 15:01:50,862 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:50,867 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace] *** 2026-03-18 15:01:50,867 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:50 +0000 (0:00:00.541) 0:01:08.475 ******* 2026-03-18 15:01:50,887 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-http is running." } 2026-03-18 15:01:50,891 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-grpc"] ****************** 2026-03-18 15:01:50,891 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:50 +0000 (0:00:00.024) 0:01:08.500 ******* 2026-03-18 15:01:51,392 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:51,399 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace] *** 2026-03-18 15:01:51,399 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:51 +0000 (0:00:00.507) 0:01:09.007 ******* 2026-03-18 15:01:51,416 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-grpc is running." } 2026-03-18 15:01:51,423 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-http"] ****************** 2026-03-18 15:01:51,423 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:51 +0000 (0:00:00.024) 0:01:09.031 ******* 2026-03-18 15:01:51,911 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:51,917 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace] *** 2026-03-18 15:01:51,917 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:51 +0000 (0:00:00.494) 0:01:09.525 ******* 2026-03-18 15:01:51,936 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-http is running." } 2026-03-18 15:01:51,940 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-grpc"] ******************* 2026-03-18 15:01:51,940 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:51 +0000 (0:00:00.023) 0:01:09.549 ******* 2026-03-18 15:01:52,401 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:52,407 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace] *** 2026-03-18 15:01:52,407 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:52 +0000 (0:00:00.466) 0:01:10.015 ******* 2026-03-18 15:01:52,423 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-grpc is running." } 2026-03-18 15:01:52,428 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-http"] ******************* 2026-03-18 15:01:52,429 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:52 +0000 (0:00:00.021) 0:01:10.037 ******* 2026-03-18 15:01:52,961 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:52,968 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace] *** 2026-03-18 15:01:52,968 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:52 +0000 (0:00:00.539) 0:01:10.577 ******* 2026-03-18 15:01:52,989 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-http is running." } 2026-03-18 15:01:52,994 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-grpc"] ************ 2026-03-18 15:01:52,994 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:52 +0000 (0:00:00.025) 0:01:10.603 ******* 2026-03-18 15:01:53,576 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:53,581 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace] *** 2026-03-18 15:01:53,581 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:53 +0000 (0:00:00.586) 0:01:11.189 ******* 2026-03-18 15:01:53,601 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-grpc is running." } 2026-03-18 15:01:53,606 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-http"] ************ 2026-03-18 15:01:53,606 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:53 +0000 (0:00:00.024) 0:01:11.214 ******* 2026-03-18 15:01:54,178 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:54,185 p=37566 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace] *** 2026-03-18 15:01:54,185 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:54 +0000 (0:00:00.579) 0:01:11.793 ******* 2026-03-18 15:01:54,204 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-http is running." } 2026-03-18 15:01:54,210 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "openstack-logging"] *************************** 2026-03-18 15:01:54,210 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:54 +0000 (0:00:00.025) 0:01:11.819 ******* 2026-03-18 15:01:54,744 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:54,750 p=37566 u=zuul n=ansible | TASK [common : TEST Verify openstack-logging service is running in openshift-logging namespace] *** 2026-03-18 15:01:54,750 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:54 +0000 (0:00:00.539) 0:01:12.358 ******* 2026-03-18 15:01:54,768 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service openstack-logging is running." } 2026-03-18 15:01:54,772 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:01:54,772 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:54 +0000 (0:00:00.022) 0:01:12.380 ******* 2026-03-18 15:01:54,791 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:54,797 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:01:54,797 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:54 +0000 (0:00:00.024) 0:01:12.405 ******* 2026-03-18 15:01:55,554 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:55,564 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:01:55,565 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:55 +0000 (0:00:00.767) 0:01:13.173 ******* 2026-03-18 15:01:55,600 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/manifest_tests.yml for controller => (item={'name': 'loki-operator', 'expected_number': 2}) 2026-03-18 15:01:55,621 p=37566 u=zuul n=ansible | TASK [common : TEST Get loki-operator 2 packagemanifest] *********************** 2026-03-18 15:01:55,622 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:55 +0000 (0:00:00.056) 0:01:13.230 ******* 2026-03-18 15:01:55,691 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "Expected 2 and found 2\n" } 2026-03-18 15:01:55,695 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:01:55,696 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:55 +0000 (0:00:00.074) 0:01:13.304 ******* 2026-03-18 15:01:55,714 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:55,718 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:01:55,718 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:55 +0000 (0:00:00.022) 0:01:13.326 ******* 2026-03-18 15:01:55,733 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:55,737 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:01:55,737 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:55 +0000 (0:00:00.019) 0:01:13.345 ******* 2026-03-18 15:01:55,754 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:55,769 p=37566 u=zuul n=ansible | PLAY [Verify logging pods are running in openstack] **************************** 2026-03-18 15:01:55,777 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:01:55,777 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:55 +0000 (0:00:00.040) 0:01:13.386 ******* 2026-03-18 15:01:55,804 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstackclient) 2026-03-18 15:01:55,809 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:01:55,809 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:55 +0000 (0:00:00.031) 0:01:13.417 ******* 2026-03-18 15:01:56,442 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:56,447 p=37566 u=zuul n=ansible | TASK [common : TEST Check openstackclient pod is Running in openstack namespace] *** 2026-03-18 15:01:56,447 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:56 +0000 (0:00:00.638) 0:01:14.056 ******* 2026-03-18 15:01:57,014 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:57,018 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:01:57,018 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.570) 0:01:14.626 ******* 2026-03-18 15:01:57,033 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,038 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:01:57,038 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.019) 0:01:14.646 ******* 2026-03-18 15:01:57,053 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,056 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:01:57,057 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.018) 0:01:14.665 ******* 2026-03-18 15:01:57,071 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,075 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:01:57,075 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.018) 0:01:14.683 ******* 2026-03-18 15:01:57,090 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,093 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:01:57,093 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.018) 0:01:14.702 ******* 2026-03-18 15:01:57,108 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,111 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:01:57,111 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.017) 0:01:14.719 ******* 2026-03-18 15:01:57,126 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,129 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:01:57,130 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.018) 0:01:14.738 ******* 2026-03-18 15:01:57,144 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,148 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:01:57,148 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.018) 0:01:14.756 ******* 2026-03-18 15:01:57,164 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,167 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:01:57,167 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.019) 0:01:14.776 ******* 2026-03-18 15:01:57,181 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,185 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:01:57,185 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.017) 0:01:14.793 ******* 2026-03-18 15:01:57,200 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:57,213 p=37566 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-operators-redhat] *********** 2026-03-18 15:01:57,221 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:01:57,221 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.036) 0:01:14.829 ******* 2026-03-18 15:01:57,246 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=loki-operator-controller-manager) 2026-03-18 15:01:57,252 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:01:57,252 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.030) 0:01:14.860 ******* 2026-03-18 15:01:57,749 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:57,753 p=37566 u=zuul n=ansible | TASK [common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace] *** 2026-03-18 15:01:57,753 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:57 +0000 (0:00:00.501) 0:01:15.362 ******* 2026-03-18 15:01:58,310 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:58,316 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:01:58,316 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.562) 0:01:15.924 ******* 2026-03-18 15:01:58,337 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,341 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:01:58,341 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.024) 0:01:15.949 ******* 2026-03-18 15:01:58,361 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,366 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:01:58,366 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.025) 0:01:15.974 ******* 2026-03-18 15:01:58,387 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,392 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:01:58,393 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.026) 0:01:16.001 ******* 2026-03-18 15:01:58,412 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,417 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:01:58,417 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.024) 0:01:16.025 ******* 2026-03-18 15:01:58,438 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,443 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:01:58,443 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.025) 0:01:16.051 ******* 2026-03-18 15:01:58,460 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,464 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:01:58,464 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.021) 0:01:16.072 ******* 2026-03-18 15:01:58,482 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,487 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:01:58,488 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.023) 0:01:16.096 ******* 2026-03-18 15:01:58,506 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,511 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:01:58,511 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.023) 0:01:16.119 ******* 2026-03-18 15:01:58,530 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,535 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:01:58,535 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.024) 0:01:16.143 ******* 2026-03-18 15:01:58,553 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:01:58,569 p=37566 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-logging] ******************** 2026-03-18 15:01:58,579 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:01:58,580 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.044) 0:01:16.188 ******* 2026-03-18 15:01:58,675 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=cluster-logging-operator) 2026-03-18 15:01:58,679 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-compactor) 2026-03-18 15:01:58,681 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-distributor) 2026-03-18 15:01:58,684 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-index-gateway) 2026-03-18 15:01:58,687 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-ingester) 2026-03-18 15:01:58,689 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-querier) 2026-03-18 15:01:58,692 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-query-frontend) 2026-03-18 15:01:58,695 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=collector) 2026-03-18 15:01:58,702 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:01:58,703 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:58 +0000 (0:00:00.123) 0:01:16.311 ******* 2026-03-18 15:01:59,243 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:59,250 p=37566 u=zuul n=ansible | TASK [common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace] *** 2026-03-18 15:01:59,250 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:59 +0000 (0:00:00.547) 0:01:16.858 ******* 2026-03-18 15:01:59,758 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:01:59,766 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:01:59,766 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:01:59 +0000 (0:00:00.515) 0:01:17.374 ******* 2026-03-18 15:02:00,353 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:00,361 p=37566 u=zuul n=ansible | TASK [common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace] *** 2026-03-18 15:02:00,361 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:00 +0000 (0:00:00.595) 0:01:17.969 ******* 2026-03-18 15:02:00,931 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:00,936 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:02:00,936 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:00 +0000 (0:00:00.574) 0:01:18.544 ******* 2026-03-18 15:02:01,670 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:01,677 p=37566 u=zuul n=ansible | TASK [common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace] *** 2026-03-18 15:02:01,677 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:01 +0000 (0:00:00.741) 0:01:19.285 ******* 2026-03-18 15:02:02,224 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:02,229 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:02:02,229 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:02 +0000 (0:00:00.551) 0:01:19.837 ******* 2026-03-18 15:02:02,839 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:02,846 p=37566 u=zuul n=ansible | TASK [common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace] *** 2026-03-18 15:02:02,846 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:02 +0000 (0:00:00.616) 0:01:20.454 ******* 2026-03-18 15:02:03,453 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:03,461 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:02:03,461 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:03 +0000 (0:00:00.614) 0:01:21.069 ******* 2026-03-18 15:02:04,091 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:04,097 p=37566 u=zuul n=ansible | TASK [common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace] *** 2026-03-18 15:02:04,097 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:04 +0000 (0:00:00.635) 0:01:21.705 ******* 2026-03-18 15:02:04,662 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:04,668 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:02:04,668 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:04 +0000 (0:00:00.570) 0:01:22.276 ******* 2026-03-18 15:02:05,270 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:05,275 p=37566 u=zuul n=ansible | TASK [common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace] *** 2026-03-18 15:02:05,275 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:05 +0000 (0:00:00.607) 0:01:22.883 ******* 2026-03-18 15:02:06,132 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:06,139 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:02:06,139 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:06 +0000 (0:00:00.863) 0:01:23.747 ******* 2026-03-18 15:02:07,483 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:07,488 p=37566 u=zuul n=ansible | TASK [common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace] *** 2026-03-18 15:02:07,488 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:07 +0000 (0:00:01.349) 0:01:25.096 ******* 2026-03-18 15:02:08,010 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:08,015 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:02:08,016 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:08 +0000 (0:00:00.527) 0:01:25.624 ******* 2026-03-18 15:02:08,795 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:08,803 p=37566 u=zuul n=ansible | TASK [common : TEST Check collector pod is Running in openshift-logging namespace] *** 2026-03-18 15:02:08,803 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:08 +0000 (0:00:00.787) 0:01:26.411 ******* 2026-03-18 15:02:09,390 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:09,394 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:02:09,394 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.591) 0:01:27.002 ******* 2026-03-18 15:02:09,419 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,422 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:02:09,422 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.027) 0:01:27.030 ******* 2026-03-18 15:02:09,444 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,447 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:02:09,447 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.025) 0:01:27.055 ******* 2026-03-18 15:02:09,465 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,469 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:02:09,469 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.021) 0:01:27.077 ******* 2026-03-18 15:02:09,486 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,490 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:02:09,490 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.020) 0:01:27.098 ******* 2026-03-18 15:02:09,506 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,510 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:02:09,510 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.019) 0:01:27.118 ******* 2026-03-18 15:02:09,526 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,529 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:02:09,530 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.019) 0:01:27.138 ******* 2026-03-18 15:02:09,545 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,548 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:02:09,548 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.018) 0:01:27.157 ******* 2026-03-18 15:02:09,563 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,567 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:02:09,567 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.018) 0:01:27.175 ******* 2026-03-18 15:02:09,584 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,587 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:02:09,587 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.019) 0:01:27.195 ******* 2026-03-18 15:02:09,602 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:09,615 p=37566 u=zuul n=ansible | PLAY [Verify logging pods are running in minio-dev] **************************** 2026-03-18 15:02:09,622 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:02:09,622 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.035) 0:01:27.231 ******* 2026-03-18 15:02:09,649 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=minio) 2026-03-18 15:02:09,658 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 15:02:09,658 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:09 +0000 (0:00:00.035) 0:01:27.266 ******* 2026-03-18 15:02:10,321 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:10,328 p=37566 u=zuul n=ansible | TASK [common : TEST Check minio pod is Running in minio-dev namespace] ********* 2026-03-18 15:02:10,329 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:10 +0000 (0:00:00.670) 0:01:27.937 ******* 2026-03-18 15:02:10,957 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:10,962 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:02:10,962 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:10 +0000 (0:00:00.633) 0:01:28.570 ******* 2026-03-18 15:02:10,982 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:10,987 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:02:10,987 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:10 +0000 (0:00:00.025) 0:01:28.595 ******* 2026-03-18 15:02:11,006 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,011 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:02:11,012 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.024) 0:01:28.620 ******* 2026-03-18 15:02:11,033 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,037 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:02:11,037 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.025) 0:01:28.645 ******* 2026-03-18 15:02:11,058 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,062 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:02:11,063 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.025) 0:01:28.671 ******* 2026-03-18 15:02:11,080 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,084 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:02:11,084 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.021) 0:01:28.693 ******* 2026-03-18 15:02:11,101 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,106 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:02:11,106 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.021) 0:01:28.714 ******* 2026-03-18 15:02:11,125 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,131 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:02:11,131 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.025) 0:01:28.739 ******* 2026-03-18 15:02:11,150 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,154 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:02:11,155 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.023) 0:01:28.763 ******* 2026-03-18 15:02:11,172 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,175 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:02:11,175 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.020) 0:01:28.784 ******* 2026-03-18 15:02:11,192 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:11,204 p=37566 u=zuul n=ansible | PLAY [Verify logging pods have complete status in openstack] ******************* 2026-03-18 15:02:11,212 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:02:11,212 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.036) 0:01:28.820 ******* 2026-03-18 15:02:11,317 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=bootstrap-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,319 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-network-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,321 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,323 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-certs-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,325 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,327 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=libvirt-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,329 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,331 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=neutron-metadata-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,334 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ovn-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,336 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=reboot-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,339 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=run-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,341 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ssh-known-hosts-edpm-deployment) 2026-03-18 15:02:11,344 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,346 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=validate-network-edpm-deployment-openstack-edpm-ipam) 2026-03-18 15:02:11,354 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:11,355 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:11 +0000 (0:00:00.142) 0:01:28.963 ******* 2026-03-18 15:02:11,996 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:12,003 p=37566 u=zuul n=ansible | TASK [common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:12,003 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:12 +0000 (0:00:00.648) 0:01:29.611 ******* 2026-03-18 15:02:12,529 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:12,535 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:12,535 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:12 +0000 (0:00:00.531) 0:01:30.143 ******* 2026-03-18 15:02:13,161 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:13,168 p=37566 u=zuul n=ansible | TASK [common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:13,169 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:13 +0000 (0:00:00.633) 0:01:30.777 ******* 2026-03-18 15:02:13,791 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:13,796 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:13,796 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:13 +0000 (0:00:00.627) 0:01:31.404 ******* 2026-03-18 15:02:14,488 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:14,495 p=37566 u=zuul n=ansible | TASK [common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:14,495 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:14 +0000 (0:00:00.699) 0:01:32.104 ******* 2026-03-18 15:02:15,094 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:15,099 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:15,099 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:15 +0000 (0:00:00.603) 0:01:32.708 ******* 2026-03-18 15:02:15,749 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:15,754 p=37566 u=zuul n=ansible | TASK [common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:15,754 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:15 +0000 (0:00:00.654) 0:01:33.362 ******* 2026-03-18 15:02:16,473 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:16,483 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:16,483 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:16 +0000 (0:00:00.728) 0:01:34.091 ******* 2026-03-18 15:02:17,202 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:17,207 p=37566 u=zuul n=ansible | TASK [common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:17,207 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:17 +0000 (0:00:00.724) 0:01:34.815 ******* 2026-03-18 15:02:17,927 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:17,932 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:17,933 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:17 +0000 (0:00:00.725) 0:01:35.541 ******* 2026-03-18 15:02:18,543 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:18,549 p=37566 u=zuul n=ansible | TASK [common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:18,549 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:18 +0000 (0:00:00.616) 0:01:36.157 ******* 2026-03-18 15:02:19,301 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:19,307 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:19,307 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:19 +0000 (0:00:00.757) 0:01:36.915 ******* 2026-03-18 15:02:19,924 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:19,932 p=37566 u=zuul n=ansible | TASK [common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:19,932 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:19 +0000 (0:00:00.624) 0:01:37.540 ******* 2026-03-18 15:02:20,642 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:20,647 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:20,647 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:20 +0000 (0:00:00.714) 0:01:38.255 ******* 2026-03-18 15:02:21,288 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:21,295 p=37566 u=zuul n=ansible | TASK [common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:21,295 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:21 +0000 (0:00:00.648) 0:01:38.903 ******* 2026-03-18 15:02:21,854 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:21,861 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:21,861 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:21 +0000 (0:00:00.565) 0:01:39.469 ******* 2026-03-18 15:02:22,432 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:22,436 p=37566 u=zuul n=ansible | TASK [common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:22,437 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:22 +0000 (0:00:00.575) 0:01:40.045 ******* 2026-03-18 15:02:23,105 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:23,111 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:23,111 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:23 +0000 (0:00:00.674) 0:01:40.719 ******* 2026-03-18 15:02:23,774 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:23,780 p=37566 u=zuul n=ansible | TASK [common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:23,780 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:23 +0000 (0:00:00.668) 0:01:41.388 ******* 2026-03-18 15:02:24,364 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:24,369 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:24,369 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:24 +0000 (0:00:00.589) 0:01:41.977 ******* 2026-03-18 15:02:25,021 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:25,026 p=37566 u=zuul n=ansible | TASK [common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:25,026 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:25 +0000 (0:00:00.657) 0:01:42.634 ******* 2026-03-18 15:02:25,573 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:25,578 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:25,578 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:25 +0000 (0:00:00.551) 0:01:43.186 ******* 2026-03-18 15:02:26,192 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:26,197 p=37566 u=zuul n=ansible | TASK [common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace] *** 2026-03-18 15:02:26,198 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:26 +0000 (0:00:00.619) 0:01:43.806 ******* 2026-03-18 15:02:26,772 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:26,778 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:26,778 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:26 +0000 (0:00:00.580) 0:01:44.386 ******* 2026-03-18 15:02:27,344 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:27,349 p=37566 u=zuul n=ansible | TASK [common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:27,349 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:27 +0000 (0:00:00.571) 0:01:44.957 ******* 2026-03-18 15:02:27,855 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:27,859 p=37566 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 15:02:27,860 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:27 +0000 (0:00:00.510) 0:01:45.468 ******* 2026-03-18 15:02:28,465 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:28,472 p=37566 u=zuul n=ansible | TASK [common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 15:02:28,472 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:28 +0000 (0:00:00.612) 0:01:46.081 ******* 2026-03-18 15:02:29,004 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:29,008 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:02:29,008 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.536) 0:01:46.617 ******* 2026-03-18 15:02:29,024 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,028 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:02:29,028 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.019) 0:01:46.636 ******* 2026-03-18 15:02:29,044 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,050 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:02:29,050 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.021) 0:01:46.658 ******* 2026-03-18 15:02:29,065 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,071 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:02:29,071 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.021) 0:01:46.679 ******* 2026-03-18 15:02:29,088 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,094 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:02:29,095 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.023) 0:01:46.703 ******* 2026-03-18 15:02:29,112 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,117 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:02:29,117 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.022) 0:01:46.726 ******* 2026-03-18 15:02:29,133 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,137 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:02:29,138 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.020) 0:01:46.746 ******* 2026-03-18 15:02:29,154 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,159 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:02:29,160 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.022) 0:01:46.768 ******* 2026-03-18 15:02:29,176 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,182 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:02:29,182 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.022) 0:01:46.790 ******* 2026-03-18 15:02:29,199 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,204 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:02:29,204 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.022) 0:01:46.812 ******* 2026-03-18 15:02:29,221 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,242 p=37566 u=zuul n=ansible | PLAY [Verify the crds exist] *************************************************** 2026-03-18 15:02:29,256 p=37566 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 15:02:29,256 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.051) 0:01:46.864 ******* 2026-03-18 15:02:29,275 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,279 p=37566 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 15:02:29,280 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.023) 0:01:46.888 ******* 2026-03-18 15:02:29,301 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,305 p=37566 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 15:02:29,305 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.025) 0:01:46.913 ******* 2026-03-18 15:02:29,329 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,333 p=37566 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 15:02:29,333 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.028) 0:01:46.942 ******* 2026-03-18 15:02:29,351 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:29,356 p=37566 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 15:02:29,356 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.022) 0:01:46.964 ******* 2026-03-18 15:02:29,410 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-internal) 2026-03-18 15:02:29,411 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-metadata-internal) 2026-03-18 15:02:29,413 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-novncproxy-cell1-public) 2026-03-18 15:02:29,415 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-public) 2026-03-18 15:02:29,422 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "nova-internal"] ******************************* 2026-03-18 15:02:29,422 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.066) 0:01:47.030 ******* 2026-03-18 15:02:29,988 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:29,993 p=37566 u=zuul n=ansible | TASK [common : TEST Verify nova-internal service is running in openstack namespace] *** 2026-03-18 15:02:29,994 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:29 +0000 (0:00:00.571) 0:01:47.602 ******* 2026-03-18 15:02:30,014 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-internal is running." } 2026-03-18 15:02:30,020 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "nova-metadata-internal"] ********************** 2026-03-18 15:02:30,021 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:30 +0000 (0:00:00.026) 0:01:47.629 ******* 2026-03-18 15:02:30,576 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:30,586 p=37566 u=zuul n=ansible | TASK [common : TEST Verify nova-metadata-internal service is running in openstack namespace] *** 2026-03-18 15:02:30,586 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:30 +0000 (0:00:00.565) 0:01:48.195 ******* 2026-03-18 15:02:30,608 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-metadata-internal is running." } 2026-03-18 15:02:30,617 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "nova-novncproxy-cell1-public"] **************** 2026-03-18 15:02:30,617 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:30 +0000 (0:00:00.030) 0:01:48.225 ******* 2026-03-18 15:02:31,157 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:31,161 p=37566 u=zuul n=ansible | TASK [common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace] *** 2026-03-18 15:02:31,161 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.543) 0:01:48.769 ******* 2026-03-18 15:02:31,178 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-novncproxy-cell1-public is running." } 2026-03-18 15:02:31,183 p=37566 u=zuul n=ansible | TASK [common : Verify Service - "nova-public"] ********************************* 2026-03-18 15:02:31,184 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.022) 0:01:48.792 ******* 2026-03-18 15:02:31,722 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:31,730 p=37566 u=zuul n=ansible | TASK [common : TEST Verify nova-public service is running in openstack namespace] *** 2026-03-18 15:02:31,730 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.546) 0:01:49.338 ******* 2026-03-18 15:02:31,747 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-public is running." } 2026-03-18 15:02:31,752 p=37566 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 15:02:31,752 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.021) 0:01:49.360 ******* 2026-03-18 15:02:31,766 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:31,769 p=37566 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 15:02:31,769 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.017) 0:01:49.377 ******* 2026-03-18 15:02:31,781 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:31,785 p=37566 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 15:02:31,785 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.015) 0:01:49.393 ******* 2026-03-18 15:02:31,801 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:31,804 p=37566 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 15:02:31,804 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.019) 0:01:49.413 ******* 2026-03-18 15:02:31,847 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=alertingrules.loki.grafana.com) 2026-03-18 15:02:31,849 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=lokistacks.loki.grafana.com) 2026-03-18 15:02:31,851 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=recordingrules.loki.grafana.com) 2026-03-18 15:02:31,853 p=37566 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=rulerconfigs.loki.grafana.com) 2026-03-18 15:02:31,860 p=37566 u=zuul n=ansible | TASK [common : Verify CRD "alertingrules.loki.grafana.com"] ******************** 2026-03-18 15:02:31,860 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:31 +0000 (0:00:00.055) 0:01:49.468 ******* 2026-03-18 15:02:32,361 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:32,366 p=37566 u=zuul n=ansible | TASK [common : TEST Verify CRD alertingrules.loki.grafana.com is found] ******** 2026-03-18 15:02:32,366 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:32 +0000 (0:00:00.506) 0:01:49.974 ******* 2026-03-18 15:02:32,382 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD alertingrules.loki.grafana.com is found." } 2026-03-18 15:02:32,388 p=37566 u=zuul n=ansible | TASK [common : Verify CRD "lokistacks.loki.grafana.com"] *********************** 2026-03-18 15:02:32,388 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:32 +0000 (0:00:00.021) 0:01:49.996 ******* 2026-03-18 15:02:32,936 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:32,941 p=37566 u=zuul n=ansible | TASK [common : TEST Verify CRD lokistacks.loki.grafana.com is found] *********** 2026-03-18 15:02:32,941 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:32 +0000 (0:00:00.553) 0:01:50.549 ******* 2026-03-18 15:02:32,959 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD lokistacks.loki.grafana.com is found." } 2026-03-18 15:02:32,965 p=37566 u=zuul n=ansible | TASK [common : Verify CRD "recordingrules.loki.grafana.com"] ******************* 2026-03-18 15:02:32,965 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:32 +0000 (0:00:00.023) 0:01:50.573 ******* 2026-03-18 15:02:33,536 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:33,541 p=37566 u=zuul n=ansible | TASK [common : TEST Verify CRD recordingrules.loki.grafana.com is found] ******* 2026-03-18 15:02:33,541 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:33 +0000 (0:00:00.575) 0:01:51.149 ******* 2026-03-18 15:02:33,563 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD recordingrules.loki.grafana.com is found." } 2026-03-18 15:02:33,567 p=37566 u=zuul n=ansible | TASK [common : Verify CRD "rulerconfigs.loki.grafana.com"] ********************* 2026-03-18 15:02:33,567 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:33 +0000 (0:00:00.025) 0:01:51.175 ******* 2026-03-18 15:02:34,134 p=37566 u=zuul n=ansible | ok: [controller] 2026-03-18 15:02:34,139 p=37566 u=zuul n=ansible | TASK [common : TEST Verify CRD rulerconfigs.loki.grafana.com is found] ********* 2026-03-18 15:02:34,139 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:34 +0000 (0:00:00.572) 0:01:51.747 ******* 2026-03-18 15:02:34,163 p=37566 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD rulerconfigs.loki.grafana.com is found." } 2026-03-18 15:02:34,166 p=37566 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 15:02:34,166 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:34 +0000 (0:00:00.027) 0:01:51.774 ******* 2026-03-18 15:02:34,184 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:34,187 p=37566 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 15:02:34,187 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:34 +0000 (0:00:00.021) 0:01:51.795 ******* 2026-03-18 15:02:34,207 p=37566 u=zuul n=ansible | skipping: [controller] 2026-03-18 15:02:34,217 p=37566 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-18 15:02:34,218 p=37566 u=zuul n=ansible | compute-0 : ok=19 changed=0 unreachable=0 failed=0 skipped=24 rescued=0 ignored=0 2026-03-18 15:02:34,218 p=37566 u=zuul n=ansible | controller : ok=219 changed=0 unreachable=0 failed=0 skipped=63 rescued=0 ignored=0 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | Wednesday 18 March 2026 15:02:34 +0000 (0:00:00.086) 0:01:51.882 ******* 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | =============================================================================== 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'public']" ----------- 3.29s 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'internal']" -------------- 3.22s 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'internal']" --------- 3.04s 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'public']" ---------------- 3.03s 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'public']" ---------- 2.93s 2026-03-18 15:02:34,274 p=37566 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'internal']" -------------- 2.87s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'public']" -------- 2.86s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'public']" ------------- 2.82s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'public']" ----------- 2.81s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'internal']" --------- 2.78s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'public']" --------- 2.77s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'internal']" ----------- 2.75s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'internal']" -------- 2.71s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'internal']" ------- 2.71s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'internal']" ------ 2.70s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'public']" ---------------- 2.66s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 2.29s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.26s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.00s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 1.35s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace --- 0.86s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-gossip-ring" -------------------- 0.84s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.84s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 0.83s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.79s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.77s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.76s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.74s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.73s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.73s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.72s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.71s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.70s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.68s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.67s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.67s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.67s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.66s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf" -------- 0.65s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.65s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace --- 0.65s 2026-03-18 15:02:34,275 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.64s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.64s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.63s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check minio pod is Running in minio-dev namespace -------- 0.63s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.63s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.62s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace --- 0.62s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.61s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify subscription "loki-operator" ---------------------------- 0.61s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.61s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.60s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.60s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.59s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get the openshift project -------------------------------------- 0.59s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check collector pod is Running in openshift-logging namespace --- 0.59s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get the openshift-openstack-infra project ---------------------- 0.59s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.59s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-grpc" ------------ 0.59s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace --- 0.58s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-http" ------------ 0.58s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-gateway-http" ------------------- 0.58s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify CRD "recordingrules.loki.grafana.com" ------------------- 0.58s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace --- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-http" --------------- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify CRD "rulerconfigs.loki.grafana.com" --------------------- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify Service - "nova-internal" ------------------------------- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace --- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check openstackclient pod is Running in openstack namespace --- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify Service - "nova-metadata-internal" ---------------------- 0.57s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace --- 0.56s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Verify CRD "lokistacks.loki.grafana.com" ----------------------- 0.55s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace --- 0.55s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.55s 2026-03-18 15:02:34,276 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "nova-public" --------------------------------- 0.55s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "nova-novncproxy-cell1-public" ---------------- 0.54s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-http" ------------- 0.54s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-http" ------------------- 0.54s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "openstack-logging" --------------------------- 0.54s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-http" ----------------- 0.54s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.53s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace --- 0.53s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-grpc" --------------- 0.52s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace --- 0.52s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.51s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-grpc" ------------------ 0.51s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace --- 0.51s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify CRD "alertingrules.loki.grafana.com" -------------------- 0.51s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "cluster-logging-operator-metrics" ------------ 0.50s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.50s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-http" ------------------ 0.49s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-grpc" ------------- 0.49s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Get the openshift-logging project ------------------------------ 0.49s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-grpc" ------------------- 0.47s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-grpc" ----------------- 0.44s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.16s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.15s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.14s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.12s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 0.11s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.09s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.09s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.08s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists --- 0.08s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Verify node_exporter container status -------------------- 0.08s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : TEST Get loki-operator 2 packagemanifest ---------------------- 0.07s 2026-03-18 15:02:34,277 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.07s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.07s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | telemetry_logging : Verify journal entries ------------------------------ 0.06s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 0.06s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.06s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.06s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.06s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Verify ceilometer_agent_compute container status --------- 0.05s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.05s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.05s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Check that barbican internal endpoint exists ------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Check that glance internal endpoint exists --------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Check that neutron public endpoint exists ---------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.04s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Check that glance public endpoint exists ----------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Check that cinderv3 internal endpoint exists ------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Check that barbican public endpoint exists --------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Check that keystone public endpoint exists --------------- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : TEST Verify nova-metadata-internal service is running in openstack namespace --- 0.03s 2026-03-18 15:02:34,278 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Check that neutron internal endpoint exists -------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Check that placement internal endpoint exists ------------ 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify CRD rulerconfigs.loki.grafana.com is found -------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify nova-internal service is running in openstack namespace --- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Check that swift public endpoint exists ------------------ 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify openshift-openstack-infra project exists ---------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify CRD recordingrules.loki.grafana.com is found ------ 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Check that swift internal endpoint exists ---------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Check that keystone internal endpoint exists ------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : TEST Check that placement public endpoint exists -------------- 0.02s 2026-03-18 15:02:34,279 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Check that nova internal endpoint exists ----------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify CRD lokistacks.loki.grafana.com is found ---------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Check that nova public endpoint exists ------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Check that cinderv3 public endpoint exists --------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify openstack-logging service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify CRD alertingrules.loki.grafana.com is found ------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : TEST Verify nova-public service is running in openstack namespace --- 0.02s 2026-03-18 15:02:34,280 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : TEST Verify openshift project exists -------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : TEST Verify openshift-logging project exists ------------------ 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace --- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 15:02:34,281 p=37566 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s