2026-03-18 13:56:17,896 p=37483 u=zuul n=ansible | [WARNING]: Found variable using reserved name: namespace 2026-03-18 13:56:17,897 p=37483 u=zuul n=ansible | PLAY [Verify logging journalctl identifiers] *********************************** 2026-03-18 13:56:17,906 p=37483 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-18 13:56:17,906 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:17 +0000 (0:00:00.012) 0:00:00.012 ******* 2026-03-18 13:56:20,155 p=37483 u=zuul n=ansible | ok: [compute-0] 2026-03-18 13:56:20,178 p=37483 u=zuul n=ansible | TASK [telemetry_logging : Verify journal entries] ****************************** 2026-03-18 13:56:20,179 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:20 +0000 (0:00:02.272) 0:00:02.285 ******* 2026-03-18 13:56:20,215 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-18 13:56:20,217 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/telemetry_logging/tasks/journal_tests.yml for compute-0 => (item=nova_compute) 2026-03-18 13:56:20,229 p=37483 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-18 13:56:20,229 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:20 +0000 (0:00:00.050) 0:00:02.335 ******* 2026-03-18 13:56:21,225 p=37483 u=zuul n=ansible | ok: [compute-0] 2026-03-18 13:56:21,236 p=37483 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX] *** 2026-03-18 13:56:21,236 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:21 +0000 (0:00:01.007) 0:00:03.342 ******* 2026-03-18 13:56:21,277 p=37483 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-18 13:56:21,286 p=37483 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-18 13:56:21,286 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:21 +0000 (0:00:00.050) 0:00:03.393 ******* 2026-03-18 13:56:24,012 p=37483 u=zuul n=ansible | ok: [compute-0] 2026-03-18 13:56:24,068 p=37483 u=zuul n=ansible | TASK [telemetry_logging : TEST Get journals nova_compute RHOSO-XXX] ************* 2026-03-18 13:56:24,068 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:02.781) 0:00:06.175 ******* 2026-03-18 13:56:24,154 p=37483 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed!" } 2026-03-18 13:56:24,169 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:56:24,169 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:00.100) 0:00:06.275 ******* 2026-03-18 13:56:24,186 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:24,194 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:56:24,194 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:00.024) 0:00:06.300 ******* 2026-03-18 13:56:24,214 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:24,221 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:56:24,221 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:00.026) 0:00:06.327 ******* 2026-03-18 13:56:24,239 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:24,247 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:56:24,248 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:00.026) 0:00:06.354 ******* 2026-03-18 13:56:24,266 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:24,274 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:56:24,274 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:00.026) 0:00:06.380 ******* 2026-03-18 13:56:24,291 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:24,298 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:56:24,298 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:00.024) 0:00:06.405 ******* 2026-03-18 13:56:24,328 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/file_tests.yml for compute-0 => (item=/etc/rsyslog.d/10-telemetry.conf) 2026-03-18 13:56:24,339 p=37483 u=zuul n=ansible | TASK [common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf"] ******** 2026-03-18 13:56:24,340 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:24 +0000 (0:00:00.041) 0:00:06.446 ******* 2026-03-18 13:56:25,042 p=37483 u=zuul n=ansible | ok: [compute-0] 2026-03-18 13:56:25,051 p=37483 u=zuul n=ansible | TASK [common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists] *** 2026-03-18 13:56:25,051 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:25 +0000 (0:00:00.711) 0:00:07.157 ******* 2026-03-18 13:56:25,090 p=37483 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "The test passed" } 2026-03-18 13:56:25,098 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:56:25,098 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:25 +0000 (0:00:00.047) 0:00:07.205 ******* 2026-03-18 13:56:25,114 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:25,122 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:56:25,122 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:25 +0000 (0:00:00.023) 0:00:07.228 ******* 2026-03-18 13:56:25,139 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:25,146 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:56:25,146 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:25 +0000 (0:00:00.024) 0:00:07.253 ******* 2026-03-18 13:56:25,165 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:25,172 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:56:25,172 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:25 +0000 (0:00:00.026) 0:00:07.279 ******* 2026-03-18 13:56:25,189 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:25,197 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:56:25,197 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:25 +0000 (0:00:00.024) 0:00:07.303 ******* 2026-03-18 13:56:25,213 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:25,245 p=37483 u=zuul n=ansible | PLAY [Run container tests which require root on compute nodes] ***************** 2026-03-18 13:56:25,253 p=37483 u=zuul n=ansible | TASK [Gathering Facts] ********************************************************* 2026-03-18 13:56:25,253 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:25 +0000 (0:00:00.055) 0:00:07.359 ******* 2026-03-18 13:56:27,204 p=37483 u=zuul n=ansible | ok: [compute-0] 2026-03-18 13:56:27,227 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:56:27,227 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:01.973) 0:00:09.333 ******* 2026-03-18 13:56:27,247 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,254 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:56:27,255 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.027) 0:00:09.361 ******* 2026-03-18 13:56:27,275 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,282 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:56:27,282 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.027) 0:00:09.388 ******* 2026-03-18 13:56:27,300 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,311 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:56:27,312 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.029) 0:00:09.418 ******* 2026-03-18 13:56:27,330 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,338 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:56:27,338 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.026) 0:00:09.445 ******* 2026-03-18 13:56:27,355 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,364 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:56:27,364 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.025) 0:00:09.470 ******* 2026-03-18 13:56:27,389 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,396 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:56:27,396 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.032) 0:00:09.502 ******* 2026-03-18 13:56:27,416 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,423 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:56:27,423 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.027) 0:00:09.529 ******* 2026-03-18 13:56:27,444 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,452 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:56:27,452 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.028) 0:00:09.558 ******* 2026-03-18 13:56:27,472 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,481 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:56:27,481 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.029) 0:00:09.588 ******* 2026-03-18 13:56:27,503 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:27,510 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:56:27,510 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.028) 0:00:09.616 ******* 2026-03-18 13:56:27,555 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=ceilometer_agent_compute) 2026-03-18 13:56:27,559 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/container_test.yml for compute-0 => (item=node_exporter) 2026-03-18 13:56:27,568 p=37483 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-18 13:56:27,568 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:27 +0000 (0:00:00.058) 0:00:09.675 ******* 2026-03-18 13:56:28,330 p=37483 u=zuul n=ansible | ok: [compute-0] 2026-03-18 13:56:28,339 p=37483 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-18 13:56:28,339 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:28 +0000 (0:00:00.770) 0:00:10.445 ******* 2026-03-18 13:56:28,355 p=37483 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "ceilometer_agent_compute Up 4 minutes (healthy)" } 2026-03-18 13:56:28,363 p=37483 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-18 13:56:28,363 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:28 +0000 (0:00:00.024) 0:00:10.470 ******* 2026-03-18 13:56:28,388 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:28,396 p=37483 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-18 13:56:28,396 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:28 +0000 (0:00:00.032) 0:00:10.502 ******* 2026-03-18 13:56:28,419 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:28,428 p=37483 u=zuul n=ansible | TASK [common : TEST Verify ceilometer_agent_compute container status] ********** 2026-03-18 13:56:28,428 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:28 +0000 (0:00:00.032) 0:00:10.534 ******* 2026-03-18 13:56:28,462 p=37483 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'ceilometer_agent_compute' is in 'healthy' status." } 2026-03-18 13:56:28,470 p=37483 u=zuul n=ansible | TASK [common : Get container status] ******************************************* 2026-03-18 13:56:28,470 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:28 +0000 (0:00:00.042) 0:00:10.577 ******* 2026-03-18 13:56:29,273 p=37483 u=zuul n=ansible | ok: [compute-0] 2026-03-18 13:56:29,280 p=37483 u=zuul n=ansible | TASK [common : Show the container name and status] ***************************** 2026-03-18 13:56:29,280 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:29 +0000 (0:00:00.809) 0:00:11.386 ******* 2026-03-18 13:56:29,296 p=37483 u=zuul n=ansible | ok: [compute-0] => { "container_status.stdout": "node_exporter Up 4 minutes (healthy)" } 2026-03-18 13:56:29,304 p=37483 u=zuul n=ansible | TASK [common : Show the containers] ******************************************** 2026-03-18 13:56:29,304 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:29 +0000 (0:00:00.023) 0:00:11.410 ******* 2026-03-18 13:56:29,330 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:29,338 p=37483 u=zuul n=ansible | TASK [common : Show the output of container list] ****************************** 2026-03-18 13:56:29,338 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:29 +0000 (0:00:00.033) 0:00:11.444 ******* 2026-03-18 13:56:29,363 p=37483 u=zuul n=ansible | skipping: [compute-0] 2026-03-18 13:56:29,371 p=37483 u=zuul n=ansible | TASK [common : TEST Verify node_exporter container status] ********************* 2026-03-18 13:56:29,372 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:29 +0000 (0:00:00.033) 0:00:11.478 ******* 2026-03-18 13:56:29,405 p=37483 u=zuul n=ansible | ok: [compute-0] => { "changed": false, "msg": "Container 'node_exporter' is in 'healthy' status." } 2026-03-18 13:56:29,444 p=37483 u=zuul n=ansible | PLAY [Verify logging projects, endpoints, credentials, nodes, pods, services, manifests and subscriptions] *** 2026-03-18 13:56:29,454 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:56:29,454 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:29 +0000 (0:00:00.082) 0:00:11.560 ******* 2026-03-18 13:56:29,489 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-operator-controller-manager) 2026-03-18 13:56:29,491 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstack-operator-controller-manager) 2026-03-18 13:56:29,498 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:56:29,498 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:29 +0000 (0:00:00.043) 0:00:11.604 ******* 2026-03-18 13:56:30,388 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:30,395 p=37483 u=zuul n=ansible | TASK [common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-18 13:56:30,395 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:30 +0000 (0:00:00.897) 0:00:12.501 ******* 2026-03-18 13:56:30,916 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:30,922 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:56:30,922 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:30 +0000 (0:00:00.526) 0:00:13.028 ******* 2026-03-18 13:56:32,689 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:32,695 p=37483 u=zuul n=ansible | TASK [common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace] *** 2026-03-18 13:56:32,695 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:32 +0000 (0:00:01.772) 0:00:14.801 ******* 2026-03-18 13:56:33,281 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:33,286 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:56:33,287 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:33 +0000 (0:00:00.591) 0:00:15.393 ******* 2026-03-18 13:56:33,322 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/subscription_tests.yml for controller => (item=loki-operator) 2026-03-18 13:56:33,334 p=37483 u=zuul n=ansible | TASK [common : Verify subscription "loki-operator"] **************************** 2026-03-18 13:56:33,334 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:33 +0000 (0:00:00.047) 0:00:15.441 ******* 2026-03-18 13:56:33,930 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:33,937 p=37483 u=zuul n=ansible | TASK [common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace] *** 2026-03-18 13:56:33,937 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:33 +0000 (0:00:00.602) 0:00:16.044 ******* 2026-03-18 13:56:33,958 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "subscription loki-operator is found." } 2026-03-18 13:56:33,964 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:56:33,964 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:33 +0000 (0:00:00.026) 0:00:16.070 ******* 2026-03-18 13:56:34,064 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'public']) 2026-03-18 13:56:34,066 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['nova', 'compute', 'internal']) 2026-03-18 13:56:34,068 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'public']) 2026-03-18 13:56:34,070 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['placement', 'placement', 'internal']) 2026-03-18 13:56:34,071 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'public']) 2026-03-18 13:56:34,073 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['swift', 'object-store', 'internal']) 2026-03-18 13:56:34,075 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'public']) 2026-03-18 13:56:34,077 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['cinderv3', 'volumev3', 'internal']) 2026-03-18 13:56:34,079 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'public']) 2026-03-18 13:56:34,080 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['barbican', 'key-manager', 'internal']) 2026-03-18 13:56:34,082 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'public']) 2026-03-18 13:56:34,084 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['keystone', 'identity', 'internal']) 2026-03-18 13:56:34,085 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'public']) 2026-03-18 13:56:34,087 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['glance', 'image', 'internal']) 2026-03-18 13:56:34,089 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'public']) 2026-03-18 13:56:34,091 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/endpoint_tests.yml for controller => (item=['neutron', 'network', 'internal']) 2026-03-18 13:56:34,102 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'public']"] **************** 2026-03-18 13:56:34,102 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:34 +0000 (0:00:00.138) 0:00:16.208 ******* 2026-03-18 13:56:36,825 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:36,832 p=37483 u=zuul n=ansible | TASK [common : TEST Check that nova public endpoint exists] ******************** 2026-03-18 13:56:36,832 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:36 +0000 (0:00:02.729) 0:00:18.938 ******* 2026-03-18 13:56:36,859 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-18 13:56:36,866 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['nova', 'compute', 'internal']"] ************** 2026-03-18 13:56:36,867 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:36 +0000 (0:00:00.034) 0:00:18.973 ******* 2026-03-18 13:56:39,877 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:39,885 p=37483 u=zuul n=ansible | TASK [common : TEST Check that nova internal endpoint exists] ****************** 2026-03-18 13:56:39,885 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:39 +0000 (0:00:03.018) 0:00:21.992 ******* 2026-03-18 13:56:39,915 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint nova is found." } 2026-03-18 13:56:39,921 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'public']"] ********* 2026-03-18 13:56:39,921 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:39 +0000 (0:00:00.036) 0:00:22.028 ******* 2026-03-18 13:56:42,814 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:42,820 p=37483 u=zuul n=ansible | TASK [common : TEST Check that placement public endpoint exists] *************** 2026-03-18 13:56:42,821 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:42 +0000 (0:00:02.899) 0:00:24.927 ******* 2026-03-18 13:56:42,841 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-18 13:56:42,846 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['placement', 'placement', 'internal']"] ******* 2026-03-18 13:56:42,846 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:42 +0000 (0:00:00.025) 0:00:24.953 ******* 2026-03-18 13:56:45,750 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:45,757 p=37483 u=zuul n=ansible | TASK [common : TEST Check that placement internal endpoint exists] ************* 2026-03-18 13:56:45,757 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:45 +0000 (0:00:02.910) 0:00:27.863 ******* 2026-03-18 13:56:45,777 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint placement is found." } 2026-03-18 13:56:45,783 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'public']"] ********** 2026-03-18 13:56:45,783 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:45 +0000 (0:00:00.025) 0:00:27.889 ******* 2026-03-18 13:56:48,536 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:48,543 p=37483 u=zuul n=ansible | TASK [common : TEST Check that swift public endpoint exists] ******************* 2026-03-18 13:56:48,543 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:48 +0000 (0:00:02.760) 0:00:30.650 ******* 2026-03-18 13:56:48,567 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-18 13:56:48,573 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['swift', 'object-store', 'internal']"] ******** 2026-03-18 13:56:48,573 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:48 +0000 (0:00:00.029) 0:00:30.679 ******* 2026-03-18 13:56:51,350 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:51,356 p=37483 u=zuul n=ansible | TASK [common : TEST Check that swift internal endpoint exists] ***************** 2026-03-18 13:56:51,356 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:51 +0000 (0:00:02.783) 0:00:33.463 ******* 2026-03-18 13:56:51,376 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint swift is found." } 2026-03-18 13:56:51,382 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'public']"] *********** 2026-03-18 13:56:51,382 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:51 +0000 (0:00:00.025) 0:00:33.488 ******* 2026-03-18 13:56:54,127 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:54,136 p=37483 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 public endpoint exists] **************** 2026-03-18 13:56:54,136 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:54 +0000 (0:00:02.754) 0:00:36.242 ******* 2026-03-18 13:56:54,158 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-18 13:56:54,164 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['cinderv3', 'volumev3', 'internal']"] ********* 2026-03-18 13:56:54,164 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:54 +0000 (0:00:00.028) 0:00:36.271 ******* 2026-03-18 13:56:56,774 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:56,782 p=37483 u=zuul n=ansible | TASK [common : TEST Check that cinderv3 internal endpoint exists] ************** 2026-03-18 13:56:56,782 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:56 +0000 (0:00:02.617) 0:00:38.889 ******* 2026-03-18 13:56:56,803 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint cinderv3 is found." } 2026-03-18 13:56:56,808 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'public']"] ******** 2026-03-18 13:56:56,809 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:56 +0000 (0:00:00.026) 0:00:38.915 ******* 2026-03-18 13:56:59,600 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:56:59,607 p=37483 u=zuul n=ansible | TASK [common : TEST Check that barbican public endpoint exists] **************** 2026-03-18 13:56:59,608 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:59 +0000 (0:00:02.798) 0:00:41.714 ******* 2026-03-18 13:56:59,636 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-18 13:56:59,643 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['barbican', 'key-manager', 'internal']"] ****** 2026-03-18 13:56:59,643 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:56:59 +0000 (0:00:00.035) 0:00:41.749 ******* 2026-03-18 13:57:02,508 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:02,514 p=37483 u=zuul n=ansible | TASK [common : TEST Check that barbican internal endpoint exists] ************** 2026-03-18 13:57:02,514 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:02 +0000 (0:00:02.871) 0:00:44.620 ******* 2026-03-18 13:57:02,539 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint barbican is found." } 2026-03-18 13:57:02,544 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'public']"] *********** 2026-03-18 13:57:02,544 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:02 +0000 (0:00:00.030) 0:00:44.651 ******* 2026-03-18 13:57:05,317 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:05,323 p=37483 u=zuul n=ansible | TASK [common : TEST Check that keystone public endpoint exists] **************** 2026-03-18 13:57:05,324 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:05 +0000 (0:00:02.779) 0:00:47.430 ******* 2026-03-18 13:57:05,347 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-18 13:57:05,353 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['keystone', 'identity', 'internal']"] ********* 2026-03-18 13:57:05,353 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:05 +0000 (0:00:00.029) 0:00:47.460 ******* 2026-03-18 13:57:08,291 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:08,298 p=37483 u=zuul n=ansible | TASK [common : TEST Check that keystone internal endpoint exists] ************** 2026-03-18 13:57:08,298 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:08 +0000 (0:00:02.944) 0:00:50.404 ******* 2026-03-18 13:57:08,320 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint keystone is found." } 2026-03-18 13:57:08,326 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'public']"] **************** 2026-03-18 13:57:08,326 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:08 +0000 (0:00:00.028) 0:00:50.432 ******* 2026-03-18 13:57:11,248 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:11,258 p=37483 u=zuul n=ansible | TASK [common : TEST Check that glance public endpoint exists] ****************** 2026-03-18 13:57:11,259 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:11 +0000 (0:00:02.932) 0:00:53.365 ******* 2026-03-18 13:57:11,295 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-18 13:57:11,303 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['glance', 'image', 'internal']"] ************** 2026-03-18 13:57:11,304 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:11 +0000 (0:00:00.045) 0:00:53.410 ******* 2026-03-18 13:57:14,177 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:14,186 p=37483 u=zuul n=ansible | TASK [common : TEST Check that glance internal endpoint exists] **************** 2026-03-18 13:57:14,186 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:14 +0000 (0:00:02.882) 0:00:56.292 ******* 2026-03-18 13:57:14,219 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint glance is found." } 2026-03-18 13:57:14,225 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'public']"] ************* 2026-03-18 13:57:14,225 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:14 +0000 (0:00:00.039) 0:00:56.332 ******* 2026-03-18 13:57:17,217 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:17,225 p=37483 u=zuul n=ansible | TASK [common : TEST Check that neutron public endpoint exists] ***************** 2026-03-18 13:57:17,225 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:17 +0000 (0:00:02.999) 0:00:59.331 ******* 2026-03-18 13:57:17,248 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-18 13:57:17,254 p=37483 u=zuul n=ansible | TASK [common : Verify endpoint "['neutron', 'network', 'internal']"] *********** 2026-03-18 13:57:17,255 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:17 +0000 (0:00:00.029) 0:00:59.361 ******* 2026-03-18 13:57:20,205 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:20,213 p=37483 u=zuul n=ansible | TASK [common : TEST Check that neutron internal endpoint exists] *************** 2026-03-18 13:57:20,214 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:20 +0000 (0:00:02.958) 0:01:02.320 ******* 2026-03-18 13:57:20,235 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "The endpoint neutron is found." } 2026-03-18 13:57:20,240 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:57:20,240 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:20 +0000 (0:00:00.026) 0:01:02.346 ******* 2026-03-18 13:57:20,281 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-openstack-infra) 2026-03-18 13:57:20,283 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift) 2026-03-18 13:57:20,285 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openstack-operators) 2026-03-18 13:57:20,287 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/project_tests.yml for controller => (item=openshift-logging) 2026-03-18 13:57:20,315 p=37483 u=zuul n=ansible | TASK [common : Get the openshift-openstack-infra project] ********************** 2026-03-18 13:57:20,315 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:20 +0000 (0:00:00.075) 0:01:02.422 ******* 2026-03-18 13:57:20,901 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:20,907 p=37483 u=zuul n=ansible | TASK [common : TEST Verify openshift-openstack-infra project exists] *********** 2026-03-18 13:57:20,907 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:20 +0000 (0:00:00.591) 0:01:03.013 ******* 2026-03-18 13:57:20,930 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-openstack-infra is found." } 2026-03-18 13:57:20,936 p=37483 u=zuul n=ansible | TASK [common : Get the openshift project] ************************************** 2026-03-18 13:57:20,936 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:20 +0000 (0:00:00.029) 0:01:03.043 ******* 2026-03-18 13:57:21,528 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:21,536 p=37483 u=zuul n=ansible | TASK [common : TEST Verify openshift project exists] *************************** 2026-03-18 13:57:21,536 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:21 +0000 (0:00:00.599) 0:01:03.642 ******* 2026-03-18 13:57:21,558 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift is found." } 2026-03-18 13:57:21,564 p=37483 u=zuul n=ansible | TASK [common : Get the openstack-operators project] **************************** 2026-03-18 13:57:21,565 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:21 +0000 (0:00:00.029) 0:01:03.671 ******* 2026-03-18 13:57:22,120 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:22,125 p=37483 u=zuul n=ansible | TASK [common : TEST Verify openstack-operators project exists] ***************** 2026-03-18 13:57:22,126 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:22 +0000 (0:00:00.560) 0:01:04.232 ******* 2026-03-18 13:57:22,144 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openstack-operators is found." } 2026-03-18 13:57:22,149 p=37483 u=zuul n=ansible | TASK [common : Get the openshift-logging project] ****************************** 2026-03-18 13:57:22,149 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:22 +0000 (0:00:00.023) 0:01:04.255 ******* 2026-03-18 13:57:22,746 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:22,753 p=37483 u=zuul n=ansible | TASK [common : TEST Verify openshift-logging project exists] ******************* 2026-03-18 13:57:22,753 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:22 +0000 (0:00:00.603) 0:01:04.859 ******* 2026-03-18 13:57:22,780 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "project openshift-logging is found." } 2026-03-18 13:57:22,785 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:57:22,785 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:22 +0000 (0:00:00.031) 0:01:04.891 ******* 2026-03-18 13:57:22,890 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=cluster-logging-operator-metrics) 2026-03-18 13:57:22,892 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-grpc) 2026-03-18 13:57:22,894 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-compactor-http) 2026-03-18 13:57:22,896 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-grpc) 2026-03-18 13:57:22,898 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-distributor-http) 2026-03-18 13:57:22,900 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gateway-http) 2026-03-18 13:57:22,901 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-gossip-ring) 2026-03-18 13:57:22,903 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-grpc) 2026-03-18 13:57:22,905 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-index-gateway-http) 2026-03-18 13:57:22,906 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-grpc) 2026-03-18 13:57:22,908 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-ingester-http) 2026-03-18 13:57:22,910 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-grpc) 2026-03-18 13:57:22,911 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-querier-http) 2026-03-18 13:57:22,913 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-grpc) 2026-03-18 13:57:22,915 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=logging-loki-query-frontend-http) 2026-03-18 13:57:22,918 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=openstack-logging) 2026-03-18 13:57:22,948 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "cluster-logging-operator-metrics"] ************ 2026-03-18 13:57:22,948 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:22 +0000 (0:00:00.163) 0:01:05.054 ******* 2026-03-18 13:57:23,469 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:23,476 p=37483 u=zuul n=ansible | TASK [common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace] *** 2026-03-18 13:57:23,476 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:23 +0000 (0:00:00.527) 0:01:05.582 ******* 2026-03-18 13:57:23,494 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service cluster-logging-operator-metrics is running." } 2026-03-18 13:57:23,500 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-grpc"] ***************** 2026-03-18 13:57:23,500 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:23 +0000 (0:00:00.024) 0:01:05.606 ******* 2026-03-18 13:57:24,026 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:24,033 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace] *** 2026-03-18 13:57:24,033 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:24 +0000 (0:00:00.533) 0:01:06.140 ******* 2026-03-18 13:57:24,053 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-grpc is running." } 2026-03-18 13:57:24,060 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-compactor-http"] ***************** 2026-03-18 13:57:24,060 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:24 +0000 (0:00:00.026) 0:01:06.167 ******* 2026-03-18 13:57:24,571 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:24,577 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace] *** 2026-03-18 13:57:24,577 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:24 +0000 (0:00:00.517) 0:01:06.684 ******* 2026-03-18 13:57:24,596 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-compactor-http is running." } 2026-03-18 13:57:24,602 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-grpc"] *************** 2026-03-18 13:57:24,602 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:24 +0000 (0:00:00.024) 0:01:06.709 ******* 2026-03-18 13:57:25,167 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:25,175 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace] *** 2026-03-18 13:57:25,175 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:25 +0000 (0:00:00.572) 0:01:07.281 ******* 2026-03-18 13:57:25,197 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-grpc is running." } 2026-03-18 13:57:25,202 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-distributor-http"] *************** 2026-03-18 13:57:25,203 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:25 +0000 (0:00:00.027) 0:01:07.309 ******* 2026-03-18 13:57:25,819 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:25,826 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace] *** 2026-03-18 13:57:25,827 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:25 +0000 (0:00:00.624) 0:01:07.933 ******* 2026-03-18 13:57:25,851 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-distributor-http is running." } 2026-03-18 13:57:25,856 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gateway-http"] ******************* 2026-03-18 13:57:25,856 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:25 +0000 (0:00:00.029) 0:01:07.962 ******* 2026-03-18 13:57:26,374 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:26,381 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace] *** 2026-03-18 13:57:26,381 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:26 +0000 (0:00:00.525) 0:01:08.488 ******* 2026-03-18 13:57:26,402 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gateway-http is running." } 2026-03-18 13:57:26,407 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-gossip-ring"] ******************** 2026-03-18 13:57:26,408 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:26 +0000 (0:00:00.026) 0:01:08.514 ******* 2026-03-18 13:57:26,955 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:26,961 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace] *** 2026-03-18 13:57:26,961 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:26 +0000 (0:00:00.553) 0:01:09.067 ******* 2026-03-18 13:57:26,980 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-gossip-ring is running." } 2026-03-18 13:57:26,985 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-grpc"] ************* 2026-03-18 13:57:26,985 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:26 +0000 (0:00:00.024) 0:01:09.092 ******* 2026-03-18 13:57:28,157 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:28,164 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace] *** 2026-03-18 13:57:28,164 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:28 +0000 (0:00:01.178) 0:01:10.271 ******* 2026-03-18 13:57:28,185 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-grpc is running." } 2026-03-18 13:57:28,190 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-index-gateway-http"] ************* 2026-03-18 13:57:28,190 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:28 +0000 (0:00:00.026) 0:01:10.297 ******* 2026-03-18 13:57:28,761 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:28,767 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace] *** 2026-03-18 13:57:28,768 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:28 +0000 (0:00:00.577) 0:01:10.874 ******* 2026-03-18 13:57:28,795 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-index-gateway-http is running." } 2026-03-18 13:57:28,801 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-grpc"] ****************** 2026-03-18 13:57:28,801 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:28 +0000 (0:00:00.033) 0:01:10.907 ******* 2026-03-18 13:57:29,398 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:29,405 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace] *** 2026-03-18 13:57:29,406 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:29 +0000 (0:00:00.604) 0:01:11.512 ******* 2026-03-18 13:57:29,429 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-grpc is running." } 2026-03-18 13:57:29,436 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-ingester-http"] ****************** 2026-03-18 13:57:29,436 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:29 +0000 (0:00:00.030) 0:01:11.543 ******* 2026-03-18 13:57:29,992 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:29,998 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace] *** 2026-03-18 13:57:29,998 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:29 +0000 (0:00:00.561) 0:01:12.104 ******* 2026-03-18 13:57:30,019 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-ingester-http is running." } 2026-03-18 13:57:30,025 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-grpc"] ******************* 2026-03-18 13:57:30,025 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:30 +0000 (0:00:00.026) 0:01:12.131 ******* 2026-03-18 13:57:30,582 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:30,588 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace] *** 2026-03-18 13:57:30,589 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:30 +0000 (0:00:00.563) 0:01:12.695 ******* 2026-03-18 13:57:30,608 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-grpc is running." } 2026-03-18 13:57:30,613 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-querier-http"] ******************* 2026-03-18 13:57:30,614 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:30 +0000 (0:00:00.024) 0:01:12.720 ******* 2026-03-18 13:57:31,168 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:31,175 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace] *** 2026-03-18 13:57:31,175 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:31 +0000 (0:00:00.561) 0:01:13.281 ******* 2026-03-18 13:57:31,196 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-querier-http is running." } 2026-03-18 13:57:31,204 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-grpc"] ************ 2026-03-18 13:57:31,204 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:31 +0000 (0:00:00.029) 0:01:13.311 ******* 2026-03-18 13:57:31,769 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:31,775 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace] *** 2026-03-18 13:57:31,775 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:31 +0000 (0:00:00.570) 0:01:13.881 ******* 2026-03-18 13:57:31,794 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-grpc is running." } 2026-03-18 13:57:31,800 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "logging-loki-query-frontend-http"] ************ 2026-03-18 13:57:31,800 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:31 +0000 (0:00:00.025) 0:01:13.906 ******* 2026-03-18 13:57:32,348 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:32,354 p=37483 u=zuul n=ansible | TASK [common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace] *** 2026-03-18 13:57:32,355 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:32 +0000 (0:00:00.554) 0:01:14.461 ******* 2026-03-18 13:57:32,377 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service logging-loki-query-frontend-http is running." } 2026-03-18 13:57:32,383 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "openstack-logging"] *************************** 2026-03-18 13:57:32,383 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:32 +0000 (0:00:00.028) 0:01:14.489 ******* 2026-03-18 13:57:32,925 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:32,932 p=37483 u=zuul n=ansible | TASK [common : TEST Verify openstack-logging service is running in openshift-logging namespace] *** 2026-03-18 13:57:32,932 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:32 +0000 (0:00:00.549) 0:01:15.038 ******* 2026-03-18 13:57:32,954 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service openstack-logging is running." } 2026-03-18 13:57:32,958 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:57:32,959 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:32 +0000 (0:00:00.026) 0:01:15.065 ******* 2026-03-18 13:57:32,978 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:32,983 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:57:32,983 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:32 +0000 (0:00:00.024) 0:01:15.089 ******* 2026-03-18 13:57:33,690 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:33,697 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:57:33,697 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:33 +0000 (0:00:00.713) 0:01:15.803 ******* 2026-03-18 13:57:33,728 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/manifest_tests.yml for controller => (item={'name': 'loki-operator', 'expected_number': 2}) 2026-03-18 13:57:33,749 p=37483 u=zuul n=ansible | TASK [common : TEST Get loki-operator 2 packagemanifest] *********************** 2026-03-18 13:57:33,750 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:33 +0000 (0:00:00.052) 0:01:15.856 ******* 2026-03-18 13:57:33,833 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "Expected 2 and found 2\n" } 2026-03-18 13:57:33,839 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:57:33,839 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:33 +0000 (0:00:00.089) 0:01:15.946 ******* 2026-03-18 13:57:33,863 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:33,868 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:57:33,869 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:33 +0000 (0:00:00.029) 0:01:15.975 ******* 2026-03-18 13:57:33,888 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:33,893 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:57:33,894 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:33 +0000 (0:00:00.025) 0:01:16.000 ******* 2026-03-18 13:57:33,913 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:33,933 p=37483 u=zuul n=ansible | PLAY [Verify logging pods are running in openstack] **************************** 2026-03-18 13:57:33,945 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:57:33,945 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:33 +0000 (0:00:00.051) 0:01:16.051 ******* 2026-03-18 13:57:33,979 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=openstackclient) 2026-03-18 13:57:33,984 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:33,985 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:33 +0000 (0:00:00.039) 0:01:16.091 ******* 2026-03-18 13:57:34,642 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:34,648 p=37483 u=zuul n=ansible | TASK [common : TEST Check openstackclient pod is Running in openstack namespace] *** 2026-03-18 13:57:34,648 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:34 +0000 (0:00:00.663) 0:01:16.754 ******* 2026-03-18 13:57:35,283 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:35,288 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:57:35,288 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.639) 0:01:17.394 ******* 2026-03-18 13:57:35,311 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,316 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:57:35,317 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.028) 0:01:17.423 ******* 2026-03-18 13:57:35,339 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,343 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:57:35,343 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.026) 0:01:17.449 ******* 2026-03-18 13:57:35,368 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,372 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:57:35,372 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.029) 0:01:17.479 ******* 2026-03-18 13:57:35,399 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,403 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:57:35,404 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.031) 0:01:17.510 ******* 2026-03-18 13:57:35,427 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,431 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:57:35,431 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.027) 0:01:17.537 ******* 2026-03-18 13:57:35,453 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,457 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:57:35,457 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.026) 0:01:17.564 ******* 2026-03-18 13:57:35,481 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,485 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:57:35,485 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.027) 0:01:17.591 ******* 2026-03-18 13:57:35,511 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,517 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:57:35,517 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.032) 0:01:17.623 ******* 2026-03-18 13:57:35,541 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,546 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:57:35,546 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.029) 0:01:17.653 ******* 2026-03-18 13:57:35,569 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:35,584 p=37483 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-operators-redhat] *********** 2026-03-18 13:57:35,595 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:57:35,595 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.048) 0:01:17.701 ******* 2026-03-18 13:57:35,628 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=loki-operator-controller-manager) 2026-03-18 13:57:35,635 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:35,635 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:35 +0000 (0:00:00.040) 0:01:17.741 ******* 2026-03-18 13:57:36,287 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:36,292 p=37483 u=zuul n=ansible | TASK [common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace] *** 2026-03-18 13:57:36,292 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.657) 0:01:18.399 ******* 2026-03-18 13:57:36,866 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:36,870 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:57:36,870 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.577) 0:01:18.977 ******* 2026-03-18 13:57:36,886 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:36,890 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:57:36,890 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.020) 0:01:18.997 ******* 2026-03-18 13:57:36,906 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:36,911 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:57:36,911 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.020) 0:01:19.017 ******* 2026-03-18 13:57:36,926 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:36,930 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:57:36,930 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.019) 0:01:19.036 ******* 2026-03-18 13:57:36,945 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:36,948 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:57:36,948 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.018) 0:01:19.055 ******* 2026-03-18 13:57:36,965 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:36,969 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:57:36,969 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.020) 0:01:19.075 ******* 2026-03-18 13:57:36,988 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:36,993 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:57:36,993 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:36 +0000 (0:00:00.023) 0:01:19.099 ******* 2026-03-18 13:57:37,010 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:37,013 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:57:37,014 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:37 +0000 (0:00:00.020) 0:01:19.120 ******* 2026-03-18 13:57:37,030 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:37,034 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:57:37,034 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:37 +0000 (0:00:00.020) 0:01:19.140 ******* 2026-03-18 13:57:37,051 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:37,055 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:57:37,055 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:37 +0000 (0:00:00.021) 0:01:19.161 ******* 2026-03-18 13:57:37,074 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:37,087 p=37483 u=zuul n=ansible | PLAY [Verify logging pods are running in openshift-logging] ******************** 2026-03-18 13:57:37,095 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:57:37,095 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:37 +0000 (0:00:00.039) 0:01:19.201 ******* 2026-03-18 13:57:37,167 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=cluster-logging-operator) 2026-03-18 13:57:37,170 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-compactor) 2026-03-18 13:57:37,172 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-distributor) 2026-03-18 13:57:37,173 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-index-gateway) 2026-03-18 13:57:37,175 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-ingester) 2026-03-18 13:57:37,177 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-querier) 2026-03-18 13:57:37,179 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-loki-query-frontend) 2026-03-18 13:57:37,181 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=collector) 2026-03-18 13:57:37,189 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:37,189 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:37 +0000 (0:00:00.094) 0:01:19.295 ******* 2026-03-18 13:57:37,756 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:37,762 p=37483 u=zuul n=ansible | TASK [common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:37,762 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:37 +0000 (0:00:00.572) 0:01:19.868 ******* 2026-03-18 13:57:38,261 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:38,267 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:38,268 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:38 +0000 (0:00:00.505) 0:01:20.374 ******* 2026-03-18 13:57:38,807 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:38,813 p=37483 u=zuul n=ansible | TASK [common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:38,813 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:38 +0000 (0:00:00.545) 0:01:20.920 ******* 2026-03-18 13:57:39,412 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:39,417 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:39,418 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:39 +0000 (0:00:00.604) 0:01:21.524 ******* 2026-03-18 13:57:40,005 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:40,010 p=37483 u=zuul n=ansible | TASK [common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:40,010 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:40 +0000 (0:00:00.592) 0:01:22.116 ******* 2026-03-18 13:57:40,530 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:40,535 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:40,535 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:40 +0000 (0:00:00.524) 0:01:22.641 ******* 2026-03-18 13:57:41,089 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:41,096 p=37483 u=zuul n=ansible | TASK [common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:41,096 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:41 +0000 (0:00:00.561) 0:01:23.202 ******* 2026-03-18 13:57:41,651 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:41,656 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:41,657 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:41 +0000 (0:00:00.560) 0:01:23.763 ******* 2026-03-18 13:57:42,301 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:42,307 p=37483 u=zuul n=ansible | TASK [common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:42,307 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:42 +0000 (0:00:00.650) 0:01:24.413 ******* 2026-03-18 13:57:42,889 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:42,895 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:42,895 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:42 +0000 (0:00:00.588) 0:01:25.001 ******* 2026-03-18 13:57:43,515 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:43,521 p=37483 u=zuul n=ansible | TASK [common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:43,521 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:43 +0000 (0:00:00.626) 0:01:25.627 ******* 2026-03-18 13:57:44,091 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:44,096 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:44,097 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:44 +0000 (0:00:00.575) 0:01:26.203 ******* 2026-03-18 13:57:44,765 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:44,770 p=37483 u=zuul n=ansible | TASK [common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:44,771 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:44 +0000 (0:00:00.674) 0:01:26.877 ******* 2026-03-18 13:57:45,468 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:45,473 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:45,473 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:45 +0000 (0:00:00.702) 0:01:27.579 ******* 2026-03-18 13:57:46,150 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:46,157 p=37483 u=zuul n=ansible | TASK [common : TEST Check collector pod is Running in openshift-logging namespace] *** 2026-03-18 13:57:46,157 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:46 +0000 (0:00:00.683) 0:01:28.263 ******* 2026-03-18 13:57:46,909 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:46,915 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:57:46,915 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:46 +0000 (0:00:00.758) 0:01:29.021 ******* 2026-03-18 13:57:46,945 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:46,949 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:57:46,950 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:46 +0000 (0:00:00.034) 0:01:29.056 ******* 2026-03-18 13:57:46,975 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:46,981 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:57:46,981 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:46 +0000 (0:00:00.031) 0:01:29.087 ******* 2026-03-18 13:57:47,004 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,010 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:57:47,011 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.029) 0:01:29.117 ******* 2026-03-18 13:57:47,033 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,039 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:57:47,039 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.028) 0:01:29.145 ******* 2026-03-18 13:57:47,062 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,067 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:57:47,067 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.028) 0:01:29.173 ******* 2026-03-18 13:57:47,090 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,095 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:57:47,096 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.028) 0:01:29.202 ******* 2026-03-18 13:57:47,118 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,123 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:57:47,123 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.027) 0:01:29.230 ******* 2026-03-18 13:57:47,146 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,151 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:57:47,151 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.027) 0:01:29.257 ******* 2026-03-18 13:57:47,174 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,180 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:57:47,180 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.029) 0:01:29.286 ******* 2026-03-18 13:57:47,205 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:47,220 p=37483 u=zuul n=ansible | PLAY [Verify logging pods are running in minio-dev] **************************** 2026-03-18 13:57:47,228 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:57:47,229 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.048) 0:01:29.335 ******* 2026-03-18 13:57:47,264 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=minio) 2026-03-18 13:57:47,271 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Running"] ******************************** 2026-03-18 13:57:47,271 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:47 +0000 (0:00:00.042) 0:01:29.377 ******* 2026-03-18 13:57:48,009 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:48,016 p=37483 u=zuul n=ansible | TASK [common : TEST Check minio pod is Running in minio-dev namespace] ********* 2026-03-18 13:57:48,017 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.745) 0:01:30.123 ******* 2026-03-18 13:57:48,743 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:48,748 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:57:48,748 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.731) 0:01:30.855 ******* 2026-03-18 13:57:48,774 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,779 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:57:48,779 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.030) 0:01:30.885 ******* 2026-03-18 13:57:48,800 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,804 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:57:48,805 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.025) 0:01:30.911 ******* 2026-03-18 13:57:48,828 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,840 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:57:48,840 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.035) 0:01:30.947 ******* 2026-03-18 13:57:48,867 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,872 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:57:48,872 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.031) 0:01:30.978 ******* 2026-03-18 13:57:48,894 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,899 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:57:48,899 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.027) 0:01:31.005 ******* 2026-03-18 13:57:48,920 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,924 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:57:48,924 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.025) 0:01:31.031 ******* 2026-03-18 13:57:48,949 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,955 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:57:48,955 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.030) 0:01:31.061 ******* 2026-03-18 13:57:48,979 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:48,984 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:57:48,985 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:48 +0000 (0:00:00.029) 0:01:31.091 ******* 2026-03-18 13:57:49,008 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:49,014 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:57:49,014 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:49 +0000 (0:00:00.029) 0:01:31.121 ******* 2026-03-18 13:57:49,043 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:57:49,063 p=37483 u=zuul n=ansible | PLAY [Verify logging pods have complete status in openstack] ******************* 2026-03-18 13:57:49,079 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:57:49,079 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:49 +0000 (0:00:00.064) 0:01:31.185 ******* 2026-03-18 13:57:49,197 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=bootstrap-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,199 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-network-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,202 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=configure-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,204 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-certs-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,206 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=install-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,209 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=libvirt-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,212 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=logging-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,214 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=neutron-metadata-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,216 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ovn-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,218 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=reboot-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,221 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=run-os-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,224 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=ssh-known-hosts-edpm-deployment) 2026-03-18 13:57:49,227 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=telemetry-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,230 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/pod_tests.yml for controller => (item=validate-network-edpm-deployment-openstack-edpm-ipam) 2026-03-18 13:57:49,238 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:49,239 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:49 +0000 (0:00:00.159) 0:01:31.345 ******* 2026-03-18 13:57:49,819 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:49,825 p=37483 u=zuul n=ansible | TASK [common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:49,825 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:49 +0000 (0:00:00.586) 0:01:31.931 ******* 2026-03-18 13:57:50,379 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:50,387 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:50,388 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:50 +0000 (0:00:00.562) 0:01:32.494 ******* 2026-03-18 13:57:50,963 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:50,970 p=37483 u=zuul n=ansible | TASK [common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:50,970 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:50 +0000 (0:00:00.581) 0:01:33.076 ******* 2026-03-18 13:57:51,489 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:51,495 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:51,495 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:51 +0000 (0:00:00.525) 0:01:33.602 ******* 2026-03-18 13:57:52,160 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:52,166 p=37483 u=zuul n=ansible | TASK [common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:52,166 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:52 +0000 (0:00:00.670) 0:01:34.272 ******* 2026-03-18 13:57:52,682 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:52,687 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:52,687 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:52 +0000 (0:00:00.521) 0:01:34.793 ******* 2026-03-18 13:57:53,329 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:53,334 p=37483 u=zuul n=ansible | TASK [common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:53,335 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:53 +0000 (0:00:00.647) 0:01:35.441 ******* 2026-03-18 13:57:53,923 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:53,929 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:53,929 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:53 +0000 (0:00:00.594) 0:01:36.036 ******* 2026-03-18 13:57:54,595 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:54,601 p=37483 u=zuul n=ansible | TASK [common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:54,601 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:54 +0000 (0:00:00.671) 0:01:36.707 ******* 2026-03-18 13:57:55,187 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:55,191 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:55,192 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:55 +0000 (0:00:00.590) 0:01:37.298 ******* 2026-03-18 13:57:55,852 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:55,857 p=37483 u=zuul n=ansible | TASK [common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:55,858 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:55 +0000 (0:00:00.665) 0:01:37.964 ******* 2026-03-18 13:57:56,450 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:56,455 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:56,456 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:56 +0000 (0:00:00.597) 0:01:38.562 ******* 2026-03-18 13:57:57,078 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:57,084 p=37483 u=zuul n=ansible | TASK [common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:57,084 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:57 +0000 (0:00:00.628) 0:01:39.191 ******* 2026-03-18 13:57:57,619 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:57,624 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:57,624 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:57 +0000 (0:00:00.539) 0:01:39.730 ******* 2026-03-18 13:57:58,289 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:58,297 p=37483 u=zuul n=ansible | TASK [common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:58,297 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:58 +0000 (0:00:00.673) 0:01:40.403 ******* 2026-03-18 13:57:58,869 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:58,876 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:57:58,876 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:58 +0000 (0:00:00.579) 0:01:40.982 ******* 2026-03-18 13:57:59,535 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:57:59,541 p=37483 u=zuul n=ansible | TASK [common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:57:59,542 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:57:59 +0000 (0:00:00.665) 0:01:41.648 ******* 2026-03-18 13:58:00,167 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:00,173 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:58:00,173 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:00 +0000 (0:00:00.631) 0:01:42.279 ******* 2026-03-18 13:58:00,806 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:00,813 p=37483 u=zuul n=ansible | TASK [common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:58:00,813 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:00 +0000 (0:00:00.640) 0:01:42.919 ******* 2026-03-18 13:58:01,378 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:01,384 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:58:01,384 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:01 +0000 (0:00:00.571) 0:01:43.491 ******* 2026-03-18 13:58:02,104 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:02,111 p=37483 u=zuul n=ansible | TASK [common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:58:02,111 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:02 +0000 (0:00:00.727) 0:01:44.218 ******* 2026-03-18 13:58:02,777 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:02,783 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:58:02,784 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:02 +0000 (0:00:00.672) 0:01:44.890 ******* 2026-03-18 13:58:03,494 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:03,499 p=37483 u=zuul n=ansible | TASK [common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace] *** 2026-03-18 13:58:03,500 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:03 +0000 (0:00:00.715) 0:01:45.606 ******* 2026-03-18 13:58:04,035 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:04,041 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:58:04,041 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:04 +0000 (0:00:00.541) 0:01:46.147 ******* 2026-03-18 13:58:04,718 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:04,724 p=37483 u=zuul n=ansible | TASK [common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:58:04,725 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:04 +0000 (0:00:00.683) 0:01:46.831 ******* 2026-03-18 13:58:05,307 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:05,313 p=37483 u=zuul n=ansible | TASK [common : Get Pod Instance name "Completed"] ****************************** 2026-03-18 13:58:05,314 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:05 +0000 (0:00:00.589) 0:01:47.420 ******* 2026-03-18 13:58:05,928 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:05,935 p=37483 u=zuul n=ansible | TASK [common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace] *** 2026-03-18 13:58:05,935 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:05 +0000 (0:00:00.621) 0:01:48.042 ******* 2026-03-18 13:58:06,552 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:06,557 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:58:06,558 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.622) 0:01:48.664 ******* 2026-03-18 13:58:06,581 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,585 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:58:06,585 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.027) 0:01:48.692 ******* 2026-03-18 13:58:06,606 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,610 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:58:06,611 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.025) 0:01:48.717 ******* 2026-03-18 13:58:06,631 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,636 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:58:06,637 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.026) 0:01:48.743 ******* 2026-03-18 13:58:06,653 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,657 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:58:06,658 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.021) 0:01:48.764 ******* 2026-03-18 13:58:06,673 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,677 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:58:06,677 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.019) 0:01:48.784 ******* 2026-03-18 13:58:06,693 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,698 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:58:06,698 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.020) 0:01:48.804 ******* 2026-03-18 13:58:06,717 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,723 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:58:06,723 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.025) 0:01:48.830 ******* 2026-03-18 13:58:06,748 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,753 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:58:06,754 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.030) 0:01:48.860 ******* 2026-03-18 13:58:06,778 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,782 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:58:06,782 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.028) 0:01:48.888 ******* 2026-03-18 13:58:06,803 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,819 p=37483 u=zuul n=ansible | PLAY [Verify the crds exist] *************************************************** 2026-03-18 13:58:06,829 p=37483 u=zuul n=ansible | TASK [common : Run pod tests] ************************************************** 2026-03-18 13:58:06,830 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.047) 0:01:48.936 ******* 2026-03-18 13:58:06,852 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,857 p=37483 u=zuul n=ansible | TASK [common : Run subscription tests] ***************************************** 2026-03-18 13:58:06,857 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.027) 0:01:48.963 ******* 2026-03-18 13:58:06,878 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,883 p=37483 u=zuul n=ansible | TASK [common : Run endpoint tests] ********************************************* 2026-03-18 13:58:06,883 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.025) 0:01:48.989 ******* 2026-03-18 13:58:06,904 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,909 p=37483 u=zuul n=ansible | TASK [common : Run project tests] ********************************************** 2026-03-18 13:58:06,910 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.026) 0:01:49.016 ******* 2026-03-18 13:58:06,932 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:06,939 p=37483 u=zuul n=ansible | TASK [common : Run service tests] ********************************************** 2026-03-18 13:58:06,940 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.029) 0:01:49.046 ******* 2026-03-18 13:58:06,987 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-internal) 2026-03-18 13:58:06,989 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-metadata-internal) 2026-03-18 13:58:06,990 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-novncproxy-cell1-public) 2026-03-18 13:58:06,992 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/service_tests.yml for controller => (item=nova-public) 2026-03-18 13:58:06,998 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "nova-internal"] ******************************* 2026-03-18 13:58:06,998 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:06 +0000 (0:00:00.058) 0:01:49.104 ******* 2026-03-18 13:58:07,633 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:07,638 p=37483 u=zuul n=ansible | TASK [common : TEST Verify nova-internal service is running in openstack namespace] *** 2026-03-18 13:58:07,638 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:07 +0000 (0:00:00.640) 0:01:49.744 ******* 2026-03-18 13:58:07,655 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-internal is running." } 2026-03-18 13:58:07,659 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "nova-metadata-internal"] ********************** 2026-03-18 13:58:07,659 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:07 +0000 (0:00:00.021) 0:01:49.765 ******* 2026-03-18 13:58:08,199 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:08,204 p=37483 u=zuul n=ansible | TASK [common : TEST Verify nova-metadata-internal service is running in openstack namespace] *** 2026-03-18 13:58:08,204 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:08 +0000 (0:00:00.544) 0:01:50.310 ******* 2026-03-18 13:58:08,224 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-metadata-internal is running." } 2026-03-18 13:58:08,229 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "nova-novncproxy-cell1-public"] **************** 2026-03-18 13:58:08,230 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:08 +0000 (0:00:00.025) 0:01:50.336 ******* 2026-03-18 13:58:08,750 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:08,756 p=37483 u=zuul n=ansible | TASK [common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace] *** 2026-03-18 13:58:08,756 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:08 +0000 (0:00:00.526) 0:01:50.862 ******* 2026-03-18 13:58:08,776 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-novncproxy-cell1-public is running." } 2026-03-18 13:58:08,781 p=37483 u=zuul n=ansible | TASK [common : Verify Service - "nova-public"] ********************************* 2026-03-18 13:58:08,781 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:08 +0000 (0:00:00.025) 0:01:50.887 ******* 2026-03-18 13:58:09,299 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:09,304 p=37483 u=zuul n=ansible | TASK [common : TEST Verify nova-public service is running in openstack namespace] *** 2026-03-18 13:58:09,304 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:09 +0000 (0:00:00.523) 0:01:51.410 ******* 2026-03-18 13:58:09,325 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "service nova-public is running." } 2026-03-18 13:58:09,329 p=37483 u=zuul n=ansible | TASK [common : Run file tests] ************************************************* 2026-03-18 13:58:09,329 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:09 +0000 (0:00:00.025) 0:01:51.435 ******* 2026-03-18 13:58:09,352 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:09,357 p=37483 u=zuul n=ansible | TASK [common : Get the manifest list once] ************************************* 2026-03-18 13:58:09,357 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:09 +0000 (0:00:00.028) 0:01:51.464 ******* 2026-03-18 13:58:09,376 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:09,380 p=37483 u=zuul n=ansible | TASK [common : Check that each package manifest is present] ******************** 2026-03-18 13:58:09,380 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:09 +0000 (0:00:00.022) 0:01:51.486 ******* 2026-03-18 13:58:09,398 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:09,402 p=37483 u=zuul n=ansible | TASK [common : Run crd tests] ************************************************** 2026-03-18 13:58:09,402 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:09 +0000 (0:00:00.021) 0:01:51.508 ******* 2026-03-18 13:58:09,444 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=alertingrules.loki.grafana.com) 2026-03-18 13:58:09,446 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=lokistacks.loki.grafana.com) 2026-03-18 13:58:09,447 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=recordingrules.loki.grafana.com) 2026-03-18 13:58:09,449 p=37483 u=zuul n=ansible | included: /home/zuul/src/github.com/infrawatch/feature-verification-tests/roles/common/tasks/crd_tests.yml for controller => (item=rulerconfigs.loki.grafana.com) 2026-03-18 13:58:09,455 p=37483 u=zuul n=ansible | TASK [common : Verify CRD "alertingrules.loki.grafana.com"] ******************** 2026-03-18 13:58:09,455 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:09 +0000 (0:00:00.052) 0:01:51.561 ******* 2026-03-18 13:58:09,977 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:09,982 p=37483 u=zuul n=ansible | TASK [common : TEST Verify CRD alertingrules.loki.grafana.com is found] ******** 2026-03-18 13:58:09,982 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:09 +0000 (0:00:00.527) 0:01:52.089 ******* 2026-03-18 13:58:10,005 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD alertingrules.loki.grafana.com is found." } 2026-03-18 13:58:10,011 p=37483 u=zuul n=ansible | TASK [common : Verify CRD "lokistacks.loki.grafana.com"] *********************** 2026-03-18 13:58:10,011 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:10 +0000 (0:00:00.028) 0:01:52.117 ******* 2026-03-18 13:58:10,631 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:10,636 p=37483 u=zuul n=ansible | TASK [common : TEST Verify CRD lokistacks.loki.grafana.com is found] *********** 2026-03-18 13:58:10,637 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:10 +0000 (0:00:00.625) 0:01:52.743 ******* 2026-03-18 13:58:10,661 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD lokistacks.loki.grafana.com is found." } 2026-03-18 13:58:10,666 p=37483 u=zuul n=ansible | TASK [common : Verify CRD "recordingrules.loki.grafana.com"] ******************* 2026-03-18 13:58:10,666 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:10 +0000 (0:00:00.029) 0:01:52.773 ******* 2026-03-18 13:58:11,327 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:11,332 p=37483 u=zuul n=ansible | TASK [common : TEST Verify CRD recordingrules.loki.grafana.com is found] ******* 2026-03-18 13:58:11,332 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:11 +0000 (0:00:00.665) 0:01:53.439 ******* 2026-03-18 13:58:11,356 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD recordingrules.loki.grafana.com is found." } 2026-03-18 13:58:11,362 p=37483 u=zuul n=ansible | TASK [common : Verify CRD "rulerconfigs.loki.grafana.com"] ********************* 2026-03-18 13:58:11,362 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:11 +0000 (0:00:00.029) 0:01:53.468 ******* 2026-03-18 13:58:11,930 p=37483 u=zuul n=ansible | ok: [controller] 2026-03-18 13:58:11,935 p=37483 u=zuul n=ansible | TASK [common : TEST Verify CRD rulerconfigs.loki.grafana.com is found] ********* 2026-03-18 13:58:11,935 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:11 +0000 (0:00:00.573) 0:01:54.042 ******* 2026-03-18 13:58:11,963 p=37483 u=zuul n=ansible | ok: [controller] => { "changed": false, "msg": "CRD rulerconfigs.loki.grafana.com is found." } 2026-03-18 13:58:11,967 p=37483 u=zuul n=ansible | TASK [common : Run CR tests] *************************************************** 2026-03-18 13:58:11,968 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:11 +0000 (0:00:00.032) 0:01:54.074 ******* 2026-03-18 13:58:11,987 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:11,992 p=37483 u=zuul n=ansible | TASK [common : Verify container tests] ***************************************** 2026-03-18 13:58:11,992 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:11 +0000 (0:00:00.024) 0:01:54.098 ******* 2026-03-18 13:58:12,011 p=37483 u=zuul n=ansible | skipping: [controller] 2026-03-18 13:58:12,029 p=37483 u=zuul n=ansible | PLAY RECAP ********************************************************************* 2026-03-18 13:58:12,029 p=37483 u=zuul n=ansible | compute-0 : ok=19 changed=0 unreachable=0 failed=0 skipped=24 rescued=0 ignored=0 2026-03-18 13:58:12,029 p=37483 u=zuul n=ansible | controller : ok=219 changed=0 unreachable=0 failed=0 skipped=63 rescued=0 ignored=0 2026-03-18 13:58:12,102 p=37483 u=zuul n=ansible | Wednesday 18 March 2026 13:58:12 +0000 (0:00:00.110) 0:01:54.209 ******* 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | =============================================================================== 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'internal']" -------------- 3.02s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'public']" ------------- 3.00s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['neutron', 'network', 'internal']" ----------- 2.96s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'internal']" --------- 2.94s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'public']" ---------------- 2.93s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'internal']" ------- 2.91s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['placement', 'placement', 'public']" --------- 2.90s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['glance', 'image', 'internal']" -------------- 2.88s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'internal']" ------ 2.87s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['barbican', 'key-manager', 'public']" -------- 2.80s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'internal']" -------- 2.78s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 2.78s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['keystone', 'identity', 'public']" ----------- 2.78s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['swift', 'object-store', 'public']" ---------- 2.76s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'public']" ----------- 2.75s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['nova', 'compute', 'public']" ---------------- 2.73s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify endpoint "['cinderv3', 'volumev3', 'internal']" --------- 2.62s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 2.27s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | Gathering Facts --------------------------------------------------------- 1.97s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 1.77s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-grpc" ------------- 1.18s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 1.01s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.90s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.81s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : Get container status ------------------------------------------- 0.77s 2026-03-18 13:58:12,103 p=37483 u=zuul n=ansible | common : TEST Check collector pod is Running in openshift-logging namespace --- 0.76s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.75s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check minio pod is Running in minio-dev namespace -------- 0.73s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.73s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.72s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.71s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get stats for file - "/etc/rsyslog.d/10-telemetry.conf" -------- 0.71s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check logging-loki-query-frontend pod is Running in openshift-logging namespace --- 0.70s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.68s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.68s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check run-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Verify CRD "recordingrules.loki.grafana.com" ------------------- 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.67s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.66s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.66s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.65s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.65s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.64s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Verify Service - "nova-internal" ------------------------------- 0.64s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check openstackclient pod is Running in openstack namespace --- 0.64s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check ovn-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.63s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.63s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.63s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Verify CRD "lokistacks.loki.grafana.com" ----------------------- 0.63s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-http" --------------- 0.62s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check validate-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.62s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.62s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-grpc" ------------------ 0.61s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check logging-loki-compactor pod is Running in openshift-logging namespace --- 0.60s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get the openshift-logging project ------------------------------ 0.60s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Verify subscription "loki-operator" ---------------------------- 0.60s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : Get the openshift project -------------------------------------- 0.60s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check libvirt-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.60s 2026-03-18 13:58:12,104 p=37483 u=zuul n=ansible | common : TEST Check install-certs-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check openstack-operator-controller-manager pod is Running in openstack-operators namespace --- 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get the openshift-openstack-infra project ---------------------- 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check install-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check telemetry-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check logging-loki-ingester pod is Running in openshift-logging namespace --- 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.59s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Completed" ------------------------------ 0.58s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check neutron-metadata-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.58s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check loki-operator-controller-manager pod is Running in openshift-operators-redhat namespace --- 0.58s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-index-gateway-http" ------------- 0.58s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check logging-loki-querier pod is Running in openshift-logging namespace --- 0.58s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify CRD "rulerconfigs.loki.grafana.com" --------------------- 0.57s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.57s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-distributor-grpc" --------------- 0.57s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check reboot-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.57s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-grpc" ------------ 0.57s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-grpc" ------------------- 0.56s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check bootstrap-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.56s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-ingester-http" ------------------ 0.56s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-querier-http" ------------------- 0.56s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.56s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get the openstack-operators project ---------------------------- 0.56s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check logging-loki-index-gateway pod is Running in openshift-logging namespace --- 0.56s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-query-frontend-http" ------------ 0.55s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-gossip-ring" -------------------- 0.55s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "openstack-logging" --------------------------- 0.55s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Get Pod Instance name "Running" -------------------------------- 0.55s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "nova-metadata-internal" ---------------------- 0.54s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check ssh-known-hosts-edpm-deployment pod is Completed in openstack namespace --- 0.54s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check logging-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.54s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-grpc" ----------------- 0.53s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "cluster-logging-operator-metrics" ------------ 0.53s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify CRD "alertingrules.loki.grafana.com" -------------------- 0.53s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : TEST Check telemetry-operator-controller-manager pod is Running in openstack-operators namespace --- 0.53s 2026-03-18 13:58:12,105 p=37483 u=zuul n=ansible | common : Verify Service - "nova-novncproxy-cell1-public" ---------------- 0.53s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Check configure-network-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.53s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-gateway-http" ------------------- 0.53s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Check logging-loki-distributor pod is Running in openshift-logging namespace --- 0.52s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify Service - "nova-public" --------------------------------- 0.52s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Check configure-os-edpm-deployment-openstack-edpm-ipam pod is Completed in openstack namespace --- 0.52s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify Service - "logging-loki-compactor-http" ----------------- 0.52s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Check cluster-logging-operator pod is Running in openshift-logging namespace --- 0.51s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.16s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.16s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.14s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.11s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | telemetry_logging : TEST Get journals nova_compute RHOSO-XXX ----------- 0.10s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.09s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Get loki-operator 2 packagemanifest ---------------------- 0.09s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Verify node_exporter container status -------------------- 0.08s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.08s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.06s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.06s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.06s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.06s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | telemetry_logging : Verify journal entries ------------------------------ 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | telemetry_logging : TEST Get journals ceilometer_agent_compute RHOSO-XXX --- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Verify the file /etc/rsyslog.d/10-telemetry.conf exists --- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Check that glance public endpoint exists ----------------- 0.05s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Verify ceilometer_agent_compute container status --------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Verify container tests ----------------------------------------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Check that glance internal endpoint exists --------------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.04s 2026-03-18 13:58:12,106 p=37483 u=zuul n=ansible | common : TEST Check that nova internal endpoint exists ----------------- 0.04s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.04s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Check that barbican public endpoint exists --------------- 0.04s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Check that nova public endpoint exists ------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Show the containers -------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Show the output of container list ------------------------------ 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify CRD rulerconfigs.loki.grafana.com is found -------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify openshift-logging project exists ------------------ 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Check that barbican internal endpoint exists ------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-querier-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Check that swift public endpoint exists ------------------ 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify CRD lokistacks.loki.grafana.com is found ---------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify openshift-openstack-infra project exists ---------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Check that keystone public endpoint exists --------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Check that neutron public endpoint exists ---------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 13:58:12,107 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Verify CRD recordingrules.loki.grafana.com is found ------ 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Verify openshift project exists -------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Verify CRD alertingrules.loki.grafana.com is found ------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Check that cinderv3 public endpoint exists --------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Check that keystone internal endpoint exists ------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-distributor-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-ingester-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : TEST Check that neutron internal endpoint exists -------------- 0.03s 2026-03-18 13:58:12,108 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Check that cinderv3 internal endpoint exists ------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify openstack-logging service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Check that loki-operator subscription exists in openshift-operators-redhat namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-gateway-http service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-index-gateway-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify nova-metadata-internal service is running in openstack namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Check that placement public endpoint exists -------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Check that placement internal endpoint exists ------------ 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Check that swift internal endpoint exists ---------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-query-frontend-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify nova-public service is running in openstack namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify nova-novncproxy-cell1-public service is running in openstack namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-querier-grpc service is running in openshift-logging namespace --- 0.03s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-compactor-http service is running in openshift-logging namespace --- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run pod tests -------------------------------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify logging-loki-gossip-ring service is running in openshift-logging namespace --- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : TEST Verify cluster-logging-operator-metrics service is running in openshift-logging namespace --- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Show the container name and status ----------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 13:58:12,109 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : TEST Verify openstack-operators project exists ---------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : TEST Verify nova-internal service is running in openstack namespace --- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run CR tests --------------------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run service tests ---------------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Check that each package manifest is present -------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run endpoint tests --------------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Get the manifest list once ------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run crd tests -------------------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run subscription tests ----------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run file tests ------------------------------------------------- 0.02s 2026-03-18 13:58:12,110 p=37483 u=zuul n=ansible | common : Run project tests ---------------------------------------------- 0.02s